2024-09-21T06:59:23.061 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T06:59:23.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:59:23.168 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913583 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913583' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 1843221895adccfb3b692060251dd6a0183bc410 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL43sKeP6R9KcuWVBsFcMxrKv75tnVaFDvA1/08XB1da84wwmiYMtAr+FPe0Csswiz2SSfrnUlznCj155QiWc2A= smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHvp75kUe2TIR4mrNBH8gVLcjijJ1ZiqfL25SRTtUzT57NFtX4lkX3xqGM8y978gLdS1ELCTex3eJlRUmB4EJkU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - check-counter: counters: mgr: - min: 4 name: finisher-volumes.complete_latency.avgcount - expected_val: 0 name: finisher-volumes.queue_len - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestPerModuleFinsherThread teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T06:59:23.169 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T06:59:23.169 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T06:59:23.169 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T06:59:23.171 INFO:teuthology.task.internal:Checking packages... 2024-09-21T06:59:23.192 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T06:59:23.192 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T06:59:23.192 INFO:teuthology.packaging:ref: None 2024-09-21T06:59:23.192 INFO:teuthology.packaging:tag: None 2024-09-21T06:59:23.192 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:59:23.192 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:59:23.192 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:59:23.331 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T06:59:23.332 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T06:59:23.346 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T06:59:23.346 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T06:59:23.446 INFO:teuthology.task.internal:Saving configuration 2024-09-21T06:59:23.467 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T06:59:23.474 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T06:59:23.499 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913583', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:53:11.829524', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL43sKeP6R9KcuWVBsFcMxrKv75tnVaFDvA1/08XB1da84wwmiYMtAr+FPe0Csswiz2SSfrnUlznCj155QiWc2A='} 2024-09-21T06:59:23.521 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913583', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:53:11.831298', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHvp75kUe2TIR4mrNBH8gVLcjijJ1ZiqfL25SRTtUzT57NFtX4lkX3xqGM8y978gLdS1ELCTex3eJlRUmB4EJkU='} 2024-09-21T06:59:23.521 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T06:59:23.529 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-21T06:59:23.529 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-21T06:59:23.529 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T06:59:23.590 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb7fddf8160>, signals=[15]) 2024-09-21T06:59:23.590 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T06:59:23.596 INFO:teuthology.task.internal:Opening connections... 2024-09-21T06:59:23.596 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T06:59:23.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:59:23.675 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T06:59:23.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:59:23.757 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T06:59:23.764 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-09-21T06:59:23.782 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-09-21T06:59:23.782 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-09-21T06:59:23.839 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-09-21T06:59:23.840 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-09-21T06:59:23.840 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-09-21T06:59:23.840 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:59:23.840 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-09-21T06:59:23.840 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:59:23.840 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:59:23.840 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-09-21T06:59:23.840 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:59:23.840 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:59:23.840 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:59:23.840 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:59:23.840 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:59:23.840 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:59:23.841 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-09-21T06:59:23.865 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-09-21T06:59:23.884 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-09-21T06:59:23.885 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-09-21T06:59:23.944 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-09-21T06:59:23.944 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2024-09-21T06:59:23.944 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-09-21T06:59:23.945 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:59:23.945 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2024-09-21T06:59:23.945 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:59:23.945 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:59:23.945 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-09-21T06:59:23.945 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:59:23.945 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:59:23.945 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:59:23.945 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:59:23.945 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:59:23.945 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:59:23.946 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-09-21T06:59:23.965 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T06:59:23.974 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T06:59:24.013 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T06:59:24.013 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:59:24.015 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:59:24.033 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T06:59:24.039 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T06:59:24.039 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:59:24.074 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:59:24.103 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T06:59:24.155 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T06:59:24.169 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T06:59:24.169 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-21T06:59:24.169 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-21T06:59:24.169 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:59:24.170 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:59:24.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:59:24.187 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-21T06:59:24.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:59:24.188 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-09-21T06:59:24.244 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-503.el9.x86_64 2024-09-21T06:59:24.244 INFO:teuthology.task.kernel:Running kernel on smithi018: 5.14.0-503.el9.x86_64 2024-09-21T06:59:24.245 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum install -y kernel 2024-09-21T06:59:24.247 INFO:teuthology.orchestra.run.smithi049.stdout:5.14.0-503.el9.x86_64 2024-09-21T06:59:24.247 INFO:teuthology.task.kernel:Running kernel on smithi049: 5.14.0-503.el9.x86_64 2024-09-21T06:59:24.247 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum install -y kernel 2024-09-21T06:59:27.608 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.3 MB 00:01 2024-09-21T06:59:28.760 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.3 MB 00:02 2024-09-21T06:59:33.092 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 20 MB 00:04 2024-09-21T06:59:34.543 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-21T06:59:38.734 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-21T06:59:40.069 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-21T06:59:40.160 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - Extras packages 133 kB/s | 19 kB 00:00 2024-09-21T06:59:40.981 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-21T06:59:41.794 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-21T06:59:42.815 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-21T06:59:46.578 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T06:59:48.537 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T06:59:48.601 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T06:59:48.601 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T06:59:48.701 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-21T06:59:48.710 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-21T06:59:48.711 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2024-09-21T06:59:48.711 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-21T06:59:48.711 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-21T06:59:48.711 INFO:teuthology.orchestra.run.smithi049.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T06:59:48.711 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-09-21T06:59:48.711 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T06:59:48.711 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T06:59:48.711 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T06:59:48.711 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:59:48.711 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-21T06:59:48.711 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-21T06:59:48.711 INFO:teuthology.orchestra.run.smithi049.stdout:Install 4 Packages 2024-09-21T06:59:48.711 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:59:48.712 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 79 M 2024-09-21T06:59:48.712 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 126 M 2024-09-21T06:59:48.712 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-21T06:59:48.855 INFO:teuthology.orchestra.run.smithi049.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 370 kB/s | 36 kB 00:00 2024-09-21T06:59:49.247 INFO:teuthology.orchestra.run.smithi049.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-21T06:59:49.630 INFO:teuthology.orchestra.run.smithi049.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-21T06:59:49.947 INFO:teuthology.orchestra.run.smithi049.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-21T06:59:49.947 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:59:49.947 INFO:teuthology.orchestra.run.smithi049.stdout:Total 64 MB/s | 79 MB 00:01 2024-09-21T06:59:50.544 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T06:59:50.544 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T06:59:50.653 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-21T06:59:50.657 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-21T06:59:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: Package Architecture Version Repository Size 2024-09-21T06:59:50.657 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-21T06:59:50.657 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-21T06:59:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T06:59:50.657 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-21T06:59:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T06:59:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T06:59:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T06:59:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:59:50.658 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-21T06:59:50.658 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-21T06:59:50.658 INFO:teuthology.orchestra.run.smithi018.stdout:Install 4 Packages 2024-09-21T06:59:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:59:50.658 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 79 M 2024-09-21T06:59:50.658 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 126 M 2024-09-21T06:59:50.659 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-21T06:59:50.663 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-21T06:59:50.997 INFO:teuthology.orchestra.run.smithi018.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 448 kB/s | 36 kB 00:00 2024-09-21T06:59:51.092 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-21T06:59:51.092 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-21T06:59:52.101 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-21T06:59:52.101 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-21T06:59:52.306 INFO:teuthology.orchestra.run.smithi018.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 22 MB/s | 29 MB 00:01 2024-09-21T06:59:52.756 INFO:teuthology.orchestra.run.smithi018.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 19 MB/s | 35 MB 00:01 2024-09-21T06:59:54.689 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-21T06:59:55.106 INFO:teuthology.orchestra.run.smithi018.stdout:(4/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-09-21T06:59:55.106 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:59:55.106 INFO:teuthology.orchestra.run.smithi018.stdout:Total 18 MB/s | 79 MB 00:04 2024-09-21T06:59:55.369 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:59:55.448 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:59:55.816 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-21T06:59:56.201 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-21T06:59:56.202 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-21T06:59:57.178 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-21T06:59:57.179 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-21T06:59:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:59:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:59:59.755 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-21T07:00:00.435 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T07:00:00.515 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:00:03.289 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:00:03.426 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:00:03.706 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:00:03.735 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:00:08.555 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:00:08.602 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:00:08.973 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:00:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:00:48.792 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:00:48.834 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:00:49.184 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:00:49.184 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T07:00:49.184 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:00:49.184 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:00:49.984 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:00:49.984 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:00:49.984 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-21T07:00:49.984 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T07:00:49.984 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T07:00:49.984 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T07:00:49.984 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T07:00:49.984 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:00:49.984 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-21T07:00:50.375 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:00:50.452 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:00:50.452 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:00:50.452 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T07:00:50.453 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T07:00:50.453 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T07:00:50.453 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-21T07:00:50.453 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi049.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T07:00:50.453 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:00:50.513 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:00:50.514 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:00:50.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo rpm -qi grub2-tools 2024-09-21T07:00:50.553 INFO:teuthology.orchestra.run.smithi049.stdout:Name : grub2-tools 2024-09-21T07:00:50.553 INFO:teuthology.orchestra.run.smithi049.stdout:Epoch : 1 2024-09-21T07:00:50.553 INFO:teuthology.orchestra.run.smithi049.stdout:Version : 2.06 2024-09-21T07:00:50.553 INFO:teuthology.orchestra.run.smithi049.stdout:Release : 82.el9 2024-09-21T07:00:50.553 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: x86_64 2024-09-21T07:00:50.553 INFO:teuthology.orchestra.run.smithi049.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T07:00:50.554 INFO:teuthology.orchestra.run.smithi049.stdout:Group : Unspecified 2024-09-21T07:00:50.554 INFO:teuthology.orchestra.run.smithi049.stdout:Size : 8274670 2024-09-21T07:00:50.554 INFO:teuthology.orchestra.run.smithi049.stdout:License : GPLv3+ 2024-09-21T07:00:50.554 INFO:teuthology.orchestra.run.smithi049.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T07:00:50.554 INFO:teuthology.orchestra.run.smithi049.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T07:00:50.554 INFO:teuthology.orchestra.run.smithi049.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T07:00:50.555 INFO:teuthology.orchestra.run.smithi049.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T07:00:50.555 INFO:teuthology.orchestra.run.smithi049.stdout:Packager : builder@centos.org 2024-09-21T07:00:50.555 INFO:teuthology.orchestra.run.smithi049.stdout:Vendor : CentOS 2024-09-21T07:00:50.555 INFO:teuthology.orchestra.run.smithi049.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T07:00:50.555 INFO:teuthology.orchestra.run.smithi049.stdout:Summary : Support tools for GRUB. 2024-09-21T07:00:50.555 INFO:teuthology.orchestra.run.smithi049.stdout:Description : 2024-09-21T07:00:50.556 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:00:50.556 INFO:teuthology.orchestra.run.smithi049.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T07:00:50.556 INFO:teuthology.orchestra.run.smithi049.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T07:00:50.556 INFO:teuthology.orchestra.run.smithi049.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T07:00:50.556 INFO:teuthology.orchestra.run.smithi049.stdout:hardware devices. 2024-09-21T07:00:50.556 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:00:50.556 INFO:teuthology.orchestra.run.smithi049.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T07:00:50.558 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T07:00:50.558 INFO:teuthology.task.kernel:Updating grub on smithi049 to boot 5.14.0-508.el9.x86_64 2024-09-21T07:00:50.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T07:00:51.181 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2024-09-21T07:00:52.530 INFO:teuthology.orchestra.run.smithi049.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T07:00:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:done 2024-09-21T07:00:52.573 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-09-21T07:00:52.583 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:00:52.590 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.0UqdARrotr 2024-09-21T07:00:52.590 DEBUG:teuthology.orchestra.run.smithi049:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0UqdARrotr 2024-09-21T07:00:52.625 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:00:52.657 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.0UqdARrotr 2024-09-21T07:00:52.793 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.0UqdARrotr is 6KB 2024-09-21T07:00:52.842 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.0UqdARrotr 2024-09-21T07:00:52.858 DEBUG:teuthology.orchestra.run.smithi049:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T07:00:52.921 INFO:teuthology.orchestra.run.smithi049.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T07:00:52.921 INFO:teuthology.orchestra.run.smithi049.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T07:00:52.921 INFO:teuthology.orchestra.run.smithi049.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T07:00:52.921 INFO:teuthology.orchestra.run.smithi049.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T07:00:52.922 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T07:00:52.995 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:00:52.995 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T07:00:52.995 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:00:52.995 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:00:53.061 DEBUG:teuthology.orchestra.run.smithi049:> sudo shutdown -r now 2024-09-21T07:00:53.822 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:00:53.823 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:00:53.823 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-21T07:00:53.823 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T07:00:53.823 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T07:00:53.823 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T07:00:53.823 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T07:00:53.823 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:00:53.823 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-21T07:00:54.154 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:00:54.243 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:00:54.244 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:00:54.244 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T07:00:54.244 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T07:00:54.244 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T07:00:54.244 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T07:00:54.244 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T07:00:54.244 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:00:54.302 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:00:54.303 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:00:54.303 DEBUG:teuthology.orchestra.run.smithi018:> sudo rpm -qi grub2-tools 2024-09-21T07:00:54.337 INFO:teuthology.orchestra.run.smithi018.stdout:Name : grub2-tools 2024-09-21T07:00:54.337 INFO:teuthology.orchestra.run.smithi018.stdout:Epoch : 1 2024-09-21T07:00:54.337 INFO:teuthology.orchestra.run.smithi018.stdout:Version : 2.06 2024-09-21T07:00:54.337 INFO:teuthology.orchestra.run.smithi018.stdout:Release : 82.el9 2024-09-21T07:00:54.338 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: x86_64 2024-09-21T07:00:54.338 INFO:teuthology.orchestra.run.smithi018.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T07:00:54.338 INFO:teuthology.orchestra.run.smithi018.stdout:Group : Unspecified 2024-09-21T07:00:54.338 INFO:teuthology.orchestra.run.smithi018.stdout:Size : 8274670 2024-09-21T07:00:54.338 INFO:teuthology.orchestra.run.smithi018.stdout:License : GPLv3+ 2024-09-21T07:00:54.338 INFO:teuthology.orchestra.run.smithi018.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T07:00:54.338 INFO:teuthology.orchestra.run.smithi018.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T07:00:54.338 INFO:teuthology.orchestra.run.smithi018.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T07:00:54.338 INFO:teuthology.orchestra.run.smithi018.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T07:00:54.338 INFO:teuthology.orchestra.run.smithi018.stdout:Packager : builder@centos.org 2024-09-21T07:00:54.338 INFO:teuthology.orchestra.run.smithi018.stdout:Vendor : CentOS 2024-09-21T07:00:54.338 INFO:teuthology.orchestra.run.smithi018.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T07:00:54.338 INFO:teuthology.orchestra.run.smithi018.stdout:Summary : Support tools for GRUB. 2024-09-21T07:00:54.338 INFO:teuthology.orchestra.run.smithi018.stdout:Description : 2024-09-21T07:00:54.338 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:00:54.339 INFO:teuthology.orchestra.run.smithi018.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T07:00:54.339 INFO:teuthology.orchestra.run.smithi018.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T07:00:54.339 INFO:teuthology.orchestra.run.smithi018.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T07:00:54.339 INFO:teuthology.orchestra.run.smithi018.stdout:hardware devices. 2024-09-21T07:00:54.339 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:00:54.339 INFO:teuthology.orchestra.run.smithi018.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T07:00:54.340 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T07:00:54.340 INFO:teuthology.task.kernel:Updating grub on smithi018 to boot 5.14.0-508.el9.x86_64 2024-09-21T07:00:54.340 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T07:00:54.946 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-09-21T07:00:56.332 INFO:teuthology.orchestra.run.smithi018.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T07:00:56.372 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-09-21T07:00:56.374 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-21T07:00:56.412 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.VfCB944nnI 2024-09-21T07:00:56.412 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VfCB944nnI 2024-09-21T07:00:56.485 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.VfCB944nnI 2024-09-21T07:00:56.623 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.VfCB944nnI is 6KB 2024-09-21T07:00:56.671 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.VfCB944nnI 2024-09-21T07:00:56.685 DEBUG:teuthology.orchestra.run.smithi018:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T07:00:56.747 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T07:00:56.748 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T07:00:56.748 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T07:00:56.748 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T07:00:56.749 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T07:00:56.917 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2024-09-21T07:01:23.086 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-21T07:01:23.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T07:01:23.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:01:26.922 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T07:01:26.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-21T07:01:26.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:01:57.619 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-21T07:02:06.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T07:02:06.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:02:09.679 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-21T07:02:21.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T07:02:21.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:02:24.751 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-21T07:02:26.925 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T07:02:35.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-21T07:02:35.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:02:36.304 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-21T07:02:36.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-21T07:02:36.837 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T07:02:36.837 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-21T07:02:36.852 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-508.el9.x86_64 2024-09-21T07:02:36.852 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T07:02:36.853 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T07:02:36.853 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T07:02:37.854 DEBUG:teuthology.parallel:result is None 2024-09-21T07:02:39.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T07:02:39.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:03:39.754 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T07:03:57.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T07:03:57.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:03:58.049 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-09-21T07:03:58.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T07:03:58.405 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-508.el9.x86_64"... 2024-09-21T07:03:58.405 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-09-21T07:03:58.422 INFO:teuthology.orchestra.run.smithi049.stdout:5.14.0-508.el9.x86_64 2024-09-21T07:03:58.422 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T07:03:58.422 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T07:03:58.422 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T07:03:59.422 DEBUG:teuthology.parallel:result is None 2024-09-21T07:03:59.423 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T07:03:59.434 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T07:03:59.435 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T07:03:59.438 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T07:03:59.457 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T07:03:59.469 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T07:03:59.483 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T07:03:59.483 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T07:03:59.498 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T07:03:59.531 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T07:03:59.543 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T07:03:59.543 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T07:03:59.563 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T07:03:59.667 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:03:59.689 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:03:59.691 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:03:59.703 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:03:59.705 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T07:03:59.717 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T07:03:59.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T07:03:59.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T07:03:59.749 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T07:03:59.763 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T07:03:59.763 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T07:03:59.790 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T07:03:59.807 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:03:59.895 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:03:59.945 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:04:00.027 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:04:00.076 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:04:00.076 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T07:04:00.147 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:04:00.189 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:04:00.242 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:04:00.325 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:04:00.370 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:04:00.370 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T07:04:00.437 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-09-21T07:04:00.439 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2024-09-21T07:04:00.495 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:04:00.529 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:04:00.893 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T07:04:00.911 INFO:teuthology.task.internal:Starting timer... 2024-09-21T07:04:00.911 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T07:04:00.965 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T07:04:00.985 DEBUG:teuthology.orchestra.run.smithi018:> sudo service auditd rotate 2024-09-21T07:04:01.053 INFO:teuthology.orchestra.run.smithi018.stdout:Rotating logs: 2024-09-21T07:04:01.056 DEBUG:teuthology.orchestra.run.smithi049:> sudo service auditd rotate 2024-09-21T07:04:01.117 INFO:teuthology.orchestra.run.smithi049.stdout:Rotating logs: 2024-09-21T07:04:01.119 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T07:04:01.119 DEBUG:teuthology.orchestra.run.smithi018:> /usr/sbin/getenforce 2024-09-21T07:04:01.145 INFO:teuthology.orchestra.run.smithi018.stdout:Permissive 2024-09-21T07:04:01.145 DEBUG:teuthology.orchestra.run.smithi049:> /usr/sbin/getenforce 2024-09-21T07:04:01.167 INFO:teuthology.orchestra.run.smithi049.stdout:Permissive 2024-09-21T07:04:01.167 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi018.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi049.front.sepia.ceph.com': 'permissive'} 2024-09-21T07:04:01.167 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T07:04:01.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:04:01.215 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T07:04:01.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:04:01.245 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T07:04:01.245 DEBUG:teuthology.orchestra.run.smithi018:> sudo /usr/sbin/setenforce permissive 2024-09-21T07:04:01.286 DEBUG:teuthology.orchestra.run.smithi049:> sudo /usr/sbin/setenforce permissive 2024-09-21T07:04:01.323 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T07:04:01.333 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T07:04:01.336 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T07:04:01.457 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T07:04:01.467 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T07:04:01.469 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi049.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T07:07:57.326 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi049.front.sepia.ceph.com')] 2024-09-21T07:07:57.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-21T07:07:57.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:07:57.402 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-21T07:07:57.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-21T07:07:57.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T07:07:57.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:07:57.556 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-09-21T07:07:57.639 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T07:07:57.639 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T07:07:57.653 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T07:07:57.653 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T07:07:57.654 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:07:57.656 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T07:07:57.656 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:07:57.684 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T07:07:57.700 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T07:07:57.710 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T07:07:57.726 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: ntpd: command not found 2024-09-21T07:07:57.726 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T07:07:57.738 INFO:teuthology.orchestra.run.smithi018.stdout:506 Cannot talk to daemon 2024-09-21T07:07:57.753 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: ntpd: command not found 2024-09-21T07:07:57.753 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T07:07:57.765 INFO:teuthology.orchestra.run.smithi049.stdout:506 Cannot talk to daemon 2024-09-21T07:07:57.768 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T07:07:57.780 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T07:07:57.795 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T07:07:57.826 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:07:57.829 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:07:57.829 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-21T07:07:57.829 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:07:57.829 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:07:57.829 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:07:57.829 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:07:57.853 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:07:57.856 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:07:57.856 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-09-21T07:07:57.856 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:07:57.856 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:07:57.856 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:07:57.856 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:07:57.857 INFO:teuthology.run_tasks:Running task install... 2024-09-21T07:07:57.865 DEBUG:teuthology.task.install:project ceph 2024-09-21T07:07:57.865 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T07:07:57.865 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T07:07:57.865 INFO:teuthology.task.install:Using flavor: default 2024-09-21T07:07:57.870 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T07:07:57.870 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T07:07:57.870 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T07:07:57.871 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:07:57.872 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T07:07:57.872 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:07:58.021 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T07:07:58.021 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T07:07:58.038 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T07:07:58.038 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T07:07:58.128 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T07:07:58.129 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:07:58.129 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T07:07:58.142 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T07:07:58.142 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:07:58.142 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T07:07:58.156 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T07:07:58.156 DEBUG:teuthology.orchestra.run.smithi018:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T07:07:58.169 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T07:07:58.169 DEBUG:teuthology.orchestra.run.smithi049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T07:07:58.222 DEBUG:teuthology.orchestra.run.smithi018:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T07:07:58.236 DEBUG:teuthology.orchestra.run.smithi049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T07:07:58.299 DEBUG:teuthology.orchestra.run.smithi018:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T07:07:58.313 DEBUG:teuthology.orchestra.run.smithi049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T07:07:58.363 INFO:teuthology.orchestra.run.smithi018.stdout:check_obsoletes = 1 2024-09-21T07:07:58.365 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum clean all 2024-09-21T07:07:58.378 INFO:teuthology.orchestra.run.smithi049.stdout:check_obsoletes = 1 2024-09-21T07:07:58.379 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum clean all 2024-09-21T07:07:58.604 INFO:teuthology.orchestra.run.smithi018.stdout:45 files removed 2024-09-21T07:07:58.610 INFO:teuthology.orchestra.run.smithi049.stdout:45 files removed 2024-09-21T07:07:58.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T07:07:58.638 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T07:07:59.197 INFO:teuthology.orchestra.run.smithi018.stdout:ceph packages for x86_64 317 kB/s | 84 kB 00:00 2024-09-21T07:07:59.214 INFO:teuthology.orchestra.run.smithi049.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-21T07:07:59.498 INFO:teuthology.orchestra.run.smithi018.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-21T07:07:59.523 INFO:teuthology.orchestra.run.smithi049.stdout:ceph noarch packages 92 kB/s | 24 kB 00:00 2024-09-21T07:07:59.782 INFO:teuthology.orchestra.run.smithi018.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-21T07:07:59.807 INFO:teuthology.orchestra.run.smithi049.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-21T07:08:00.382 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-21T07:08:01.765 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.3 MB 00:01 2024-09-21T07:08:02.075 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-21T07:08:03.601 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-21T07:08:07.935 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-21T07:08:08.276 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-21T07:08:09.877 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-21T07:08:09.993 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 19 kB 00:00 2024-09-21T07:08:10.956 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-21T07:08:11.189 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-21T07:08:16.762 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-21T07:08:16.820 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-21T07:08:19.072 INFO:teuthology.orchestra.run.smithi018.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:08:19.073 INFO:teuthology.orchestra.run.smithi018.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:08:19.085 INFO:teuthology.orchestra.run.smithi018.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T07:08:19.085 INFO:teuthology.orchestra.run.smithi018.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T07:08:19.086 INFO:teuthology.orchestra.run.smithi018.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T07:08:19.087 INFO:teuthology.orchestra.run.smithi018.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T07:08:19.089 INFO:teuthology.orchestra.run.smithi049.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:08:19.089 INFO:teuthology.orchestra.run.smithi018.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T07:08:19.090 INFO:teuthology.orchestra.run.smithi049.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:08:19.091 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T07:08:19.092 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T07:08:19.101 INFO:teuthology.orchestra.run.smithi049.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T07:08:19.102 INFO:teuthology.orchestra.run.smithi049.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T07:08:19.103 INFO:teuthology.orchestra.run.smithi049.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T07:08:19.104 INFO:teuthology.orchestra.run.smithi049.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T07:08:19.106 INFO:teuthology.orchestra.run.smithi049.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T07:08:19.108 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T07:08:19.109 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T07:08:19.159 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-21T07:08:19.176 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-21T07:08:19.182 INFO:teuthology.orchestra.run.smithi018.stdout:======================================================================================= 2024-09-21T07:08:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-21T07:08:19.182 INFO:teuthology.orchestra.run.smithi018.stdout:======================================================================================= 2024-09-21T07:08:19.182 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-21T07:08:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T07:08:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T07:08:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T07:08:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T07:08:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:08:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T07:08:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T07:08:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T07:08:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T07:08:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T07:08:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T07:08:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T07:08:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T07:08:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T07:08:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T07:08:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T07:08:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T07:08:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T07:08:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T07:08:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T07:08:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T07:08:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T07:08:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T07:08:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T07:08:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T07:08:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T07:08:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T07:08:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T07:08:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T07:08:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T07:08:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T07:08:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T07:08:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T07:08:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T07:08:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T07:08:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T07:08:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T07:08:19.185 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrading: 2024-09-21T07:08:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T07:08:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T07:08:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T07:08:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T07:08:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T07:08:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T07:08:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T07:08:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T07:08:19.186 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-21T07:08:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T07:08:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T07:08:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T07:08:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T07:08:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T07:08:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T07:08:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T07:08:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T07:08:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T07:08:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T07:08:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T07:08:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T07:08:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T07:08:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T07:08:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T07:08:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T07:08:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T07:08:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T07:08:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T07:08:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T07:08:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T07:08:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T07:08:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T07:08:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T07:08:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T07:08:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T07:08:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T07:08:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T07:08:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T07:08:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T07:08:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T07:08:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T07:08:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T07:08:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T07:08:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T07:08:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T07:08:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T07:08:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T07:08:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T07:08:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T07:08:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T07:08:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T07:08:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T07:08:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T07:08:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T07:08:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T07:08:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T07:08:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:08:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T07:08:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T07:08:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T07:08:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T07:08:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T07:08:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T07:08:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T07:08:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T07:08:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T07:08:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T07:08:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T07:08:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T07:08:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T07:08:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T07:08:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T07:08:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T07:08:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T07:08:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T07:08:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T07:08:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T07:08:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T07:08:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T07:08:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T07:08:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T07:08:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T07:08:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T07:08:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T07:08:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T07:08:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T07:08:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T07:08:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T07:08:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T07:08:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T07:08:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T07:08:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T07:08:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T07:08:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T07:08:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T07:08:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T07:08:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T07:08:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T07:08:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T07:08:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T07:08:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T07:08:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T07:08:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T07:08:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T07:08:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T07:08:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T07:08:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T07:08:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T07:08:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T07:08:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T07:08:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T07:08:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T07:08:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T07:08:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T07:08:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T07:08:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T07:08:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T07:08:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T07:08:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T07:08:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T07:08:19.202 INFO:teuthology.orchestra.run.smithi018.stdout:Installing weak dependencies: 2024-09-21T07:08:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T07:08:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:08:19.203 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-21T07:08:19.203 INFO:teuthology.orchestra.run.smithi018.stdout:======================================================================================= 2024-09-21T07:08:19.203 INFO:teuthology.orchestra.run.smithi018.stdout:Install 149 Packages 2024-09-21T07:08:19.203 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrade 8 Packages 2024-09-21T07:08:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:08:19.205 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 228 M 2024-09-21T07:08:19.205 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-21T07:08:19.205 INFO:teuthology.orchestra.run.smithi049.stdout:======================================================================================= 2024-09-21T07:08:19.205 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-09-21T07:08:19.205 INFO:teuthology.orchestra.run.smithi049.stdout:======================================================================================= 2024-09-21T07:08:19.205 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-21T07:08:19.205 INFO:teuthology.orchestra.run.smithi049.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T07:08:19.205 INFO:teuthology.orchestra.run.smithi049.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T07:08:19.205 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T07:08:19.205 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T07:08:19.205 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:08:19.205 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T07:08:19.205 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T07:08:19.206 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T07:08:19.206 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T07:08:19.206 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T07:08:19.206 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T07:08:19.206 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T07:08:19.206 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T07:08:19.206 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T07:08:19.206 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T07:08:19.206 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T07:08:19.206 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T07:08:19.206 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T07:08:19.206 INFO:teuthology.orchestra.run.smithi049.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T07:08:19.206 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T07:08:19.207 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T07:08:19.207 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T07:08:19.207 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T07:08:19.207 INFO:teuthology.orchestra.run.smithi049.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T07:08:19.207 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T07:08:19.207 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T07:08:19.207 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T07:08:19.207 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T07:08:19.207 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T07:08:19.207 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T07:08:19.207 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T07:08:19.207 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T07:08:19.207 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T07:08:19.207 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T07:08:19.208 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T07:08:19.208 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T07:08:19.208 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T07:08:19.208 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrading: 2024-09-21T07:08:19.208 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T07:08:19.208 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T07:08:19.208 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T07:08:19.208 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T07:08:19.208 INFO:teuthology.orchestra.run.smithi049.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T07:08:19.208 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T07:08:19.208 INFO:teuthology.orchestra.run.smithi049.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T07:08:19.208 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T07:08:19.208 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-09-21T07:08:19.208 INFO:teuthology.orchestra.run.smithi049.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T07:08:19.209 INFO:teuthology.orchestra.run.smithi049.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T07:08:19.209 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T07:08:19.209 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T07:08:19.209 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T07:08:19.209 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T07:08:19.209 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T07:08:19.209 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T07:08:19.209 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T07:08:19.209 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T07:08:19.209 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T07:08:19.209 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T07:08:19.209 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T07:08:19.209 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T07:08:19.210 INFO:teuthology.orchestra.run.smithi049.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T07:08:19.210 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T07:08:19.210 INFO:teuthology.orchestra.run.smithi049.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T07:08:19.210 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T07:08:19.210 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T07:08:19.210 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T07:08:19.210 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T07:08:19.210 INFO:teuthology.orchestra.run.smithi049.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T07:08:19.210 INFO:teuthology.orchestra.run.smithi049.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T07:08:19.210 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T07:08:19.210 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T07:08:19.210 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T07:08:19.210 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T07:08:19.211 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T07:08:19.211 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T07:08:19.211 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T07:08:19.211 INFO:teuthology.orchestra.run.smithi049.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T07:08:19.211 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T07:08:19.211 INFO:teuthology.orchestra.run.smithi049.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T07:08:19.211 INFO:teuthology.orchestra.run.smithi049.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T07:08:19.211 INFO:teuthology.orchestra.run.smithi049.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T07:08:19.211 INFO:teuthology.orchestra.run.smithi049.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T07:08:19.211 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T07:08:19.211 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T07:08:19.211 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T07:08:19.211 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T07:08:19.211 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T07:08:19.212 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T07:08:19.212 INFO:teuthology.orchestra.run.smithi049.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T07:08:19.212 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T07:08:19.212 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T07:08:19.212 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T07:08:19.212 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T07:08:19.212 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:08:19.212 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T07:08:19.212 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T07:08:19.212 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T07:08:19.212 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T07:08:19.212 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T07:08:19.212 INFO:teuthology.orchestra.run.smithi049.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T07:08:19.212 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T07:08:19.213 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T07:08:19.213 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T07:08:19.213 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T07:08:19.213 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T07:08:19.213 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T07:08:19.213 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T07:08:19.213 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T07:08:19.213 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T07:08:19.213 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T07:08:19.213 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T07:08:19.213 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T07:08:19.213 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T07:08:19.213 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T07:08:19.213 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T07:08:19.214 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T07:08:19.214 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T07:08:19.214 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T07:08:19.214 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T07:08:19.214 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T07:08:19.214 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T07:08:19.214 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T07:08:19.214 INFO:teuthology.orchestra.run.smithi049.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T07:08:19.214 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T07:08:19.214 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T07:08:19.214 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T07:08:19.214 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T07:08:19.214 INFO:teuthology.orchestra.run.smithi049.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T07:08:19.214 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T07:08:19.215 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T07:08:19.215 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T07:08:19.215 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T07:08:19.215 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T07:08:19.215 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T07:08:19.215 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T07:08:19.215 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T07:08:19.215 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T07:08:19.215 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T07:08:19.215 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T07:08:19.215 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T07:08:19.215 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T07:08:19.215 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T07:08:19.215 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T07:08:19.215 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T07:08:19.216 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T07:08:19.216 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T07:08:19.216 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T07:08:19.216 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T07:08:19.216 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T07:08:19.216 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T07:08:19.216 INFO:teuthology.orchestra.run.smithi049.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T07:08:19.216 INFO:teuthology.orchestra.run.smithi049.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T07:08:19.216 INFO:teuthology.orchestra.run.smithi049.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T07:08:19.216 INFO:teuthology.orchestra.run.smithi049.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T07:08:19.216 INFO:teuthology.orchestra.run.smithi049.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T07:08:19.216 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi049.stdout:Installing weak dependencies: 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi049.stdout:======================================================================================= 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi049.stdout:Install 149 Packages 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrade 8 Packages 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 228 M 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-21T07:08:19.905 INFO:teuthology.orchestra.run.smithi018.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 45 kB/s | 6.6 kB 00:00 2024-09-21T07:08:19.921 INFO:teuthology.orchestra.run.smithi049.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-09-21T07:08:20.305 INFO:teuthology.orchestra.run.smithi049.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.2 MB/s | 873 kB 00:00 2024-09-21T07:08:20.338 INFO:teuthology.orchestra.run.smithi018.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.0 MB/s | 873 kB 00:00 2024-09-21T07:08:20.380 INFO:teuthology.orchestra.run.smithi049.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.9 MB/s | 148 kB 00:00 2024-09-21T07:08:20.414 INFO:teuthology.orchestra.run.smithi018.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.9 MB/s | 148 kB 00:00 2024-09-21T07:08:20.480 INFO:teuthology.orchestra.run.smithi049.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 7.9 MB/s | 5.5 MB 00:00 2024-09-21T07:08:20.539 INFO:teuthology.orchestra.run.smithi018.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 7.1 MB/s | 5.5 MB 00:00 2024-09-21T07:08:20.664 INFO:teuthology.orchestra.run.smithi049.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 8.3 MB/s | 1.5 MB 00:00 2024-09-21T07:08:20.689 INFO:teuthology.orchestra.run.smithi018.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 10 MB/s | 1.5 MB 00:00 2024-09-21T07:08:20.881 INFO:teuthology.orchestra.run.smithi049.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 4.6 MB/s | 2.3 MB 00:00 2024-09-21T07:08:20.990 INFO:teuthology.orchestra.run.smithi018.stdout:(6/157): ceph-common-19.3.0-5120.g18432218.el9. 16 MB/s | 20 MB 00:01 2024-09-21T07:08:21.040 INFO:teuthology.orchestra.run.smithi018.stdout:(7/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 3.7 MB/s | 2.3 MB 00:00 2024-09-21T07:08:21.047 INFO:teuthology.orchestra.run.smithi049.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 13 MB/s | 5.0 MB 00:00 2024-09-21T07:08:21.123 INFO:teuthology.orchestra.run.smithi018.stdout:(8/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 11 MB/s | 5.0 MB 00:00 2024-09-21T07:08:21.223 INFO:teuthology.orchestra.run.smithi018.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 253 kB/s | 25 kB 00:00 2024-09-21T07:08:22.139 INFO:teuthology.orchestra.run.smithi049.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 9.5 MB/s | 10 MB 00:01 2024-09-21T07:08:22.165 INFO:teuthology.orchestra.run.smithi018.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 15 MB/s | 18 MB 00:01 2024-09-21T07:08:22.181 INFO:teuthology.orchestra.run.smithi049.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 608 kB/s | 25 kB 00:00 2024-09-21T07:08:22.232 INFO:teuthology.orchestra.run.smithi018.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.3 MB/s | 226 kB 00:00 2024-09-21T07:08:22.299 INFO:teuthology.orchestra.run.smithi018.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 405 kB/s | 27 kB 00:00 2024-09-21T07:08:22.366 INFO:teuthology.orchestra.run.smithi018.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 477 kB/s | 32 kB 00:00 2024-09-21T07:08:22.441 INFO:teuthology.orchestra.run.smithi018.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 10 MB/s | 766 kB 00:00 2024-09-21T07:08:22.500 INFO:teuthology.orchestra.run.smithi018.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.7 MB/s | 158 kB 00:00 2024-09-21T07:08:22.506 INFO:teuthology.orchestra.run.smithi049.stdout:(10/157): ceph-common-19.3.0-5120.g18432218.el9 7.3 MB/s | 20 MB 00:02 2024-09-21T07:08:22.559 INFO:teuthology.orchestra.run.smithi018.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T07:08:22.582 INFO:teuthology.orchestra.run.smithi049.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 2.9 MB/s | 226 kB 00:00 2024-09-21T07:08:22.634 INFO:teuthology.orchestra.run.smithi018.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 6.6 MB/s | 507 kB 00:00 2024-09-21T07:08:22.657 INFO:teuthology.orchestra.run.smithi049.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 361 kB/s | 27 kB 00:00 2024-09-21T07:08:22.732 INFO:teuthology.orchestra.run.smithi049.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 425 kB/s | 32 kB 00:00 2024-09-21T07:08:22.793 INFO:teuthology.orchestra.run.smithi018.stdout:(18/157): ceph-radosgw-19.3.0-5120.g18432218.el 5.9 MB/s | 10 MB 00:01 2024-09-21T07:08:22.859 INFO:teuthology.orchestra.run.smithi018.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 681 kB/s | 45 kB 00:00 2024-09-21T07:08:22.926 INFO:teuthology.orchestra.run.smithi018.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.2 MB/s | 148 kB 00:00 2024-09-21T07:08:22.991 INFO:teuthology.orchestra.run.smithi049.stdout:(14/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 8.4 MB/s | 18 MB 00:02 2024-09-21T07:08:23.010 INFO:teuthology.orchestra.run.smithi018.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 14 MB/s | 5.3 MB 00:00 2024-09-21T07:08:23.033 INFO:teuthology.orchestra.run.smithi049.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 2.5 MB/s | 766 kB 00:00 2024-09-21T07:08:23.035 INFO:teuthology.orchestra.run.smithi018.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.5 MB/s | 161 kB 00:00 2024-09-21T07:08:23.058 INFO:teuthology.orchestra.run.smithi049.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T07:08:23.069 INFO:teuthology.orchestra.run.smithi018.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T07:08:23.083 INFO:teuthology.orchestra.run.smithi049.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T07:08:23.102 INFO:teuthology.orchestra.run.smithi018.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 4.5 MB/s | 307 kB 00:00 2024-09-21T07:08:23.125 INFO:teuthology.orchestra.run.smithi049.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T07:08:23.128 INFO:teuthology.orchestra.run.smithi018.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T07:08:23.161 INFO:teuthology.orchestra.run.smithi018.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-21T07:08:23.175 INFO:teuthology.orchestra.run.smithi049.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 906 kB/s | 45 kB 00:00 2024-09-21T07:08:23.236 INFO:teuthology.orchestra.run.smithi018.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-21T07:08:23.250 INFO:teuthology.orchestra.run.smithi049.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.9 MB/s | 148 kB 00:00 2024-09-21T07:08:23.303 INFO:teuthology.orchestra.run.smithi018.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 513 kB/s | 34 kB 00:00 2024-09-21T07:08:23.334 INFO:teuthology.orchestra.run.smithi049.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 1.9 MB/s | 161 kB 00:00 2024-09-21T07:08:23.379 INFO:teuthology.orchestra.run.smithi018.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 12 MB/s | 3.1 MB 00:00 2024-09-21T07:08:23.401 INFO:teuthology.orchestra.run.smithi049.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 4.7 MB/s | 321 kB 00:00 2024-09-21T07:08:23.404 INFO:teuthology.orchestra.run.smithi018.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.5 MB/s | 154 kB 00:00 2024-09-21T07:08:23.468 INFO:teuthology.orchestra.run.smithi049.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 4.5 MB/s | 307 kB 00:00 2024-09-21T07:08:23.552 INFO:teuthology.orchestra.run.smithi049.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 1.2 MB/s | 99 kB 00:00 2024-09-21T07:08:23.637 INFO:teuthology.orchestra.run.smithi049.stdout:(25/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.0 MB/s | 86 kB 00:00 2024-09-21T07:08:23.721 INFO:teuthology.orchestra.run.smithi049.stdout:(26/157): librgw2-19.3.0-5120.g18432218.el9.x86 8.3 MB/s | 5.3 MB 00:00 2024-09-21T07:08:23.805 INFO:teuthology.orchestra.run.smithi049.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.0 MB/s | 170 kB 00:00 2024-09-21T07:08:23.871 INFO:teuthology.orchestra.run.smithi049.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 514 kB/s | 34 kB 00:00 2024-09-21T07:08:23.922 INFO:teuthology.orchestra.run.smithi049.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T07:08:23.997 INFO:teuthology.orchestra.run.smithi049.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 8.6 MB/s | 3.1 MB 00:00 2024-09-21T07:08:24.188 INFO:teuthology.orchestra.run.smithi018.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 13 MB/s | 40 MB 00:02 2024-09-21T07:08:24.272 INFO:teuthology.orchestra.run.smithi018.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.4 MB/s | 292 kB 00:00 2024-09-21T07:08:24.347 INFO:teuthology.orchestra.run.smithi018.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 659 kB/s | 49 kB 00:00 2024-09-21T07:08:24.505 INFO:teuthology.orchestra.run.smithi018.stdout:(34/157): ceph-mgr-dashboard-19.3.0-5120.g18432 13 MB/s | 14 MB 00:01 2024-09-21T07:08:24.531 INFO:teuthology.orchestra.run.smithi018.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 90 kB/s | 16 kB 00:00 2024-09-21T07:08:24.564 INFO:teuthology.orchestra.run.smithi018.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 4.8 MB/s | 285 kB 00:00 2024-09-21T07:08:24.614 INFO:teuthology.orchestra.run.smithi049.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 12 MB/s | 7.4 MB 00:00 2024-09-21T07:08:24.665 INFO:teuthology.orchestra.run.smithi018.stdout:(37/157): ceph-mgr-diskprediction-local-19.3.0- 5.9 MB/s | 7.4 MB 00:01 2024-09-21T07:08:24.672 INFO:teuthology.orchestra.run.smithi049.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.9 MB/s | 292 kB 00:00 2024-09-21T07:08:24.690 INFO:teuthology.orchestra.run.smithi018.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 147 kB/s | 18 kB 00:00 2024-09-21T07:08:24.723 INFO:teuthology.orchestra.run.smithi049.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 987 kB/s | 49 kB 00:00 2024-09-21T07:08:24.732 INFO:teuthology.orchestra.run.smithi018.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.8 MB/s | 784 kB 00:00 2024-09-21T07:08:24.773 INFO:teuthology.orchestra.run.smithi049.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 329 kB/s | 16 kB 00:00 2024-09-21T07:08:24.832 INFO:teuthology.orchestra.run.smithi049.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 4.8 MB/s | 285 kB 00:00 2024-09-21T07:08:24.840 INFO:teuthology.orchestra.run.smithi018.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-09-21T07:08:24.891 INFO:teuthology.orchestra.run.smithi018.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-21T07:08:24.924 INFO:teuthology.orchestra.run.smithi018.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.3 MB/s | 801 kB 00:00 2024-09-21T07:08:24.949 INFO:teuthology.orchestra.run.smithi018.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-21T07:08:24.975 INFO:teuthology.orchestra.run.smithi018.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T07:08:25.008 INFO:teuthology.orchestra.run.smithi018.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-21T07:08:25.015 INFO:teuthology.orchestra.run.smithi049.stdout:(36/157): ceph-mgr-dashboard-19.3.0-5120.g18432 13 MB/s | 14 MB 00:01 2024-09-21T07:08:25.050 INFO:teuthology.orchestra.run.smithi018.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-09-21T07:08:25.075 INFO:teuthology.orchestra.run.smithi018.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-21T07:08:25.101 INFO:teuthology.orchestra.run.smithi018.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-21T07:08:25.218 INFO:teuthology.orchestra.run.smithi018.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 917 kB/s | 107 kB 00:00 2024-09-21T07:08:25.260 INFO:teuthology.orchestra.run.smithi018.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 521 kB/s | 22 kB 00:00 2024-09-21T07:08:25.293 INFO:teuthology.orchestra.run.smithi018.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-09-21T07:08:25.327 INFO:teuthology.orchestra.run.smithi018.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-09-21T07:08:25.360 INFO:teuthology.orchestra.run.smithi018.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-09-21T07:08:25.374 INFO:teuthology.orchestra.run.smithi049.stdout:(37/157): ceph-test-19.3.0-5120.g18432218.el9.x 12 MB/s | 40 MB 00:03 2024-09-21T07:08:25.377 INFO:teuthology.orchestra.run.smithi018.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-21T07:08:25.394 INFO:teuthology.orchestra.run.smithi018.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 541 kB/s | 18 kB 00:00 2024-09-21T07:08:25.399 INFO:teuthology.orchestra.run.smithi049.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 48 kB/s | 18 kB 00:00 2024-09-21T07:08:25.419 INFO:teuthology.orchestra.run.smithi018.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 266 kB/s | 11 kB 00:00 2024-09-21T07:08:25.424 INFO:teuthology.orchestra.run.smithi049.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 1.3 MB/s | 784 kB 00:00 2024-09-21T07:08:25.453 INFO:teuthology.orchestra.run.smithi018.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-09-21T07:08:25.478 INFO:teuthology.orchestra.run.smithi018.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-21T07:08:25.495 INFO:teuthology.orchestra.run.smithi018.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-21T07:08:25.541 INFO:teuthology.orchestra.run.smithi049.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-21T07:08:25.587 INFO:teuthology.orchestra.run.smithi018.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-21T07:08:25.613 INFO:teuthology.orchestra.run.smithi018.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-21T07:08:25.625 INFO:teuthology.orchestra.run.smithi049.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 955 kB/s | 191 kB 00:00 2024-09-21T07:08:25.630 INFO:teuthology.orchestra.run.smithi018.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 582 kB/s | 24 kB 00:00 2024-09-21T07:08:25.647 INFO:teuthology.orchestra.run.smithi018.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-21T07:08:25.684 INFO:teuthology.orchestra.run.smithi049.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-21T07:08:25.714 INFO:teuthology.orchestra.run.smithi018.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-09-21T07:08:25.717 INFO:teuthology.orchestra.run.smithi049.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-21T07:08:25.739 INFO:teuthology.orchestra.run.smithi018.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-21T07:08:25.742 INFO:teuthology.orchestra.run.smithi049.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-21T07:08:25.756 INFO:teuthology.orchestra.run.smithi018.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 921 kB/s | 38 kB 00:00 2024-09-21T07:08:25.768 INFO:teuthology.orchestra.run.smithi049.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T07:08:25.801 INFO:teuthology.orchestra.run.smithi049.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-21T07:08:25.827 INFO:teuthology.orchestra.run.smithi049.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-21T07:08:25.869 INFO:teuthology.orchestra.run.smithi049.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 5.0 MB/s | 1.2 MB 00:00 2024-09-21T07:08:25.944 INFO:teuthology.orchestra.run.smithi049.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-21T07:08:25.985 INFO:teuthology.orchestra.run.smithi049.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-21T07:08:26.011 INFO:teuthology.orchestra.run.smithi049.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-21T07:08:26.053 INFO:teuthology.orchestra.run.smithi049.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-21T07:08:26.095 INFO:teuthology.orchestra.run.smithi049.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-09-21T07:08:26.120 INFO:teuthology.orchestra.run.smithi049.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-21T07:08:26.148 INFO:teuthology.orchestra.run.smithi018.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.6 MB/s | 3.0 MB 00:00 2024-09-21T07:08:26.162 INFO:teuthology.orchestra.run.smithi049.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-09-21T07:08:26.188 INFO:teuthology.orchestra.run.smithi049.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 165 kB/s | 11 kB 00:00 2024-09-21T07:08:26.254 INFO:teuthology.orchestra.run.smithi049.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.8 MB/s | 171 kB 00:00 2024-09-21T07:08:26.279 INFO:teuthology.orchestra.run.smithi049.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-21T07:08:26.352 INFO:teuthology.orchestra.run.smithi049.stdout:(59/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-09-21T07:08:26.499 INFO:teuthology.orchestra.run.smithi049.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 185 kB/s | 45 kB 00:00 2024-09-21T07:08:26.555 INFO:teuthology.orchestra.run.smithi049.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 435 kB/s | 24 kB 00:00 2024-09-21T07:08:26.581 INFO:teuthology.orchestra.run.smithi049.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-21T07:08:26.581 INFO:teuthology.orchestra.run.smithi018.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-09-21T07:08:26.631 INFO:teuthology.orchestra.run.smithi049.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 631 kB/s | 47 kB 00:00 2024-09-21T07:08:26.656 INFO:teuthology.orchestra.run.smithi049.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 1.9 MB/s | 581 kB 00:00 2024-09-21T07:08:26.690 INFO:teuthology.orchestra.run.smithi049.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-21T07:08:26.732 INFO:teuthology.orchestra.run.smithi049.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-21T07:08:26.757 INFO:teuthology.orchestra.run.smithi049.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 383 kB/s | 38 kB 00:00 2024-09-21T07:08:26.840 INFO:teuthology.orchestra.run.smithi018.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 3.4 MB/s | 910 kB 00:00 2024-09-21T07:08:26.907 INFO:teuthology.orchestra.run.smithi018.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T07:08:27.016 INFO:teuthology.orchestra.run.smithi018.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2024-09-21T07:08:27.065 INFO:teuthology.orchestra.run.smithi049.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 13 MB/s | 4.9 MB 00:00 2024-09-21T07:08:27.099 INFO:teuthology.orchestra.run.smithi049.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 4.6 MB/s | 1.6 MB 00:00 2024-09-21T07:08:27.158 INFO:teuthology.orchestra.run.smithi049.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-21T07:08:27.174 INFO:teuthology.orchestra.run.smithi018.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.4 MB/s | 4.9 MB 00:01 2024-09-21T07:08:27.224 INFO:teuthology.orchestra.run.smithi018.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-21T07:08:27.225 INFO:teuthology.orchestra.run.smithi049.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-21T07:08:27.250 INFO:teuthology.orchestra.run.smithi049.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-21T07:08:27.317 INFO:teuthology.orchestra.run.smithi049.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T07:08:27.358 INFO:teuthology.orchestra.run.smithi018.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 2.9 MB/s | 1.0 MB 00:00 2024-09-21T07:08:27.359 INFO:teuthology.orchestra.run.smithi049.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-21T07:08:27.400 INFO:teuthology.orchestra.run.smithi018.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T07:08:27.417 INFO:teuthology.orchestra.run.smithi049.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-21T07:08:27.484 INFO:teuthology.orchestra.run.smithi018.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-21T07:08:27.509 INFO:teuthology.orchestra.run.smithi049.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-21T07:08:27.567 INFO:teuthology.orchestra.run.smithi018.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-21T07:08:27.609 INFO:teuthology.orchestra.run.smithi018.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 619 kB/s | 26 kB 00:00 2024-09-21T07:08:27.618 INFO:teuthology.orchestra.run.smithi049.stdout:(77/157): postgresql-server-13.16-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-09-21T07:08:27.651 INFO:teuthology.orchestra.run.smithi018.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 459 kB/s | 19 kB 00:00 2024-09-21T07:08:27.676 INFO:teuthology.orchestra.run.smithi049.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-21T07:08:27.693 INFO:teuthology.orchestra.run.smithi049.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-09-21T07:08:27.726 INFO:teuthology.orchestra.run.smithi018.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-21T07:08:27.735 INFO:teuthology.orchestra.run.smithi049.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-21T07:08:27.768 INFO:teuthology.orchestra.run.smithi018.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 836 kB/s | 35 kB 00:00 2024-09-21T07:08:27.836 INFO:teuthology.orchestra.run.smithi049.stdout:(81/157): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-21T07:08:27.894 INFO:teuthology.orchestra.run.smithi049.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 219 kB/s | 35 kB 00:00 2024-09-21T07:08:27.919 INFO:teuthology.orchestra.run.smithi049.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 763 kB/s | 172 kB 00:00 2024-09-21T07:08:27.986 INFO:teuthology.orchestra.run.smithi049.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-21T07:08:28.012 INFO:teuthology.orchestra.run.smithi049.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-21T07:08:28.103 INFO:teuthology.orchestra.run.smithi049.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 662 kB/s | 77 kB 00:00 2024-09-21T07:08:28.137 INFO:teuthology.orchestra.run.smithi049.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 336 kB/s | 42 kB 00:00 2024-09-21T07:08:28.238 INFO:teuthology.orchestra.run.smithi049.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-09-21T07:08:28.280 INFO:teuthology.orchestra.run.smithi049.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 1.5 MB/s | 269 kB 00:00 2024-09-21T07:08:28.338 INFO:teuthology.orchestra.run.smithi049.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-21T07:08:28.363 INFO:teuthology.orchestra.run.smithi049.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 610 kB/s | 51 kB 00:00 2024-09-21T07:08:28.422 INFO:teuthology.orchestra.run.smithi049.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 644 kB/s | 54 kB 00:00 2024-09-21T07:08:28.481 INFO:teuthology.orchestra.run.smithi049.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 714 kB/s | 42 kB 00:00 2024-09-21T07:08:28.589 INFO:teuthology.orchestra.run.smithi049.stdout:(94/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.8 MB/s | 5.1 MB 00:00 2024-09-21T07:08:28.602 INFO:teuthology.orchestra.run.smithi018.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 3.4 MB/s | 5.8 MB 00:01 2024-09-21T07:08:28.614 INFO:teuthology.orchestra.run.smithi049.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 331 kB/s | 44 kB 00:00 2024-09-21T07:08:28.694 INFO:teuthology.orchestra.run.smithi018.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-21T07:08:28.786 INFO:teuthology.orchestra.run.smithi018.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-21T07:08:28.815 INFO:teuthology.orchestra.run.smithi049.stdout:(96/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-09-21T07:08:28.840 INFO:teuthology.orchestra.run.smithi049.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 159 kB/s | 36 kB 00:00 2024-09-21T07:08:28.844 INFO:teuthology.orchestra.run.smithi018.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T07:08:28.857 INFO:teuthology.orchestra.run.smithi049.stdout:(98/157): qatlib-24.02.0-1.el9.x86_64.rpm 826 kB/s | 221 kB 00:00 2024-09-21T07:08:28.878 INFO:teuthology.orchestra.run.smithi018.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 42 kB 00:00 2024-09-21T07:08:28.907 INFO:teuthology.orchestra.run.smithi049.stdout:(99/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 516 kB/s | 47 kB 00:00 2024-09-21T07:08:28.932 INFO:teuthology.orchestra.run.smithi049.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 770 kB/s | 58 kB 00:00 2024-09-21T07:08:28.966 INFO:teuthology.orchestra.run.smithi049.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-21T07:08:29.000 INFO:teuthology.orchestra.run.smithi049.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.0 MB/s | 96 kB 00:00 2024-09-21T07:08:29.003 INFO:teuthology.orchestra.run.smithi018.stdout:(87/157): python3-babel-2.9.1-2.el9.noarch.rpm 3.4 MB/s | 6.0 MB 00:01 2024-09-21T07:08:29.033 INFO:teuthology.orchestra.run.smithi049.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 634 kB/s | 64 kB 00:00 2024-09-21T07:08:29.045 INFO:teuthology.orchestra.run.smithi018.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 1.6 MB/s | 269 kB 00:00 2024-09-21T07:08:29.098 INFO:teuthology.orchestra.run.smithi049.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 487 kB/s | 45 kB 00:00 2024-09-21T07:08:29.098 INFO:teuthology.orchestra.run.smithi049.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-21T07:08:29.120 INFO:teuthology.orchestra.run.smithi018.stdout:(89/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.8 MB/s | 5.1 MB 00:01 2024-09-21T07:08:29.134 INFO:teuthology.orchestra.run.smithi049.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-21T07:08:29.146 INFO:teuthology.orchestra.run.smithi018.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-21T07:08:29.159 INFO:teuthology.orchestra.run.smithi049.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 853 kB/s | 19 kB 00:00 2024-09-21T07:08:29.163 INFO:teuthology.orchestra.run.smithi018.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-21T07:08:29.180 INFO:teuthology.orchestra.run.smithi018.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-21T07:08:29.194 INFO:teuthology.orchestra.run.smithi049.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 3.0 MB/s | 308 kB 00:00 2024-09-21T07:08:29.205 INFO:teuthology.orchestra.run.smithi018.stdout:(93/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.7 MB/s | 279 kB 00:00 2024-09-21T07:08:29.218 INFO:teuthology.orchestra.run.smithi049.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T07:08:29.222 INFO:teuthology.orchestra.run.smithi018.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 998 kB/s | 42 kB 00:00 2024-09-21T07:08:29.239 INFO:teuthology.orchestra.run.smithi018.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-21T07:08:29.243 INFO:teuthology.orchestra.run.smithi049.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T07:08:29.269 INFO:teuthology.orchestra.run.smithi049.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T07:08:29.272 INFO:teuthology.orchestra.run.smithi018.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 36 kB 00:00 2024-09-21T07:08:29.294 INFO:teuthology.orchestra.run.smithi049.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T07:08:29.314 INFO:teuthology.orchestra.run.smithi018.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-21T07:08:29.331 INFO:teuthology.orchestra.run.smithi018.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-09-21T07:08:29.336 INFO:teuthology.orchestra.run.smithi049.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-21T07:08:29.365 INFO:teuthology.orchestra.run.smithi018.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2024-09-21T07:08:29.378 INFO:teuthology.orchestra.run.smithi049.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-21T07:08:29.411 INFO:teuthology.orchestra.run.smithi049.stdout:(115/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-21T07:08:29.423 INFO:teuthology.orchestra.run.smithi018.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-21T07:08:29.437 INFO:teuthology.orchestra.run.smithi049.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 742 kB/s | 43 kB 00:00 2024-09-21T07:08:29.449 INFO:teuthology.orchestra.run.smithi018.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-21T07:08:29.470 INFO:teuthology.orchestra.run.smithi049.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 560 kB/s | 14 kB 00:00 2024-09-21T07:08:29.482 INFO:teuthology.orchestra.run.smithi018.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T07:08:29.496 INFO:teuthology.orchestra.run.smithi049.stdout:(118/157): python3-cachetools-4.2.4-1.el9.noarc 383 kB/s | 32 kB 00:00 2024-09-21T07:08:29.499 INFO:teuthology.orchestra.run.smithi018.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-21T07:08:29.521 INFO:teuthology.orchestra.run.smithi049.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.5 MB/s | 172 kB 00:00 2024-09-21T07:08:29.555 INFO:teuthology.orchestra.run.smithi049.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-21T07:08:29.566 INFO:teuthology.orchestra.run.smithi018.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-21T07:08:29.580 INFO:teuthology.orchestra.run.smithi049.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-21T07:08:29.616 INFO:teuthology.orchestra.run.smithi018.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T07:08:29.642 INFO:teuthology.orchestra.run.smithi018.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T07:08:29.647 INFO:teuthology.orchestra.run.smithi049.stdout:(122/157): libarrow-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-09-21T07:08:29.659 INFO:teuthology.orchestra.run.smithi018.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-21T07:08:29.672 INFO:teuthology.orchestra.run.smithi049.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 1.8 MB/s | 220 kB 00:00 2024-09-21T07:08:29.697 INFO:teuthology.orchestra.run.smithi049.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-21T07:08:29.714 INFO:teuthology.orchestra.run.smithi049.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 256 kB/s | 11 kB 00:00 2024-09-21T07:08:29.731 INFO:teuthology.orchestra.run.smithi049.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 529 kB/s | 18 kB 00:00 2024-09-21T07:08:29.748 INFO:teuthology.orchestra.run.smithi049.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 692 kB/s | 23 kB 00:00 2024-09-21T07:08:29.765 INFO:teuthology.orchestra.run.smithi049.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 584 kB/s | 19 kB 00:00 2024-09-21T07:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-21T07:08:29.784 INFO:teuthology.orchestra.run.smithi018.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-21T07:08:29.790 INFO:teuthology.orchestra.run.smithi049.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 470 kB/s | 20 kB 00:00 2024-09-21T07:08:29.809 INFO:teuthology.orchestra.run.smithi018.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T07:08:29.815 INFO:teuthology.orchestra.run.smithi049.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T07:08:29.841 INFO:teuthology.orchestra.run.smithi049.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T07:08:29.843 INFO:teuthology.orchestra.run.smithi018.stdout:(111/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-09-21T07:08:29.866 INFO:teuthology.orchestra.run.smithi049.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T07:08:29.868 INFO:teuthology.orchestra.run.smithi018.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-21T07:08:29.900 INFO:teuthology.orchestra.run.smithi049.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T07:08:29.910 INFO:teuthology.orchestra.run.smithi018.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-21T07:08:29.925 INFO:teuthology.orchestra.run.smithi049.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 665 kB/s | 16 kB 00:00 2024-09-21T07:08:29.944 INFO:teuthology.orchestra.run.smithi018.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 17 MB/s | 548 kB 00:00 2024-09-21T07:08:29.958 INFO:teuthology.orchestra.run.smithi049.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-21T07:08:29.969 INFO:teuthology.orchestra.run.smithi018.stdout:(115/157): luarocks-3.9.2-5.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-09-21T07:08:29.984 INFO:teuthology.orchestra.run.smithi049.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-21T07:08:29.994 INFO:teuthology.orchestra.run.smithi018.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 865 kB/s | 43 kB 00:00 2024-09-21T07:08:30.009 INFO:teuthology.orchestra.run.smithi049.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-21T07:08:30.020 INFO:teuthology.orchestra.run.smithi018.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-21T07:08:30.034 INFO:teuthology.orchestra.run.smithi049.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-21T07:08:30.045 INFO:teuthology.orchestra.run.smithi018.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T07:08:30.059 INFO:teuthology.orchestra.run.smithi049.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T07:08:30.070 INFO:teuthology.orchestra.run.smithi018.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-21T07:08:30.085 INFO:teuthology.orchestra.run.smithi049.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-21T07:08:30.096 INFO:teuthology.orchestra.run.smithi018.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.9 MB/s | 358 kB 00:00 2024-09-21T07:08:30.110 INFO:teuthology.orchestra.run.smithi049.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-21T07:08:30.121 INFO:teuthology.orchestra.run.smithi018.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.8 MB/s | 303 kB 00:00 2024-09-21T07:08:30.135 INFO:teuthology.orchestra.run.smithi049.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T07:08:30.146 INFO:teuthology.orchestra.run.smithi018.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T07:08:30.161 INFO:teuthology.orchestra.run.smithi049.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T07:08:30.180 INFO:teuthology.orchestra.run.smithi018.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T07:08:30.186 INFO:teuthology.orchestra.run.smithi049.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T07:08:30.205 INFO:teuthology.orchestra.run.smithi018.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-21T07:08:30.211 INFO:teuthology.orchestra.run.smithi049.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-09-21T07:08:30.230 INFO:teuthology.orchestra.run.smithi018.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 717 kB/s | 18 kB 00:00 2024-09-21T07:08:30.256 INFO:teuthology.orchestra.run.smithi018.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 923 kB/s | 23 kB 00:00 2024-09-21T07:08:30.262 INFO:teuthology.orchestra.run.smithi049.stdout:(146/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.0 MB/s | 2.0 MB 00:00 2024-09-21T07:08:30.273 INFO:teuthology.orchestra.run.smithi018.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-21T07:08:30.287 INFO:teuthology.orchestra.run.smithi049.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-21T07:08:30.290 INFO:teuthology.orchestra.run.smithi018.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-21T07:08:30.312 INFO:teuthology.orchestra.run.smithi049.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-21T07:08:30.357 INFO:teuthology.orchestra.run.smithi018.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-21T07:08:30.371 INFO:teuthology.orchestra.run.smithi049.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T07:08:30.374 INFO:teuthology.orchestra.run.smithi018.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-21T07:08:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T07:08:30.416 INFO:teuthology.orchestra.run.smithi018.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-21T07:08:30.466 INFO:teuthology.orchestra.run.smithi018.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-21T07:08:30.483 INFO:teuthology.orchestra.run.smithi018.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 994 kB/s | 16 kB 00:00 2024-09-21T07:08:30.501 INFO:teuthology.orchestra.run.smithi018.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 5.3 MB/s | 90 kB 00:00 2024-09-21T07:08:30.525 INFO:teuthology.orchestra.run.smithi018.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-21T07:08:30.543 INFO:teuthology.orchestra.run.smithi018.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 675 kB/s | 28 kB 00:00 2024-09-21T07:08:30.563 INFO:teuthology.orchestra.run.smithi049.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 12 MB/s | 3.4 MB 00:00 2024-09-21T07:08:30.568 INFO:teuthology.orchestra.run.smithi018.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 732 kB/s | 31 kB 00:00 2024-09-21T07:08:30.593 INFO:teuthology.orchestra.run.smithi018.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T07:08:30.618 INFO:teuthology.orchestra.run.smithi018.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T07:08:30.621 INFO:teuthology.orchestra.run.smithi049.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-21T07:08:30.643 INFO:teuthology.orchestra.run.smithi018.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-21T07:08:30.669 INFO:teuthology.orchestra.run.smithi018.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-21T07:08:30.686 INFO:teuthology.orchestra.run.smithi018.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 5.4 MB/s | 90 kB 00:00 2024-09-21T07:08:30.711 INFO:teuthology.orchestra.run.smithi018.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-21T07:08:30.730 INFO:teuthology.orchestra.run.smithi049.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 378 kB/s | 41 kB 00:00 2024-09-21T07:08:30.736 INFO:teuthology.orchestra.run.smithi018.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-21T07:08:30.762 INFO:teuthology.orchestra.run.smithi018.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-21T07:08:30.795 INFO:teuthology.orchestra.run.smithi018.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-21T07:08:30.847 INFO:teuthology.orchestra.run.smithi049.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-09-21T07:08:30.854 INFO:teuthology.orchestra.run.smithi018.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-21T07:08:31.039 INFO:teuthology.orchestra.run.smithi049.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.8 MB/s | 1.8 MB 00:00 2024-09-21T07:08:31.063 INFO:teuthology.orchestra.run.smithi018.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 13 MB/s | 3.4 MB 00:00 2024-09-21T07:08:31.146 INFO:teuthology.orchestra.run.smithi018.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-21T07:08:31.189 INFO:teuthology.orchestra.run.smithi049.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 4.0 MB/s | 1.4 MB 00:00 2024-09-21T07:08:31.239 INFO:teuthology.orchestra.run.smithi049.stdout:(156/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.7 MB/s | 2.3 MB 00:00 2024-09-21T07:08:31.388 INFO:teuthology.orchestra.run.smithi018.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 7.1 MB/s | 2.3 MB 00:00 2024-09-21T07:08:31.430 INFO:teuthology.orchestra.run.smithi018.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 6.4 MB/s | 1.8 MB 00:00 2024-09-21T07:08:31.456 INFO:teuthology.orchestra.run.smithi018.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 611 kB/s | 41 kB 00:00 2024-09-21T07:08:31.480 INFO:teuthology.orchestra.run.smithi018.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-21T07:08:31.523 INFO:teuthology.orchestra.run.smithi018.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-21T07:08:31.581 INFO:teuthology.orchestra.run.smithi018.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-21T07:08:32.248 INFO:teuthology.orchestra.run.smithi049.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-21T07:08:32.255 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:08:32.255 INFO:teuthology.orchestra.run.smithi049.stdout:Total 17 MB/s | 228 MB 00:13 2024-09-21T07:08:33.522 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-21T07:08:33.695 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-21T07:08:33.695 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-21T07:08:34.190 INFO:teuthology.orchestra.run.smithi018.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.2 MB/s | 16 MB 00:05 2024-09-21T07:08:34.195 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:08:34.195 INFO:teuthology.orchestra.run.smithi018.stdout:Total 15 MB/s | 228 MB 00:15 2024-09-21T07:08:35.469 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-21T07:08:35.643 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-21T07:08:35.643 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-21T07:08:36.042 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-21T07:08:36.043 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-21T07:08:37.967 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-21T07:08:42.845 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-21T07:08:42.951 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T07:08:43.022 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T07:08:43.153 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T07:08:43.194 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T07:08:43.220 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T07:08:43.275 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T07:08:43.698 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T07:08:43.762 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:08:43.875 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:08:43.897 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:08:43.989 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:08:44.018 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:08:44.048 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T07:08:44.225 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T07:08:44.274 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T07:08:44.301 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:08:44.393 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:08:44.419 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:08:44.482 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:08:44.504 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:08:44.526 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:08:44.721 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-21T07:08:44.724 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:08:44.835 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T07:08:44.885 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T07:08:44.890 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:08:44.945 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T07:08:44.988 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T07:08:45.013 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T07:08:45.035 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T07:08:45.068 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T07:08:45.141 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:08:45.220 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:08:45.455 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:08:45.483 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T07:08:45.539 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:08:45.565 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T07:08:45.600 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T07:08:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T07:08:45.668 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:08:45.698 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:08:45.711 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T07:08:45.761 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T07:08:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:08:45.801 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T07:08:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:08:45.844 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T07:08:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T07:08:45.877 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T07:08:45.904 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T07:08:45.976 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T07:08:46.028 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T07:08:46.029 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T07:08:46.066 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T07:08:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T07:08:46.110 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T07:08:46.112 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:08:46.202 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T07:08:46.224 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:08:46.237 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T07:08:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:08:46.281 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T07:08:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:08:46.329 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T07:08:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:08:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:08:46.408 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T07:08:46.457 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T07:08:46.535 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T07:08:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:08:46.680 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T07:08:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:08:46.744 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T07:08:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T07:08:46.937 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:08:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:08:47.245 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:08:47.298 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T07:08:47.359 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T07:08:47.383 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T07:08:47.393 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T07:08:47.426 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T07:08:47.428 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T07:08:47.469 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T07:08:47.504 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T07:08:47.507 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T07:08:47.550 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T07:08:47.563 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T07:08:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T07:08:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T07:08:47.688 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T07:08:47.714 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T07:08:47.715 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T07:08:47.768 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T07:08:47.786 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T07:08:47.838 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T07:08:47.863 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T07:08:47.868 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T07:08:47.912 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T07:08:47.925 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T07:08:48.004 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T07:08:48.006 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T07:08:48.039 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T07:08:48.045 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T07:08:48.081 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T07:08:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T07:08:48.111 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T07:08:48.129 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T07:08:48.164 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T07:08:48.183 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T07:08:48.208 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T07:08:48.235 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T07:08:48.250 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T07:08:48.312 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T07:08:48.393 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T07:08:48.458 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T07:08:48.522 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T07:08:48.585 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T07:08:48.626 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T07:08:48.734 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T07:08:48.767 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T07:08:48.808 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T07:08:48.841 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T07:08:48.866 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T07:08:48.962 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T07:08:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T07:08:49.089 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T07:08:49.131 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T07:08:49.160 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T07:08:49.168 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T07:08:49.193 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T07:08:49.204 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T07:08:49.237 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T07:08:49.247 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T07:08:49.276 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T07:08:49.285 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T07:08:49.306 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T07:08:49.328 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T07:08:49.341 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T07:08:49.374 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T07:08:49.416 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T07:08:49.449 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T07:08:49.486 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T07:08:49.540 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T07:08:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T07:08:49.597 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T07:08:49.628 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T07:08:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T07:08:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T07:08:49.736 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T07:08:49.785 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T07:08:49.789 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T07:08:49.823 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T07:08:49.868 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T07:08:49.915 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T07:08:49.950 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T07:08:49.994 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T07:08:50.036 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T07:08:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T07:08:50.221 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T07:08:50.263 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T07:08:50.371 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T07:08:50.548 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T07:08:50.592 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T07:08:50.592 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T07:08:50.627 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T07:08:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T07:08:50.729 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T07:08:50.745 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T07:08:50.770 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T07:08:50.783 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T07:08:50.827 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T07:08:50.862 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T07:08:50.918 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T07:08:50.954 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T07:08:50.996 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T07:08:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T07:08:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T07:08:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T07:08:51.144 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T07:08:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T07:08:51.176 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T07:08:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T07:08:51.226 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T07:08:51.257 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T07:08:51.261 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T07:08:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T07:08:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T07:08:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T07:08:51.460 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T07:08:51.510 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T07:08:51.541 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T07:08:51.648 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T07:08:51.701 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T07:08:51.953 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T07:08:52.070 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T07:08:52.465 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T07:08:52.514 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T07:08:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T07:08:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T07:08:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T07:08:52.757 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T07:08:52.847 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T07:08:52.900 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T07:08:53.091 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T07:08:53.133 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T07:08:53.211 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T07:08:53.398 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T07:08:53.472 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T07:08:53.501 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T07:08:53.533 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T07:08:53.876 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T07:08:53.903 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T07:08:53.921 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:08:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T07:08:54.028 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:08:54.059 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T07:08:54.096 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T07:08:54.622 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T07:08:54.649 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:08:54.720 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:08:54.750 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T07:08:55.344 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T07:08:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T07:08:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T07:08:55.498 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T07:08:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T07:08:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:08:55.987 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:08:56.016 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T07:08:56.052 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T07:08:56.587 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T07:08:56.614 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:08:56.679 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:08:56.709 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T07:08:57.141 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:08:57.172 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:08:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:08:57.808 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:08:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:08:57.885 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:08:57.885 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:08:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:08:57.918 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:08:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:08:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:08:59.742 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:08:59.784 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:08:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:08:59.875 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:08:59.875 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:08:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:08:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:09:10.229 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:09:10.230 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /sys 2024-09-21T07:09:10.230 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /proc 2024-09-21T07:09:10.230 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /mnt 2024-09-21T07:09:10.230 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /var/tmp 2024-09-21T07:09:10.230 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /home 2024-09-21T07:09:10.230 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /root 2024-09-21T07:09:10.230 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /tmp 2024-09-21T07:09:10.230 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:10.406 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:09:10.423 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:09:10.423 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:10.423 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T07:09:10.423 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:12.067 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:09:12.096 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:09:12.096 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:12.096 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:09:12.096 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:09:12.096 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:09:12.096 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:12.310 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:09:12.310 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /sys 2024-09-21T07:09:12.310 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /proc 2024-09-21T07:09:12.310 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /mnt 2024-09-21T07:09:12.310 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /var/tmp 2024-09-21T07:09:12.311 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /home 2024-09-21T07:09:12.311 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /root 2024-09-21T07:09:12.311 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /tmp 2024-09-21T07:09:12.311 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:12.334 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:09:12.359 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:09:12.359 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:12.360 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:09:12.360 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:09:12.360 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:09:12.360 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:12.489 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:09:12.509 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:09:12.510 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:12.510 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T07:09:12.510 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:12.860 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:09:12.885 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:09:12.885 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:12.885 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:09:12.886 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:09:12.886 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:09:12.886 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:12.991 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T07:09:13.058 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T07:09:13.122 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T07:09:13.315 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T07:09:13.370 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T07:09:13.451 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T07:09:13.549 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T07:09:13.693 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T07:09:13.728 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T07:09:13.760 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T07:09:13.787 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T07:09:14.159 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:09:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:09:14.187 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:14.187 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:09:14.187 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:09:14.187 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:09:14.187 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:14.227 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:09:14.253 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:09:14.285 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T07:09:14.345 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T07:09:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:09:14.426 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:09:14.451 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:09:14.451 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:14.451 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:09:14.452 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:09:14.452 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:09:14.452 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:14.952 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:09:14.977 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:09:14.977 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:14.977 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:09:14.977 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:09:14.977 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:09:14.977 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:15.083 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T07:09:15.141 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T07:09:15.205 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T07:09:15.408 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T07:09:15.453 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T07:09:15.534 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T07:09:15.633 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T07:09:15.792 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T07:09:15.837 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T07:09:15.868 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T07:09:15.896 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T07:09:16.357 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:09:16.386 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:09:16.419 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T07:09:16.487 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T07:09:16.545 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:09:17.755 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:09:17.815 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:09:18.827 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:09:18.865 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:09:18.986 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:09:19.157 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T07:09:19.184 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:09:19.209 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:09:19.209 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:19.209 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:09:19.209 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:09:19.209 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:09:19.209 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:19.259 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:09:19.271 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:09:19.374 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T07:09:19.435 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T07:09:19.920 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:09:19.982 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:09:20.452 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T07:09:20.478 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:09:20.504 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:09:20.504 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:20.504 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:09:20.504 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:09:20.504 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:09:20.504 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:20.546 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:09:20.570 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:09:20.570 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:20.570 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:09:20.570 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:20.621 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:09:20.646 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:09:20.646 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:20.646 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T07:09:20.646 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:09:20.646 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:09:20.646 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:20.980 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:09:20.993 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:09:21.005 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:09:21.005 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:21.005 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:09:21.005 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:09:21.005 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:09:21.006 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:21.024 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:09:21.147 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:09:21.315 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T07:09:21.359 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:09:21.384 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:09:21.384 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:21.385 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:09:21.385 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:09:21.385 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:09:21.385 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:21.435 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:09:21.447 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:09:21.549 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T07:09:21.607 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T07:09:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T07:09:22.662 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:09:22.687 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:09:22.688 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:22.688 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:09:22.688 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:09:22.688 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:09:22.688 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:22.729 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:09:22.753 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:09:22.753 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:22.753 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:09:22.754 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:22.805 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:09:22.830 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:09:22.830 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:22.830 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T07:09:22.830 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:09:22.830 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:09:22.830 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:09:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:09:23.189 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:09:23.189 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:09:23.189 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:09:23.189 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:09:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:25.256 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T07:09:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T07:09:25.342 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T07:09:25.373 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T07:09:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T07:09:25.623 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T07:09:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T07:09:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T07:09:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T07:09:25.787 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T07:09:26.422 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:09:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:09:26.489 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:09:27.409 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T07:09:27.442 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T07:09:27.485 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T07:09:27.497 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T07:09:27.526 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T07:09:27.548 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T07:09:27.557 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T07:09:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T07:09:27.653 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T07:09:27.683 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T07:09:27.709 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T07:09:27.735 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T07:09:27.735 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:09:27.807 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T07:09:27.852 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:09:27.852 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:09:27.856 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T07:09:27.887 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T07:09:27.916 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T07:09:27.944 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:09:27.954 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T07:09:27.969 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T07:09:27.975 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:09:27.975 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:09:28.163 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:09:28.163 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:09:28.247 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:09:28.315 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:09:28.558 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:09:28.593 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:09:28.615 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:09:29.522 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T07:09:29.623 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T07:09:29.670 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T07:09:29.770 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T07:09:29.801 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T07:09:29.827 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T07:09:29.853 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T07:09:29.853 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:09:29.920 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:09:29.921 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:09:29.987 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:09:30.013 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T07:09:30.018 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:09:30.018 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:09:30.206 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:09:30.206 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:09:30.282 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:09:30.350 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:09:34.625 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:09:34.626 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T07:09:34.626 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T07:09:34.626 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T07:09:34.626 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T07:09:34.626 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T07:09:34.626 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T07:09:34.626 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T07:09:34.626 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:09:34.626 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:09:34.626 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:09:34.626 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T07:09:34.627 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T07:09:34.627 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T07:09:34.627 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:09:34.627 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T07:09:34.627 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T07:09:34.627 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T07:09:34.627 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T07:09:34.627 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T07:09:34.627 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T07:09:34.627 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T07:09:34.627 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T07:09:34.627 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T07:09:34.627 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T07:09:34.627 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T07:09:34.628 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T07:09:34.628 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T07:09:34.628 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T07:09:34.628 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T07:09:34.639 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T07:09:34.639 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T07:09:34.640 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T07:09:34.640 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T07:09:34.640 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T07:09:34.640 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T07:09:34.640 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T07:09:34.640 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T07:09:34.640 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T07:09:34.640 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T07:09:34.640 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T07:09:34.640 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T07:09:34.640 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T07:09:34.640 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T07:09:34.640 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T07:09:34.640 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T07:09:34.641 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T07:09:34.641 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T07:09:34.641 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T07:09:34.641 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T07:09:34.641 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T07:09:34.641 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T07:09:34.641 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T07:09:34.641 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T07:09:34.641 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T07:09:34.641 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T07:09:34.641 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T07:09:34.641 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T07:09:34.641 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T07:09:34.641 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T07:09:34.642 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T07:09:34.642 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T07:09:34.642 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T07:09:34.642 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T07:09:34.642 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T07:09:34.642 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T07:09:34.642 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T07:09:34.642 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T07:09:34.642 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T07:09:34.642 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T07:09:34.642 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T07:09:34.642 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T07:09:34.643 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T07:09:34.643 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T07:09:34.643 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T07:09:34.643 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T07:09:34.643 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T07:09:34.643 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T07:09:34.643 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T07:09:34.643 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T07:09:34.643 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T07:09:34.643 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T07:09:34.643 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T07:09:34.643 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T07:09:34.643 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T07:09:34.644 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T07:09:34.644 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T07:09:34.644 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T07:09:34.644 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T07:09:34.644 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T07:09:34.644 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T07:09:34.644 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T07:09:34.644 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T07:09:34.644 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T07:09:34.644 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T07:09:34.644 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T07:09:34.644 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T07:09:34.644 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T07:09:34.645 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T07:09:34.645 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T07:09:34.645 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T07:09:34.645 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T07:09:34.645 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T07:09:34.645 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T07:09:34.645 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T07:09:34.645 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T07:09:34.645 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T07:09:34.645 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T07:09:34.645 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T07:09:34.645 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T07:09:34.645 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T07:09:34.646 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T07:09:34.646 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T07:09:34.646 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T07:09:34.646 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T07:09:34.646 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T07:09:34.646 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T07:09:34.646 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T07:09:34.646 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T07:09:34.646 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T07:09:34.646 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T07:09:34.646 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T07:09:34.646 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T07:09:34.646 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T07:09:34.647 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T07:09:34.647 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T07:09:34.647 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T07:09:34.647 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T07:09:34.647 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T07:09:34.647 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T07:09:34.647 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T07:09:34.649 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T07:09:34.650 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T07:09:34.650 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T07:09:34.650 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T07:09:34.650 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T07:09:34.650 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T07:09:34.650 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T07:09:34.650 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T07:09:34.650 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T07:09:34.650 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T07:09:34.650 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T07:09:34.650 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T07:09:34.650 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T07:09:34.650 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T07:09:34.651 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T07:09:34.651 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T07:09:34.651 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T07:09:34.651 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T07:09:34.651 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T07:09:34.651 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T07:09:34.651 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T07:09:34.651 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T07:09:34.651 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T07:09:34.651 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T07:09:34.651 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T07:09:34.651 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T07:09:34.651 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T07:09:34.651 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T07:09:34.651 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T07:09:34.652 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T07:09:34.652 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T07:09:34.652 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T07:09:34.652 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T07:09:34.652 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T07:09:36.682 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:09:36.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T07:09:36.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T07:09:36.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T07:09:36.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T07:09:36.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T07:09:36.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T07:09:36.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T07:09:36.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:09:36.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:09:36.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:09:36.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T07:09:36.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T07:09:36.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T07:09:36.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:09:36.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T07:09:36.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T07:09:36.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T07:09:36.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T07:09:36.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T07:09:36.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T07:09:36.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T07:09:36.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T07:09:36.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T07:09:36.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T07:09:36.684 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T07:09:36.684 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T07:09:36.684 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T07:09:36.684 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T07:09:36.684 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T07:09:36.684 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T07:09:36.684 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T07:09:36.684 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T07:09:36.684 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T07:09:36.684 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T07:09:36.684 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T07:09:36.684 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T07:09:36.684 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T07:09:36.684 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T07:09:36.684 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T07:09:36.685 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T07:09:36.685 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T07:09:36.685 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T07:09:36.685 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T07:09:36.685 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T07:09:36.685 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T07:09:36.685 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T07:09:36.685 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T07:09:36.685 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T07:09:36.685 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T07:09:36.685 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T07:09:36.685 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T07:09:36.685 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T07:09:36.685 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T07:09:36.686 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T07:09:36.686 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T07:09:36.686 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T07:09:36.686 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T07:09:36.686 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T07:09:36.686 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T07:09:36.686 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T07:09:36.686 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T07:09:36.686 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T07:09:36.686 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T07:09:36.686 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T07:09:36.686 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T07:09:36.686 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T07:09:36.686 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T07:09:36.686 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T07:09:36.687 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T07:09:36.687 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T07:09:36.687 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T07:09:36.687 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T07:09:36.687 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T07:09:36.687 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T07:09:36.687 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T07:09:36.687 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T07:09:36.687 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T07:09:36.687 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T07:09:36.687 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T07:09:36.687 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T07:09:36.687 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T07:09:36.687 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T07:09:36.687 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T07:09:36.688 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T07:09:36.688 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T07:09:36.688 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T07:09:36.688 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T07:09:36.688 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T07:09:36.688 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T07:09:36.688 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T07:09:36.688 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T07:09:36.688 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T07:09:36.688 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T07:09:36.688 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T07:09:36.688 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T07:09:36.688 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T07:09:36.688 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T07:09:36.688 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T07:09:36.689 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T07:09:36.689 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T07:09:36.689 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T07:09:36.689 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T07:09:36.689 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T07:09:36.689 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T07:09:36.689 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T07:09:36.689 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T07:09:36.689 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T07:09:36.689 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T07:09:36.689 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T07:09:36.689 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T07:09:36.689 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T07:09:36.689 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T07:09:36.689 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T07:09:36.690 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T07:09:36.690 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T07:09:36.690 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T07:09:36.690 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T07:09:36.690 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T07:09:36.690 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T07:09:36.690 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T07:09:36.690 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T07:09:36.690 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T07:09:36.690 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T07:09:36.690 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T07:09:36.690 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T07:09:36.690 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T07:09:36.690 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T07:09:36.690 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T07:09:36.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T07:09:36.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T07:09:36.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T07:09:36.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T07:09:36.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T07:09:36.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T07:09:36.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T07:09:36.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T07:09:36.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T07:09:36.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T07:09:36.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T07:09:36.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T07:09:36.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T07:09:36.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T07:09:36.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T07:09:36.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T07:09:36.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T07:09:36.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T07:09:36.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T07:09:36.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T07:09:36.693 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T07:09:36.694 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T07:09:36.694 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T07:09:36.695 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T07:09:36.695 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T07:09:36.695 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T07:09:36.695 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T07:09:36.695 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T07:09:36.695 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T07:09:36.695 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T07:09:36.695 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T07:09:36.695 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T07:09:36.696 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T07:09:36.696 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T07:09:36.696 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T07:09:36.696 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T07:09:36.879 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:09:36.879 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:36.879 INFO:teuthology.orchestra.run.smithi049.stdout:Upgraded: 2024-09-21T07:09:36.879 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T07:09:36.879 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T07:09:36.880 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T07:09:36.880 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T07:09:36.880 INFO:teuthology.orchestra.run.smithi049.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.880 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.880 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T07:09:36.880 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T07:09:36.880 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-21T07:09:36.880 INFO:teuthology.orchestra.run.smithi049.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T07:09:36.880 INFO:teuthology.orchestra.run.smithi049.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T07:09:36.880 INFO:teuthology.orchestra.run.smithi049.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T07:09:36.880 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T07:09:36.880 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.880 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.880 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.881 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.881 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:36.881 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.881 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.881 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.881 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:36.881 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:36.881 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:36.881 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:36.881 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:36.881 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.881 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.881 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:36.881 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.882 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.882 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.882 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:36.882 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:36.882 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.882 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.882 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:36.882 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T07:09:36.882 INFO:teuthology.orchestra.run.smithi049.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T07:09:36.882 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:09:36.882 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:09:36.882 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:09:36.882 INFO:teuthology.orchestra.run.smithi049.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T07:09:36.882 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:09:36.883 INFO:teuthology.orchestra.run.smithi049.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T07:09:36.883 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T07:09:36.883 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T07:09:36.883 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T07:09:36.883 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.883 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.883 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.883 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:09:36.883 INFO:teuthology.orchestra.run.smithi049.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T07:09:36.883 INFO:teuthology.orchestra.run.smithi049.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:09:36.883 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:09:36.883 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:09:36.883 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:09:36.883 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.884 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.884 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:09:36.884 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.884 INFO:teuthology.orchestra.run.smithi049.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T07:09:36.884 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:09:36.884 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T07:09:36.884 INFO:teuthology.orchestra.run.smithi049.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T07:09:36.884 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:09:36.884 INFO:teuthology.orchestra.run.smithi049.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T07:09:36.884 INFO:teuthology.orchestra.run.smithi049.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T07:09:36.884 INFO:teuthology.orchestra.run.smithi049.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T07:09:36.884 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:09:36.884 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:09:36.884 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T07:09:36.884 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T07:09:36.885 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T07:09:36.885 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T07:09:36.885 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T07:09:36.885 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T07:09:36.885 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T07:09:36.885 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T07:09:36.885 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:09:36.885 INFO:teuthology.orchestra.run.smithi049.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T07:09:36.885 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:09:36.885 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:09:36.885 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:09:36.885 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.885 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.885 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.886 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:09:36.886 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:09:36.886 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:09:36.886 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:09:36.886 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T07:09:36.886 INFO:teuthology.orchestra.run.smithi049.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T07:09:36.886 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:09:36.886 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:09:36.886 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:09:36.886 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T07:09:36.886 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T07:09:36.886 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:09:36.886 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:09:36.886 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:09:36.887 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:09:36.887 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:09:36.887 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:09:36.887 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:09:36.887 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:09:36.887 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:09:36.887 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:09:36.887 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:09:36.887 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:09:36.887 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:09:36.887 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:09:36.887 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:09:36.887 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:09:36.887 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:09:36.888 INFO:teuthology.orchestra.run.smithi049.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:09:36.888 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:09:36.888 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:09:36.888 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:09:36.888 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:09:36.888 INFO:teuthology.orchestra.run.smithi049.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T07:09:36.888 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:09:36.888 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:09:36.888 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:09:36.888 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:09:36.888 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T07:09:36.888 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:09:36.888 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.888 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.889 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:09:36.889 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:09:36.889 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:09:36.889 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.889 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:09:36.889 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:09:36.889 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:09:36.889 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:09:36.889 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:09:36.889 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:09:36.889 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:09:36.889 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T07:09:36.889 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:09:36.889 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:09:36.889 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:09:36.890 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:09:36.890 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T07:09:36.890 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T07:09:36.890 INFO:teuthology.orchestra.run.smithi049.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T07:09:36.890 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.890 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.890 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:36.890 INFO:teuthology.orchestra.run.smithi049.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T07:09:36.890 INFO:teuthology.orchestra.run.smithi049.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:09:36.890 INFO:teuthology.orchestra.run.smithi049.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:09:36.890 INFO:teuthology.orchestra.run.smithi049.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T07:09:36.890 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T07:09:36.890 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:09:36.891 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T07:09:36.891 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:36.891 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-21T07:09:37.311 DEBUG:teuthology.parallel:result is None 2024-09-21T07:09:39.167 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:09:39.167 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:39.167 INFO:teuthology.orchestra.run.smithi018.stdout:Upgraded: 2024-09-21T07:09:39.167 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T07:09:39.167 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T07:09:39.167 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T07:09:39.167 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T07:09:39.167 INFO:teuthology.orchestra.run.smithi018.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.167 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.167 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T07:09:39.167 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T07:09:39.168 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-21T07:09:39.168 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T07:09:39.168 INFO:teuthology.orchestra.run.smithi018.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T07:09:39.168 INFO:teuthology.orchestra.run.smithi018.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T07:09:39.168 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T07:09:39.168 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.168 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.168 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.168 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.168 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:39.168 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.168 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.168 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.168 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:39.168 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:39.169 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:39.169 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:39.169 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:39.169 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.169 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.169 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:39.169 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.169 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.169 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.169 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:39.169 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:39.169 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.169 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.169 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:09:39.170 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T07:09:39.170 INFO:teuthology.orchestra.run.smithi018.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T07:09:39.170 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:09:39.170 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:09:39.170 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:09:39.170 INFO:teuthology.orchestra.run.smithi018.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T07:09:39.170 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:09:39.170 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T07:09:39.170 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T07:09:39.170 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T07:09:39.170 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T07:09:39.170 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.170 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.170 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.171 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:09:39.171 INFO:teuthology.orchestra.run.smithi018.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T07:09:39.171 INFO:teuthology.orchestra.run.smithi018.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:09:39.171 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:09:39.171 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:09:39.171 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:09:39.171 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.171 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.171 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:09:39.171 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.171 INFO:teuthology.orchestra.run.smithi018.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T07:09:39.171 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:09:39.171 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T07:09:39.171 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T07:09:39.171 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:09:39.172 INFO:teuthology.orchestra.run.smithi018.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T07:09:39.172 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T07:09:39.172 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T07:09:39.172 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:09:39.172 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:09:39.172 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T07:09:39.172 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T07:09:39.172 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T07:09:39.172 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T07:09:39.172 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T07:09:39.172 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T07:09:39.172 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T07:09:39.172 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T07:09:39.172 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:09:39.173 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:09:39.174 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T07:09:39.174 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T07:09:39.174 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:09:39.174 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:09:39.174 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:09:39.174 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:09:39.174 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:09:39.174 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:09:39.174 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:09:39.174 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:09:39.174 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:09:39.174 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:09:39.174 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:09:39.174 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T07:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:09:39.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T07:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:09:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:09:39.177 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T07:09:39.177 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:09:39.177 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:09:39.177 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:09:39.177 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:09:39.177 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T07:09:39.177 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T07:09:39.177 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T07:09:39.177 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.177 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.177 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:09:39.177 INFO:teuthology.orchestra.run.smithi018.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T07:09:39.177 INFO:teuthology.orchestra.run.smithi018.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:09:39.177 INFO:teuthology.orchestra.run.smithi018.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:09:39.178 INFO:teuthology.orchestra.run.smithi018.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T07:09:39.178 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T07:09:39.178 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:09:39.178 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T07:09:39.178 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:39.178 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-21T07:09:39.571 DEBUG:teuthology.parallel:result is None 2024-09-21T07:09:39.571 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:09:39.719 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:09:39.741 INFO:teuthology.orchestra.run.smithi018.stdout:19.3.0-5120.g18432218.el9 2024-09-21T07:09:39.741 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T07:09:39.742 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T07:09:39.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:09:39.887 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:09:39.915 INFO:teuthology.orchestra.run.smithi049.stdout:19.3.0-5120.g18432218.el9 2024-09-21T07:09:39.915 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T07:09:39.916 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T07:09:39.917 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T07:09:39.917 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:09:39.917 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:09:39.945 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:09:39.946 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:09:39.989 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T07:09:39.989 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:09:39.989 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:09:40.014 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:09:40.079 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:09:40.080 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:09:40.110 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:09:40.182 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T07:09:40.182 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:09:40.182 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:09:40.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:09:40.273 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:09:40.273 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:09:40.303 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:09:40.372 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T07:09:40.372 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:09:40.372 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:09:40.398 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:09:40.463 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:09:40.463 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:09:40.493 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:09:40.562 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T07:09:40.639 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T07:09:40.639 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /var/log/ceph 2024-09-21T07:09:40.642 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /var/log/ceph 2024-09-21T07:09:40.671 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T07:09:40.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T07:09:40.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T07:09:40.741 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T07:09:40.741 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T07:09:40.774 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T07:09:40.815 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-21T07:09:40.816 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-21T07:09:40.816 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-21T07:09:40.816 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:09:40.816 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T07:09:40.853 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T07:09:40.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T07:09:40.991 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:09:40.992 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T07:09:41.009 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T07:09:41.124 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T07:09:41.156 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T07:09:41.157 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T07:09:41.157 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913583', 'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7913583', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240920.212106-debug'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7864, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'sleep_before_teardown': 0, 'subset': '67/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240920.212106-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi018.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL43sKeP6R9KcuWVBsFcMxrKv75tnVaFDvA1/08XB1da84wwmiYMtAr+FPe0Csswiz2SSfrnUlznCj155QiWc2A=', 'smithi049.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHvp75kUe2TIR4mrNBH8gVLcjijJ1ZiqfL25SRTtUzT57NFtX4lkX3xqGM8y978gLdS1ELCTex3eJlRUmB4EJkU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'cluster': 'ceph'}}, {'kclient': None}, {'check-counter': {'counters': {'mgr': [{'min': 4, 'name': 'finisher-volumes.complete_latency.avgcount'}, {'expected_val': 0, 'name': 'finisher-volumes.queue_len'}]}}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestPerModuleFinsherThread']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-20_23:48:22', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T07:09:41.157 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T07:09:41.160 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T07:09:41.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T07:09:41.216 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T07:09:41.274 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:09:41.274 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:09:41.296 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:09:41.296 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-09-21T07:09:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:09:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:09:41.351 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T07:09:41.351 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:09:41.351 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:09:41.351 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-21 07:09:30.724004839 +0000 2024-09-21T07:09:41.351 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-21 07:07:37.138586572 +0000 2024-09-21T07:09:41.352 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-21 07:07:37.138586572 +0000 2024-09-21T07:09:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-21 07:07:37.138586572 +0000 2024-09-21T07:09:41.352 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:09:41.414 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-21T07:09:41.415 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-21T07:09:41.415 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000102247 s, 5.0 MB/s 2024-09-21T07:09:41.416 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:09:41.473 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-09-21T07:09:41.529 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:09:41.529 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:09:41.529 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T07:09:41.529 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:09:41.530 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:09:41.530 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-21 07:09:30.725004826 +0000 2024-09-21T07:09:41.530 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-21 07:07:37.460582492 +0000 2024-09-21T07:09:41.530 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-21 07:07:37.460582492 +0000 2024-09-21T07:09:41.530 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-21 07:07:37.460582492 +0000 2024-09-21T07:09:41.530 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:09:41.593 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-21T07:09:41.593 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-21T07:09:41.593 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 9.8483e-05 s, 5.2 MB/s 2024-09-21T07:09:41.594 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:09:41.651 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-09-21T07:09:41.707 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:09:41.707 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:09:41.707 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T07:09:41.707 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:09:41.707 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:09:41.707 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-21 07:09:30.725004826 +0000 2024-09-21T07:09:41.707 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-21 07:07:37.799578197 +0000 2024-09-21T07:09:41.707 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-21 07:07:37.799578197 +0000 2024-09-21T07:09:41.707 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-21 07:07:37.799578197 +0000 2024-09-21T07:09:41.708 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:09:41.770 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-21T07:09:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-21T07:09:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000101211 s, 5.1 MB/s 2024-09-21T07:09:41.772 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:09:41.829 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-09-21T07:09:41.885 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:09:41.885 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:09:41.885 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T07:09:41.885 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:09:41.885 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:09:41.885 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-21 07:09:30.725004826 +0000 2024-09-21T07:09:41.886 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-21 07:07:38.120574130 +0000 2024-09-21T07:09:41.886 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-21 07:07:38.120574130 +0000 2024-09-21T07:09:41.886 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-21 07:07:38.120574130 +0000 2024-09-21T07:09:41.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:09:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-21T07:09:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-21T07:09:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000102379 s, 5.0 MB/s 2024-09-21T07:09:41.950 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:09:42.007 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T07:09:42.007 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:09:42.007 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:09:42.026 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:09:42.026 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2024-09-21T07:09:42.086 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:09:42.086 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:09:42.086 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T07:09:42.086 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:09:42.086 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:09:42.086 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-21 07:09:28.693179707 +0000 2024-09-21T07:09:42.087 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-21 07:07:37.144401261 +0000 2024-09-21T07:09:42.087 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-21 07:07:37.144401261 +0000 2024-09-21T07:09:42.087 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-21 07:07:37.144401261 +0000 2024-09-21T07:09:42.087 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:09:42.154 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-21T07:09:42.155 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-21T07:09:42.155 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000118427 s, 4.3 MB/s 2024-09-21T07:09:42.156 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:09:42.215 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2024-09-21T07:09:42.273 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:09:42.273 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:09:42.273 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T07:09:42.274 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:09:42.274 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:09:42.274 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-21 07:09:28.693179707 +0000 2024-09-21T07:09:42.274 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-21 07:07:37.500391539 +0000 2024-09-21T07:09:42.274 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-21 07:07:37.500391539 +0000 2024-09-21T07:09:42.274 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-21 07:07:37.500391539 +0000 2024-09-21T07:09:42.274 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:09:42.340 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-21T07:09:42.340 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-21T07:09:42.340 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.00011215 s, 4.6 MB/s 2024-09-21T07:09:42.342 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:09:42.399 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2024-09-21T07:09:42.457 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:09:42.457 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:09:42.457 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T07:09:42.457 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:09:42.457 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:09:42.457 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-21 07:09:28.694179680 +0000 2024-09-21T07:09:42.457 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-21 07:07:37.826382636 +0000 2024-09-21T07:09:42.457 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-21 07:07:37.826382636 +0000 2024-09-21T07:09:42.457 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-21 07:07:37.826382636 +0000 2024-09-21T07:09:42.458 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:09:42.522 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-21T07:09:42.522 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-21T07:09:42.522 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 9.1978e-05 s, 5.6 MB/s 2024-09-21T07:09:42.524 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:09:42.581 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2024-09-21T07:09:42.637 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:09:42.637 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:09:42.637 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T07:09:42.637 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:09:42.637 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:09:42.637 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-21 07:09:28.694179680 +0000 2024-09-21T07:09:42.637 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-21 07:07:38.141374033 +0000 2024-09-21T07:09:42.637 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-21 07:07:38.141374033 +0000 2024-09-21T07:09:42.638 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-21 07:07:38.141374033 +0000 2024-09-21T07:09:42.638 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:09:42.702 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-21T07:09:42.702 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-21T07:09:42.702 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 9.6047e-05 s, 5.3 MB/s 2024-09-21T07:09:42.703 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:09:42.760 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T07:09:42.760 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T07:09:42.760 INFO:tasks.ceph:Generating config... 2024-09-21T07:09:42.761 INFO:tasks.ceph:[client] pid file = 2024-09-21T07:09:42.761 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-21T07:09:42.761 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-21T07:09:42.761 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-09-21T07:09:42.761 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T07:09:42.761 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T07:09:42.761 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T07:09:42.762 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T07:09:42.762 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T07:09:42.762 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-21T07:09:42.762 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-21T07:09:42.762 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-21T07:09:42.762 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-21T07:09:42.762 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T07:09:42.762 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T07:09:42.762 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-21T07:09:42.762 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-21T07:09:42.762 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T07:09:42.762 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T07:09:42.762 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-21T07:09:42.762 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T07:09:42.763 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T07:09:42.763 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T07:09:42.763 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T07:09:42.763 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T07:09:42.763 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T07:09:42.763 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T07:09:42.831 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T07:09:42.835 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T07:09:42.893 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T07:09:42.918 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.18'), ('mon.b', '172.21.15.49'), ('mon.c', '[v2:172.21.15.49:3301,v1:172.21.15.49:6790]')] 2024-09-21T07:09:42.919 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.18,172.21.15.49,[v2:172.21.15.49:3301,v1:172.21.15.49:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-21T07:09:42.919 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:09:42.919 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T07:09:42.974 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.18 --add b 172.21.15.49 --addv c '[v2:172.21.15.49:3301,v1:172.21.15.49:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:09:43.072 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:09:43.072 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: generated fsid ed917ec8-3fd9-4777-97f4-b5e2f57d6f41 2024-09-21T07:09:43.072 INFO:teuthology.orchestra.run.smithi018.stdout:setting min_mon_release = quincy 2024-09-21T07:09:43.073 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 0 2024-09-21T07:09:43.073 INFO:teuthology.orchestra.run.smithi018.stdout:fsid ed917ec8-3fd9-4777-97f4-b5e2f57d6f41 2024-09-21T07:09:43.073 INFO:teuthology.orchestra.run.smithi018.stdout:last_changed 2024-09-21T07:09:43.071817+0000 2024-09-21T07:09:43.073 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-09-21T07:09:43.071817+0000 2024-09-21T07:09:43.073 INFO:teuthology.orchestra.run.smithi018.stdout:min_mon_release 17 (quincy) 2024-09-21T07:09:43.073 INFO:teuthology.orchestra.run.smithi018.stdout:election_strategy: 1 2024-09-21T07:09:43.073 INFO:teuthology.orchestra.run.smithi018.stdout:0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-21T07:09:43.073 INFO:teuthology.orchestra.run.smithi018.stdout:1: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.b 2024-09-21T07:09:43.073 INFO:teuthology.orchestra.run.smithi018.stdout:2: [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] mon.c 2024-09-21T07:09:43.073 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-21T07:09:43.074 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T07:09:43.090 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ed917ec8-3fd9-4777-97f4-b5e2f57d6f41... 2024-09-21T07:09:43.092 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T07:09:43.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T07:09:43.175 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-09-21T07:09:43.175 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2024-09-21T07:09:43.175 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T07:09:43.175 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2024-09-21T07:09:43.175 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.175 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2024-09-21T07:09:43.175 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2024-09-21T07:09:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2024-09-21T07:09:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2024-09-21T07:09:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2024-09-21T07:09:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2024-09-21T07:09:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T07:09:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2024-09-21T07:09:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T07:09:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T07:09:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2024-09-21T07:09:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2024-09-21T07:09:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2024-09-21T07:09:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2024-09-21T07:09:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2024-09-21T07:09:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2024-09-21T07:09:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2024-09-21T07:09:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2024-09-21T07:09:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T07:09:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T07:09:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2024-09-21T07:09:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:09:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2024-09-21T07:09:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2024-09-21T07:09:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2024-09-21T07:09:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2024-09-21T07:09:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2024-09-21T07:09:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = "172.21.15.18,172.21.15.49,[v2:172.21.15.49:3301,v1:172.21.15.49:6790]" 2024-09-21T07:09:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on skipped message = False 2024-09-21T07:09:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = ed917ec8-3fd9-4777-97f4-b5e2f57d6f41 2024-09-21T07:09:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.178 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2024-09-21T07:09:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2024-09-21T07:09:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2024-09-21T07:09:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2024-09-21T07:09:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: osd mclock profile = high_recovery_ops 2024-09-21T07:09:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2024-09-21T07:09:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2024-09-21T07:09:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2024-09-21T07:09:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2024-09-21T07:09:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2024-09-21T07:09:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug trim objects = true 2024-09-21T07:09:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2024-09-21T07:09:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2024-09-21T07:09:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2024-09-21T07:09:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2024-09-21T07:09:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2024-09-21T07:09:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2024-09-21T07:09:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2024-09-21T07:09:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2024-09-21T07:09:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2024-09-21T07:09:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: bdev async discard = True 2024-09-21T07:09:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: bdev enable discard = True 2024-09-21T07:09:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore allocator = bitmap 2024-09-21T07:09:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore block size = 96636764160 2024-09-21T07:09:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore fsck on mount = True 2024-09-21T07:09:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluefs = 1/20 2024-09-21T07:09:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluestore = 1/20 2024-09-21T07:09:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-21T07:09:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2024-09-21T07:09:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: debug rocksdb = 4/10 2024-09-21T07:09:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T07:09:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd full ratio = 0.9 2024-09-21T07:09:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd nearfull ratio = 0.8 2024-09-21T07:09:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: osd failsafe full ratio = 0.95 2024-09-21T07:09:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: osd objectstore = bluestore 2024-09-21T07:09:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.183 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2024-09-21T07:09:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-21T07:09:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2024-09-21T07:09:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-09-21T07:09:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-09-21T07:09:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:09:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:09:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2024-09-21T07:09:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: debug client = 20 2024-09-21T07:09:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: debug finisher = 20 2024-09-21T07:09:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.184 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2024-09-21T07:09:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-21T07:09:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-09-21T07:09:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2024-09-21T07:09:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-09-21T07:09:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2024-09-21T07:09:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2024-09-21T07:09:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:09:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2024-09-21T07:09:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2024-09-21T07:09:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:09:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T07:09:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T07:09:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T07:09:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T07:09:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T07:09:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T07:09:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: # 1m isn't quite enough 2024-09-21T07:09:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: mon_down_mkfs_grace = 2m 2024-09-21T07:09:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_filestore_osds = false 2024-09-21T07:09:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: mon down mkfs grace = 300 2024-09-21T07:09:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:09:43.186 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2024-09-21T07:09:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2024-09-21T07:09:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2024-09-21T07:09:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2024-09-21T07:09:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T07:09:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T07:09:43.187 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = "" 2024-09-21T07:09:43.187 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2024-09-21T07:09:43.187 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.b] 2024-09-21T07:09:43.187 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.c] 2024-09-21T07:09:43.187 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2024-09-21T07:09:43.187 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2024-09-21T07:09:43.187 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2024-09-21T07:09:43.187 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2024-09-21T07:09:43.188 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2024-09-21T07:09:43.188 INFO:teuthology.orchestra.run.smithi049.stdout: chdir = "" 2024-09-21T07:09:43.188 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T07:09:43.188 INFO:teuthology.orchestra.run.smithi049.stdout: auth supported = cephx 2024-09-21T07:09:43.188 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.188 INFO:teuthology.orchestra.run.smithi049.stdout: filestore xattr use omap = true 2024-09-21T07:09:43.188 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.189 INFO:teuthology.orchestra.run.smithi049.stdout: mon clock drift allowed = 1.000 2024-09-21T07:09:43.189 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.189 INFO:teuthology.orchestra.run.smithi049.stdout: osd crush chooseleaf type = 0 2024-09-21T07:09:43.189 INFO:teuthology.orchestra.run.smithi049.stdout: auth debug = true 2024-09-21T07:09:43.189 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.189 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on old message = true 2024-09-21T07:09:43.189 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on bug = true 2024-09-21T07:09:43.189 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.189 INFO:teuthology.orchestra.run.smithi049.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T07:09:43.189 INFO:teuthology.orchestra.run.smithi049.stdout: mon pg warn max object skew = 0 2024-09-21T07:09:43.190 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.190 INFO:teuthology.orchestra.run.smithi049.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T07:09:43.190 INFO:teuthology.orchestra.run.smithi049.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T07:09:43.190 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.190 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default size = 2 2024-09-21T07:09:43.190 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.191 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow primary affinity = true 2024-09-21T07:09:43.191 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow pg remap = true 2024-09-21T07:09:43.191 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on legacy crush tunables = false 2024-09-21T07:09:43.191 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on crush straw calc version zero = false 2024-09-21T07:09:43.191 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on no sortbitwise = false 2024-09-21T07:09:43.191 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on osd down out interval zero = false 2024-09-21T07:09:43.191 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on too few osds = false 2024-09-21T07:09:43.192 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T07:09:43.192 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T07:09:43.192 INFO:teuthology.orchestra.run.smithi049.stdout: mon_allow_pool_size_one = true 2024-09-21T07:09:43.192 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.192 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:09:43.192 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.192 INFO:teuthology.orchestra.run.smithi049.stdout: osd default data pool replay window = 5 2024-09-21T07:09:43.193 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.193 INFO:teuthology.orchestra.run.smithi049.stdout: mon allow pool delete = true 2024-09-21T07:09:43.193 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.193 INFO:teuthology.orchestra.run.smithi049.stdout: mon cluster log file level = debug 2024-09-21T07:09:43.193 INFO:teuthology.orchestra.run.smithi049.stdout: debug asserts on shutdown = true 2024-09-21T07:09:43.193 INFO:teuthology.orchestra.run.smithi049.stdout: mon health detail to clog = false 2024-09-21T07:09:43.193 INFO:teuthology.orchestra.run.smithi049.stdout: mon host = "172.21.15.18,172.21.15.49,[v2:172.21.15.49:3301,v1:172.21.15.49:6790]" 2024-09-21T07:09:43.194 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on skipped message = False 2024-09-21T07:09:43.194 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = ed917ec8-3fd9-4777-97f4-b5e2f57d6f41 2024-09-21T07:09:43.194 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.194 INFO:teuthology.orchestra.run.smithi049.stdout:[osd] 2024-09-21T07:09:43.194 INFO:teuthology.orchestra.run.smithi049.stdout: osd journal size = 100 2024-09-21T07:09:43.194 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.195 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub load threshold = 5.0 2024-09-21T07:09:43.195 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub max interval = 600 2024-09-21T07:09:43.195 INFO:teuthology.orchestra.run.smithi049.stdout: osd mclock profile = high_recovery_ops 2024-09-21T07:09:43.195 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.195 INFO:teuthology.orchestra.run.smithi049.stdout: osd recover clone overlap = true 2024-09-21T07:09:43.195 INFO:teuthology.orchestra.run.smithi049.stdout: osd recovery max chunk = 1048576 2024-09-21T07:09:43.195 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.196 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug shutdown = true 2024-09-21T07:09:43.196 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug op order = true 2024-09-21T07:09:43.196 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug verify stray on activate = true 2024-09-21T07:09:43.196 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug trim objects = true 2024-09-21T07:09:43.196 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.196 INFO:teuthology.orchestra.run.smithi049.stdout: osd open classes on start = true 2024-09-21T07:09:43.197 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug pg log writeout = true 2024-09-21T07:09:43.197 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.197 INFO:teuthology.orchestra.run.smithi049.stdout: osd deep scrub update digest min age = 30 2024-09-21T07:09:43.197 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.197 INFO:teuthology.orchestra.run.smithi049.stdout: osd map max advance = 10 2024-09-21T07:09:43.197 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.197 INFO:teuthology.orchestra.run.smithi049.stdout: journal zero on create = true 2024-09-21T07:09:43.198 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.198 INFO:teuthology.orchestra.run.smithi049.stdout: filestore ondisk finisher threads = 3 2024-09-21T07:09:43.198 INFO:teuthology.orchestra.run.smithi049.stdout: filestore apply finisher threads = 3 2024-09-21T07:09:43.198 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.198 INFO:teuthology.orchestra.run.smithi049.stdout: bdev debug aio = true 2024-09-21T07:09:43.198 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug misdirected ops = true 2024-09-21T07:09:43.199 INFO:teuthology.orchestra.run.smithi049.stdout: bdev async discard = True 2024-09-21T07:09:43.199 INFO:teuthology.orchestra.run.smithi049.stdout: bdev enable discard = True 2024-09-21T07:09:43.199 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore allocator = bitmap 2024-09-21T07:09:43.199 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore block size = 96636764160 2024-09-21T07:09:43.199 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore fsck on mount = True 2024-09-21T07:09:43.199 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluefs = 1/20 2024-09-21T07:09:43.199 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluestore = 1/20 2024-09-21T07:09:43.200 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-09-21T07:09:43.200 INFO:teuthology.orchestra.run.smithi049.stdout: debug osd = 20 2024-09-21T07:09:43.200 INFO:teuthology.orchestra.run.smithi049.stdout: debug rocksdb = 4/10 2024-09-21T07:09:43.200 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T07:09:43.200 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd full ratio = 0.9 2024-09-21T07:09:43.200 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd nearfull ratio = 0.8 2024-09-21T07:09:43.201 INFO:teuthology.orchestra.run.smithi049.stdout: osd failsafe full ratio = 0.95 2024-09-21T07:09:43.201 INFO:teuthology.orchestra.run.smithi049.stdout: osd objectstore = bluestore 2024-09-21T07:09:43.201 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.201 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr] 2024-09-21T07:09:43.201 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-09-21T07:09:43.201 INFO:teuthology.orchestra.run.smithi049.stdout: debug mgr = 20 2024-09-21T07:09:43.201 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-09-21T07:09:43.202 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-09-21T07:09:43.202 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:09:43.202 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:09:43.202 INFO:teuthology.orchestra.run.smithi049.stdout: mgr/telemetry/nag = false 2024-09-21T07:09:43.202 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 20 2024-09-21T07:09:43.202 INFO:teuthology.orchestra.run.smithi049.stdout: debug finisher = 20 2024-09-21T07:09:43.202 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.203 INFO:teuthology.orchestra.run.smithi049.stdout:[mon] 2024-09-21T07:09:43.203 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-09-21T07:09:43.203 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-09-21T07:09:43.203 INFO:teuthology.orchestra.run.smithi049.stdout: debug paxos = 20 2024-09-21T07:09:43.203 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-09-21T07:09:43.203 INFO:teuthology.orchestra.run.smithi049.stdout: mon data avail warn = 5 2024-09-21T07:09:43.203 INFO:teuthology.orchestra.run.smithi049.stdout: mon mgr mkfs grace = 240 2024-09-21T07:09:43.203 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-09-21T07:09:43.204 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd reporter subtree level = osd 2024-09-21T07:09:43.204 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd prime pg temp = true 2024-09-21T07:09:43.204 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-09-21T07:09:43.204 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.204 INFO:teuthology.orchestra.run.smithi049.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T07:09:43.204 INFO:teuthology.orchestra.run.smithi049.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T07:09:43.204 INFO:teuthology.orchestra.run.smithi049.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T07:09:43.205 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.205 INFO:teuthology.orchestra.run.smithi049.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T07:09:43.205 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T07:09:43.205 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T07:09:43.205 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.205 INFO:teuthology.orchestra.run.smithi049.stdout: # 1m isn't quite enough 2024-09-21T07:09:43.205 INFO:teuthology.orchestra.run.smithi049.stdout: mon_down_mkfs_grace = 2m 2024-09-21T07:09:43.205 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.205 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_filestore_osds = false 2024-09-21T07:09:43.205 INFO:teuthology.orchestra.run.smithi049.stdout: mon down mkfs grace = 300 2024-09-21T07:09:43.205 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T07:09:43.205 INFO:teuthology.orchestra.run.smithi049.stdout:[client] 2024-09-21T07:09:43.205 INFO:teuthology.orchestra.run.smithi049.stdout: rgw cache enabled = true 2024-09-21T07:09:43.206 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable ops log = true 2024-09-21T07:09:43.206 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable usage log = true 2024-09-21T07:09:43.206 INFO:teuthology.orchestra.run.smithi049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T07:09:43.206 INFO:teuthology.orchestra.run.smithi049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T07:09:43.206 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = "" 2024-09-21T07:09:43.206 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.a] 2024-09-21T07:09:43.206 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.b] 2024-09-21T07:09:43.206 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.c] 2024-09-21T07:09:43.206 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2024-09-21T07:09:43.206 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2024-09-21T07:09:43.206 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2024-09-21T07:09:43.206 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2024-09-21T07:09:43.208 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T07:09:43.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T07:09:43.314 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T07:09:43.314 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:09:43.314 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T07:09:43.330 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:09:43.330 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T07:09:43.386 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T07:09:43.386 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:09:43.386 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T07:09:43.387 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T07:09:43.462 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:09:43.462 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:09:43.518 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T07:09:43.519 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:09:43.519 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T07:09:43.519 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T07:09:43.556 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:09:43.556 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:09:43.613 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T07:09:43.613 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T07:09:43.614 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T07:09:43.676 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T07:09:43.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T07:09:43.750 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T07:09:43.753 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T07:09:43.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T07:09:43.816 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T07:09:43.819 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-21T07:09:43.844 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T07:09:43.946 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T07:09:43.949 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-21T07:09:43.974 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T07:09:44.038 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T07:09:44.042 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-21T07:09:44.067 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T07:09:44.170 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T07:09:44.173 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-21T07:09:44.198 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T07:09:44.198 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T07:09:44.251 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T07:09:44.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-21T07:09:44.317 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-21T07:09:44.331 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T07:09:44.383 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-21T07:09:44.397 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-21T07:09:44.449 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-21T07:09:44.462 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T07:09:44.462 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T07:09:44.463 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T07:09:44.491 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T07:09:44.491 INFO:tasks.ceph:role: osd.0 2024-09-21T07:09:44.491 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T07:09:44.491 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T07:09:44.556 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:09:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:09:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:09:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T07:09:44.556 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:09:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:09:44.557 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:09:44.557 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T07:09:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:09:44.557 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:09:44.589 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-21T07:09:44.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-21T07:09:44.591 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T07:09:44.662 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T07:09:44.732 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T07:09:44.799 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T07:09:44.799 INFO:tasks.ceph:role: osd.1 2024-09-21T07:09:44.799 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T07:09:44.799 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T07:09:44.865 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:09:44.865 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:09:44.865 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:09:44.865 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T07:09:44.865 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:09:44.865 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:09:44.865 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:09:44.865 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T07:09:44.865 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:09:44.865 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:09:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-21T07:09:44.899 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-21T07:09:44.899 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-21T07:09:44.969 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T07:09:45.040 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T07:09:45.107 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T07:09:45.107 INFO:tasks.ceph:role: osd.2 2024-09-21T07:09:45.107 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T07:09:45.107 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T07:09:45.172 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:09:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:09:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:09:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T07:09:45.172 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:09:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:09:45.173 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:09:45.173 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T07:09:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:09:45.173 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:09:45.205 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-21T07:09:45.207 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-21T07:09:45.207 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-21T07:09:45.277 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T07:09:45.347 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T07:09:45.414 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T07:09:45.414 INFO:tasks.ceph:role: osd.3 2024-09-21T07:09:45.414 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T07:09:45.415 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T07:09:45.479 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:09:45.479 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:09:45.479 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:09:45.479 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T07:09:45.480 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:09:45.480 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:09:45.480 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:09:45.480 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T07:09:45.480 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:09:45.480 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:09:45.512 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-21T07:09:45.514 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-21T07:09:45.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-21T07:09:45.588 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T07:09:45.658 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:09:45.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:45.764+0000 7f5ca2a16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-21T07:09:45.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:45.764+0000 7f5ca2a16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-21T07:09:45.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:45.764+0000 7f5ca2a16640 -1 bdev(0x56124ac8f900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-21T07:09:45.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:45.764+0000 7f5ca2a16640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-21T07:09:49.184 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T07:09:49.215 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:09:49.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:49.318+0000 7f1217c20640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-21T07:09:49.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:49.318+0000 7f1217c20640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-21T07:09:49.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:49.318+0000 7f1217c20640 -1 bdev(0x563a9369f900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-21T07:09:49.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:49.318+0000 7f1217c20640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-21T07:09:52.735 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T07:09:52.765 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:09:52.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:52.869+0000 7f8f6560c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-21T07:09:52.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:52.869+0000 7f8f6560c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-21T07:09:52.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:52.869+0000 7f8f6560c640 -1 bdev(0x56250c4ff900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-21T07:09:52.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:52.869+0000 7f8f6560c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-21T07:09:56.272 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T07:09:56.300 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:09:56.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:56.399+0000 7f05245c1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-21T07:09:56.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:56.399+0000 7f05245c1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-21T07:09:56.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:56.399+0000 7f05245c1640 -1 bdev(0x556cf8011900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-21T07:09:56.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:09:56.399+0000 7f05245c1640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-21T07:10:00.065 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T07:10:00.096 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-21T07:10:00.128 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T07:10:00.128 INFO:tasks.ceph:role: osd.4 2024-09-21T07:10:00.128 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T07:10:00.128 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T07:10:00.197 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:10:00.197 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:10:00.197 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:10:00.197 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T07:10:00.197 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:10:00.198 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:10:00.198 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:10:00.198 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T07:10:00.198 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:10:00.198 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:10:00.232 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2024-09-21T07:10:00.234 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2024-09-21T07:10:00.234 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-21T07:10:00.306 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-21T07:10:00.378 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-21T07:10:00.445 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T07:10:00.445 INFO:tasks.ceph:role: osd.5 2024-09-21T07:10:00.446 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T07:10:00.446 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T07:10:00.512 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:10:00.512 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:10:00.512 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:10:00.512 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T07:10:00.512 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:10:00.513 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:10:00.513 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:10:00.513 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T07:10:00.513 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:10:00.513 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:10:00.548 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2024-09-21T07:10:00.551 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2024-09-21T07:10:00.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-21T07:10:00.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-21T07:10:00.696 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-21T07:10:00.761 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T07:10:00.761 INFO:tasks.ceph:role: osd.6 2024-09-21T07:10:00.761 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T07:10:00.762 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T07:10:00.828 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:10:00.829 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:10:00.829 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:10:00.829 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T07:10:00.829 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:10:00.829 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:10:00.829 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:10:00.829 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T07:10:00.829 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:10:00.829 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:10:00.865 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2024-09-21T07:10:00.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2024-09-21T07:10:00.867 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-21T07:10:00.937 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-21T07:10:01.007 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-21T07:10:01.073 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T07:10:01.073 INFO:tasks.ceph:role: osd.7 2024-09-21T07:10:01.073 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T07:10:01.073 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T07:10:01.138 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T07:10:01.138 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T07:10:01.138 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T07:10:01.138 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T07:10:01.138 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T07:10:01.138 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2024-09-21T07:10:01.138 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T07:10:01.139 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T07:10:01.139 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T07:10:01.139 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T07:10:01.174 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2024-09-21T07:10:01.176 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2024-09-21T07:10:01.176 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-21T07:10:01.245 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-21T07:10:01.314 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:10:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:01.418+0000 7fba9c231640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-21T07:10:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:01.418+0000 7fba9c231640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-21T07:10:01.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:01.418+0000 7fba9c231640 -1 bdev(0x55bc492af900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-21T07:10:01.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:01.418+0000 7fba9c231640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-21T07:10:04.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T07:10:04.622 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:10:04.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:04.727+0000 7f709fc1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-21T07:10:04.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:04.727+0000 7f709fc1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-21T07:10:04.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:04.727+0000 7f709fc1a640 -1 bdev(0x55f03232d900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-21T07:10:04.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:04.728+0000 7f709fc1a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-21T07:10:07.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T07:10:07.922 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:10:08.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:08.022+0000 7f484ad1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-21T07:10:08.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:08.022+0000 7f484ad1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-21T07:10:08.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:08.022+0000 7f484ad1e640 -1 bdev(0x55691e1a1900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-21T07:10:08.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:08.022+0000 7f484ad1e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-21T07:10:10.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-21T07:10:10.969 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:10:11.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:11.076+0000 7fa64d9c5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-21T07:10:11.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:11.076+0000 7fa64d9c5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-21T07:10:11.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:11.076+0000 7fa64d9c5640 -1 bdev(0x55e73265f900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-21T07:10:11.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:11.077+0000 7fa64d9c5640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-21T07:10:11.158 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:10:11.161 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:10:14.494 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-21T07:10:14.524 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T07:10:14.525 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:10:14.525 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-21T07:10:14.556 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:10:14.556 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-21T07:10:14.625 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:10:14.625 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-21T07:10:14.694 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:10:14.694 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T07:10:14.760 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:10:14.760 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T07:10:14.827 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:10:14.827 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T07:10:14.894 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:10:14.894 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T07:10:14.960 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:10:14.960 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T07:10:14.991 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:10:14.991 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-21T07:10:15.060 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:10:15.060 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-21T07:10:15.129 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:10:15.129 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-21T07:10:15.197 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:10:15.198 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-21T07:10:15.265 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:10:15.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-21T07:10:15.333 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:10:15.334 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-21T07:10:15.400 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:10:15.401 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T07:10:15.418 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:10:15.418 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-21T07:10:15.474 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:10:15.474 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-21T07:10:15.491 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:10:15.491 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-21T07:10:15.550 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T07:10:15.551 DEBUG:teuthology.orchestra.run.smithi018:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T07:10:15.553 DEBUG:teuthology.orchestra.run.smithi049:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T07:10:15.594 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.y] 2024-09-21T07:10:15.594 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA3ce5mDa9EKBAA8u/yP/frJ9d2GvHkLfhthQ== 2024-09-21T07:10:15.594 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2024-09-21T07:10:15.594 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA3ce5mK3ibMBAA7YebOqMbzm7WOKOimqHsTg== 2024-09-21T07:10:15.594 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2024-09-21T07:10:15.594 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA3ce5m+MZdOBAAFzOYOjjO6X0X6Q56X7MFxQ== 2024-09-21T07:10:15.594 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.0] 2024-09-21T07:10:15.595 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA5ce5mLo2tLRAAbSAouEw3LrKhAotfyHDTpQ== 2024-09-21T07:10:15.595 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.1] 2024-09-21T07:10:15.595 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA9ce5mq9AJExAA4hrMJ2fG18IDgxHjQgnVaw== 2024-09-21T07:10:15.595 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.2] 2024-09-21T07:10:15.595 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBAce5mU5PcMxAA0W/5NV6LL4oz3CL4Vz5g2A== 2024-09-21T07:10:15.595 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.3] 2024-09-21T07:10:15.595 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBEce5majPWFxAAtM+5JisBb6qwbcOr+A9g9Q== 2024-09-21T07:10:15.595 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.x] 2024-09-21T07:10:15.595 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA3ce5mo0CwLBAArojazCStHf7R8Fp6N8r6gg== 2024-09-21T07:10:15.595 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2024-09-21T07:10:15.595 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA4ce5mbjFFAhAA2K6D9olAal5KgXqmWELojg== 2024-09-21T07:10:15.595 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2024-09-21T07:10:15.595 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA4ce5mHFEbChAAl/342q1xMDq1eQUGpOaLRw== 2024-09-21T07:10:15.595 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.4] 2024-09-21T07:10:15.595 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBJce5mzwcCGRAAkG+tsd1wH6TL+nHVIoHHkQ== 2024-09-21T07:10:15.596 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.5] 2024-09-21T07:10:15.596 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBMce5mtttkKxAAec30vgfU90CAj72Hv4pHfQ== 2024-09-21T07:10:15.596 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.6] 2024-09-21T07:10:15.596 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBQce5mEI9VARAARR+htWsJV4EXT9Qk1Rc9dw== 2024-09-21T07:10:15.596 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.7] 2024-09-21T07:10:15.596 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBTce5mpDeWBBAANIi5lhBXRWVf7w1YxKc7ZQ== 2024-09-21T07:10:15.596 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-21T07:10:15.596 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA4ce5mJv7rDhAAkKNAHkkVH1tIbrRt3I1zBg== 2024-09-21T07:10:15.596 INFO:teuthology.orchestra.run.smithi018.stdout:[client.2] 2024-09-21T07:10:15.596 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA4ce5muYPjEhAA1DSfHtawBY51YrYpoYoB1Q== 2024-09-21T07:10:15.596 INFO:teuthology.orchestra.run.smithi018.stdout:[client.1] 2024-09-21T07:10:15.596 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA4ce5mLq/WFhAA6HHSKH0bTNiuPHtZUP/czg== 2024-09-21T07:10:15.596 INFO:teuthology.orchestra.run.smithi018.stdout:[client.3] 2024-09-21T07:10:15.596 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA4ce5mxGW3GhAAGAYa/ctLH45tnWV9GHiqYg== 2024-09-21T07:10:15.616 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.y] 2024-09-21T07:10:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA3ce5mDa9EKBAA8u/yP/frJ9d2GvHkLfhthQ== 2024-09-21T07:10:15.616 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2024-09-21T07:10:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA3ce5mK3ibMBAA7YebOqMbzm7WOKOimqHsTg== 2024-09-21T07:10:15.616 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2024-09-21T07:10:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA3ce5m+MZdOBAAFzOYOjjO6X0X6Q56X7MFxQ== 2024-09-21T07:10:15.616 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.0] 2024-09-21T07:10:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA5ce5mLo2tLRAAbSAouEw3LrKhAotfyHDTpQ== 2024-09-21T07:10:15.616 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.1] 2024-09-21T07:10:15.616 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA9ce5mq9AJExAA4hrMJ2fG18IDgxHjQgnVaw== 2024-09-21T07:10:15.617 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.2] 2024-09-21T07:10:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBAce5mU5PcMxAA0W/5NV6LL4oz3CL4Vz5g2A== 2024-09-21T07:10:15.617 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.3] 2024-09-21T07:10:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBEce5majPWFxAAtM+5JisBb6qwbcOr+A9g9Q== 2024-09-21T07:10:15.617 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.x] 2024-09-21T07:10:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA3ce5mo0CwLBAArojazCStHf7R8Fp6N8r6gg== 2024-09-21T07:10:15.617 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2024-09-21T07:10:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA4ce5mbjFFAhAA2K6D9olAal5KgXqmWELojg== 2024-09-21T07:10:15.617 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2024-09-21T07:10:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA4ce5mHFEbChAAl/342q1xMDq1eQUGpOaLRw== 2024-09-21T07:10:15.617 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.4] 2024-09-21T07:10:15.617 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBJce5mzwcCGRAAkG+tsd1wH6TL+nHVIoHHkQ== 2024-09-21T07:10:15.618 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.5] 2024-09-21T07:10:15.618 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBMce5mtttkKxAAec30vgfU90CAj72Hv4pHfQ== 2024-09-21T07:10:15.618 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.6] 2024-09-21T07:10:15.618 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBQce5mEI9VARAARR+htWsJV4EXT9Qk1Rc9dw== 2024-09-21T07:10:15.618 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.7] 2024-09-21T07:10:15.618 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBTce5mpDeWBBAANIi5lhBXRWVf7w1YxKc7ZQ== 2024-09-21T07:10:15.618 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-09-21T07:10:15.618 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA4ce5mJv7rDhAAkKNAHkkVH1tIbrRt3I1zBg== 2024-09-21T07:10:15.618 INFO:teuthology.orchestra.run.smithi049.stdout:[client.2] 2024-09-21T07:10:15.618 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA4ce5muYPjEhAA1DSfHtawBY51YrYpoYoB1Q== 2024-09-21T07:10:15.618 INFO:teuthology.orchestra.run.smithi049.stdout:[client.1] 2024-09-21T07:10:15.619 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA4ce5mLq/WFhAA6HHSKH0bTNiuPHtZUP/czg== 2024-09-21T07:10:15.619 INFO:teuthology.orchestra.run.smithi049.stdout:[client.3] 2024-09-21T07:10:15.619 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQA4ce5mxGW3GhAAGAYa/ctLH45tnWV9GHiqYg== 2024-09-21T07:10:15.620 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T07:10:15.640 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T07:10:15.723 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:10:15.726 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:10:15.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:10:15.794 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:10:15.859 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:15.861 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:15.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:15.926 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:15.988 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:15.990 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:16.052 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:16.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:16.116 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T07:10:16.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T07:10:16.181 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:10:16.183 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:10:16.249 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:10:16.252 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T07:10:16.319 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:16.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:16.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:16.386 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:16.449 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:16.451 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:16.513 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:16.516 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T07:10:16.579 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:10:16.581 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:10:16.647 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:10:16.649 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:10:16.715 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:10:16.718 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:10:16.784 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:10:16.786 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T07:10:16.852 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T07:10:16.852 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T07:10:16.877 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T07:10:16.985 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T07:10:17.011 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-21T07:10:17.037 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T07:10:17.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-21T07:10:17.171 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-21T07:10:17.237 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T07:10:17.346 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-21T07:10:17.371 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:10:17.374 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T07:10:17.428 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T07:10:17.428 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T07:10:17.428 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T07:10:17.431 INFO:tasks.ceph.mon.a:Started 2024-09-21T07:10:17.431 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-21T07:10:17.431 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-21T07:10:17.471 INFO:tasks.ceph.mon.b:Started 2024-09-21T07:10:17.471 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T07:10:17.471 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T07:10:17.474 INFO:tasks.ceph.mon.c:Started 2024-09-21T07:10:17.474 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T07:10:17.474 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-21T07:10:17.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-21T07:10:17.477 INFO:tasks.ceph.mgr.y:Started 2024-09-21T07:10:17.478 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T07:10:17.478 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T07:10:17.480 INFO:tasks.ceph.mgr.x:Started 2024-09-21T07:10:17.480 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-21T07:10:17.481 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-21T07:10:17.483 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-21T07:10:17.484 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-21T07:10:17.526 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-21T07:10:17.527 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-21T07:10:17.569 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-21T07:10:17.569 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-21T07:10:17.612 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-21T07:10:17.613 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-21T07:10:17.655 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-21T07:10:17.655 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-21T07:10:17.698 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-21T07:10:17.699 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-21T07:10:17.742 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-21T07:10:17.742 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-21T07:10:17.786 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-21T07:10:17.786 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-21T07:10:17.830 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-21T07:10:17.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-21T07:10:17.875 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-21T07:10:17.876 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-21T07:10:17.926 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-21T07:10:17.926 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-21T07:10:17.963 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-21T07:10:17.963 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-21T07:10:17.984 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T07:10:17.984 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-21T07:10:18.013 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T07:10:18.014 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-21T07:10:18.060 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-21T07:10:18.061 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-21T07:10:18.103 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-21T07:10:18.104 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-21T07:10:18.146 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-21T07:10:18.147 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-21T07:10:18.169 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-21T07:10:18.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-21T07:10:18.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.190+0000 7fab0221d640 1 -- 172.21.15.18:0/1034055652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faafc0b5260 msgr2=0x7faafc0aa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.190+0000 7fab0221d640 1 --2- 172.21.15.18:0/1034055652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faafc0b5260 0x7faafc0aa4c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faaec00ed00 tx=0x7faaec00c640 comp rx=0 tx=0).stop 2024-09-21T07:10:18.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.190+0000 7fab0221d640 1 -- 172.21.15.18:0/1034055652 shutdown_connections 2024-09-21T07:10:18.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.191+0000 7fab0221d640 1 --2- 172.21.15.18:0/1034055652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faafc15c810 0x7faafc1f45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.191+0000 7fab0221d640 1 --2- 172.21.15.18:0/1034055652 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7faafc0b5670 0x7faafc1f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.191+0000 7fab0221d640 1 --2- 172.21.15.18:0/1034055652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faafc0b5260 0x7faafc0aa4c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.191+0000 7fab0221d640 1 -- 172.21.15.18:0/1034055652 >> 172.21.15.18:0/1034055652 conn(0x7faafc0b3a40 msgr2=0x7faafc159a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.191+0000 7fab0221d640 1 -- 172.21.15.18:0/1034055652 shutdown_connections 2024-09-21T07:10:18.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.191+0000 7fab0221d640 1 -- 172.21.15.18:0/1034055652 wait complete. 2024-09-21T07:10:18.198 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T07:10:18.198 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T07:10:18.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.204+0000 7f1808ff9640 1 -- 172.21.15.18:0/2606797867 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f180c0c3410 con 0x7f1804005cb0 2024-09-21T07:10:18.218 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-21T07:10:18.218 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-21T07:10:18.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.212+0000 7f4a38ff9640 1 -- 172.21.15.18:0/3906600852 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f4a300016f0 con 0x7f4a44052b60 2024-09-21T07:10:18.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.217+0000 7f4e097e6640 1 -- 172.21.15.18:0/4256194092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc0e7000 msgr2=0x7f4dfc005e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.217+0000 7f4e097e6640 1 --2- 172.21.15.18:0/4256194092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc0e7000 0x7f4dfc005e30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4e0402ebd0 tx=0x7f4e040b76a0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.217+0000 7f4e097e6640 1 -- 172.21.15.18:0/4256194092 shutdown_connections 2024-09-21T07:10:18.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.217+0000 7f4e097e6640 1 --2- 172.21.15.18:0/4256194092 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4dfc0e7410 0x7f4dfc006370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.217+0000 7f4e097e6640 1 --2- 172.21.15.18:0/4256194092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc0e7000 0x7f4dfc005e30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.217+0000 7f4e097e6640 1 --2- 172.21.15.18:0/4256194092 >> v2:172.21.15.18:3300/0 conn(0x7f4dfc052360 0x7f4dfc0e6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.217+0000 7f4e097e6640 1 -- 172.21.15.18:0/4256194092 >> 172.21.15.18:0/4256194092 conn(0x7f4dfc01d9a0 msgr2=0x7f4dfc039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.217+0000 7f4e097e6640 1 -- 172.21.15.18:0/4256194092 shutdown_connections 2024-09-21T07:10:18.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.217+0000 7f4e097e6640 1 -- 172.21.15.18:0/4256194092 wait complete. 2024-09-21T07:10:18.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.221+0000 7f4e097e6640 1 Processor -- start 2024-09-21T07:10:18.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.221+0000 7f4e097e6640 1 -- start start 2024-09-21T07:10:18.225 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-21T07:10:18.226 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-21T07:10:18.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.228+0000 7f4e097e6640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4dfc052360 0x7f4dfc032de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.231 DEBUG:tasks.ceph:set 22 configs 2024-09-21T07:10:18.232 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.232 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.232 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.228+0000 7f4e097e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dfc0e7000 0x7f4dfc0ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.228+0000 7f4e097e6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc0e7410 0x7f4dfc0dcb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.229+0000 7f4e097e6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc0e3590 con 0x7f4dfc0e7000 2024-09-21T07:10:18.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.229+0000 7f4e097e6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc0e3410 con 0x7f4dfc0e7410 2024-09-21T07:10:18.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.229+0000 7f4e037fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc0e7410 0x7f4dfc0dcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.229+0000 7f4e037fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc0e7410 0x7f4dfc0dcb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:56434/0 (socket says 172.21.15.18:56434) 2024-09-21T07:10:18.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.229+0000 7f4e037fe640 1 -- 172.21.15.18:0/2207544182 learned_addr learned my addr 172.21.15.18:0/2207544182 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:18.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.229+0000 7f4e097e6640 1 -- 172.21.15.18:0/2207544182 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f4dfc054720 con 0x7f4dfc052360 2024-09-21T07:10:18.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.230+0000 7f4e02ffd640 1 --2- 172.21.15.18:0/2207544182 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4dfc052360 0x7f4dfc032de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.237+0000 7f4a3affd640 1 -- 172.21.15.18:0/3906600852 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7f4a400054f0 con 0x7f4a44052b60 2024-09-21T07:10:18.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.239+0000 7f4a38ff9640 1 -- 172.21.15.18:0/3906600852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a44052b60 msgr2=0x7f4a44021120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.239+0000 7f4a38ff9640 1 --2- 172.21.15.18:0/3906600852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a44052b60 0x7f4a44021120 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4a40009460 tx=0x7f4a40009920 comp rx=0 tx=0).stop 2024-09-21T07:10:18.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.231+0000 7f4e027fc640 1 --2- 172.21.15.18:0/2207544182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dfc0e7000 0x7f4dfc0ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.232+0000 7f4e027fc640 1 -- 172.21.15.18:0/2207544182 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4dfc052360 msgr2=0x7f4dfc032de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.232+0000 7f4e027fc640 1 --2- 172.21.15.18:0/2207544182 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4dfc052360 0x7f4dfc032de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.232+0000 7f4e027fc640 1 -- 172.21.15.18:0/2207544182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc0e7410 msgr2=0x7f4dfc0dcb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.232+0000 7f4e027fc640 1 --2- 172.21.15.18:0/2207544182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc0e7410 0x7f4dfc0dcb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.232+0000 7f4e027fc640 1 -- 172.21.15.18:0/2207544182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dfc0caf20 con 0x7f4dfc0e7000 2024-09-21T07:10:18.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.233+0000 7f4e02ffd640 1 --2- 172.21.15.18:0/2207544182 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4dfc052360 0x7f4dfc032de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:18.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.234+0000 7f4e027fc640 1 --2- 172.21.15.18:0/2207544182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dfc0e7000 0x7f4dfc0ca9e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e04075960 tx=0x7f4e040bd5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:18.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.240+0000 7f4deb7fe640 1 -- 172.21.15.18:0/2207544182 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e040cc070 con 0x7f4dfc0e7000 2024-09-21T07:10:18.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.240+0000 7f4e097e6640 1 -- 172.21.15.18:0/2207544182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dfc0da230 con 0x7f4dfc0e7000 2024-09-21T07:10:18.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.240+0000 7f4e097e6640 1 -- 172.21.15.18:0/2207544182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dfc0da7f0 con 0x7f4dfc0e7000 2024-09-21T07:10:18.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.241+0000 7f4a38ff9640 1 -- 172.21.15.18:0/3906600852 shutdown_connections 2024-09-21T07:10:18.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.241+0000 7f4a38ff9640 1 --2- 172.21.15.18:0/3906600852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a44052b60 0x7f4a44021120 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.241+0000 7f4a38ff9640 1 --2- 172.21.15.18:0/3906600852 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4a44037520 0x7f4a4401f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.241+0000 7f4a38ff9640 1 --2- 172.21.15.18:0/3906600852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a44007db0 0x7f4a4404e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.241+0000 7f4a38ff9640 1 -- 172.21.15.18:0/3906600852 >> 172.21.15.18:0/3906600852 conn(0x7f4a4401e230 msgr2=0x7f4a4400b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.242+0000 7f4a38ff9640 1 -- 172.21.15.18:0/3906600852 shutdown_connections 2024-09-21T07:10:18.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.242+0000 7f4a38ff9640 1 -- 172.21.15.18:0/3906600852 wait complete. 2024-09-21T07:10:18.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.242+0000 7f4deb7fe640 1 -- 172.21.15.18:0/2207544182 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e040bdcc0 con 0x7f4dfc0e7000 2024-09-21T07:10:18.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.247+0000 7f4deb7fe640 1 -- 172.21.15.18:0/2207544182 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e040d1660 con 0x7f4dfc0e7000 2024-09-21T07:10:18.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.248+0000 7f4deb7fe640 1 -- 172.21.15.18:0/2207544182 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4e040d18c0 con 0x7f4dfc0e7000 2024-09-21T07:10:18.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.250+0000 7f2b37b69640 1 -- 172.21.15.18:0/677370482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b1c004800 msgr2=0x7f2b1c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.250+0000 7f2b37b69640 1 --2- 172.21.15.18:0/677370482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b1c004800 0x7f2b1c004c10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c00c310 tx=0x7f2b1c005830 comp rx=0 tx=0).stop 2024-09-21T07:10:18.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.250+0000 7f2b37b69640 1 -- 172.21.15.18:0/677370482 shutdown_connections 2024-09-21T07:10:18.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.250+0000 7f2b37b69640 1 --2- 172.21.15.18:0/677370482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b1c004800 0x7f2b1c004c10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.250+0000 7f2b37b69640 1 -- 172.21.15.18:0/677370482 >> 172.21.15.18:0/677370482 conn(0x7f2b30073d80 msgr2=0x7f2b3006cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.250+0000 7f2b37b69640 1 -- 172.21.15.18:0/677370482 shutdown_connections 2024-09-21T07:10:18.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.250+0000 7f2b37b69640 1 -- 172.21.15.18:0/677370482 wait complete. 2024-09-21T07:10:18.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.254+0000 7f2b37b69640 1 Processor -- start 2024-09-21T07:10:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.254+0000 7f4deb7fe640 1 -- 172.21.15.18:0/2207544182 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4e040c8460 con 0x7f4dfc0e7000 2024-09-21T07:10:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.255+0000 7f4de97fa640 1 -- 172.21.15.18:0/2207544182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de4005290 con 0x7f4dfc0e7000 2024-09-21T07:10:18.263 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.263 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.263 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.263 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.263 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.255+0000 7f2b37b69640 1 -- start start 2024-09-21T07:10:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.257+0000 7f2b37b69640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2b1c004800 0x7f2b301fdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.257+0000 7f2b37b69640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b301fd010 0x7f2b3006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.257+0000 7f2b37b69640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b3006ff20 0x7f2b300cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.257+0000 7f2b37b69640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3015ef30 con 0x7f2b301fd010 2024-09-21T07:10:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.257+0000 7f2b37b69640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3015f0b0 con 0x7f2b3006ff20 2024-09-21T07:10:18.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.262+0000 7f4deb7fe640 1 -- 172.21.15.18:0/2207544182 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4e040df020 con 0x7f4dfc0e7000 2024-09-21T07:10:18.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.257+0000 7f2b37b69640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f2b3015f230 con 0x7f2b1c004800 2024-09-21T07:10:18.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.257+0000 7f2b35905640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2b1c004800 0x7f2b301fdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.257+0000 7f2b35905640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2b1c004800 0x7f2b301fdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.18:41464/0 (socket says 172.21.15.18:41464) 2024-09-21T07:10:18.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.257+0000 7f2b35905640 1 -- 172.21.15.18:0/4215371083 learned_addr learned my addr 172.21.15.18:0/4215371083 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:18.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.257+0000 7f2b36106640 1 --2- 172.21.15.18:0/4215371083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b3006ff20 0x7f2b300cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.262+0000 7f2b36106640 1 -- 172.21.15.18:0/4215371083 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2b1c004800 msgr2=0x7f2b301fdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.262+0000 7f2b36106640 1 --2- 172.21.15.18:0/4215371083 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2b1c004800 0x7f2b301fdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.262+0000 7f2b36106640 1 -- 172.21.15.18:0/4215371083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b301fd010 msgr2=0x7f2b3006f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.262+0000 7f2b36106640 1 --2- 172.21.15.18:0/4215371083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b301fd010 0x7f2b3006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.262+0000 7f2b36106640 1 -- 172.21.15.18:0/4215371083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b30070330 con 0x7f2b3006ff20 2024-09-21T07:10:18.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.266+0000 7f2b36106640 1 --2- 172.21.15.18:0/4215371083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b3006ff20 0x7f2b300cd430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2b300cef60 tx=0x7f2b2800a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:18.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.270+0000 7f2b227fc640 1 -- 172.21.15.18:0/4215371083 <== mon.1 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b28003b70 con 0x7f2b3006ff20 2024-09-21T07:10:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.270+0000 7f2b227fc640 1 -- 172.21.15.18:0/4215371083 <== mon.1 v2:172.21.15.49:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b28003e20 con 0x7f2b3006ff20 2024-09-21T07:10:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.270+0000 7f2b227fc640 1 -- 172.21.15.18:0/4215371083 <== mon.1 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b28004280 con 0x7f2b3006ff20 2024-09-21T07:10:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.270+0000 7f2b37b69640 1 -- 172.21.15.18:0/4215371083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b300707a0 con 0x7f2b3006ff20 2024-09-21T07:10:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.270+0000 7f2b37b69640 1 -- 172.21.15.18:0/4215371083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b30072700 con 0x7f2b3006ff20 2024-09-21T07:10:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.271+0000 7f2b227fc640 1 -- 172.21.15.18:0/4215371083 <== mon.1 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2b280085c0 con 0x7f2b3006ff20 2024-09-21T07:10:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.271+0000 7f2b227fc640 1 -- 172.21.15.18:0/4215371083 <== mon.1 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2b280149d0 con 0x7f2b3006ff20 2024-09-21T07:10:18.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.280+0000 7f2b13fff640 1 -- 172.21.15.18:0/4215371083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b300d0dc0 con 0x7f2b3006ff20 2024-09-21T07:10:18.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.283+0000 7f2b227fc640 1 -- 172.21.15.18:0/4215371083 <== mon.1 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2b300d0dc0 con 0x7f2b3006ff20 2024-09-21T07:10:18.288 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.387+0000 7efef759e640 1 -- 172.21.15.18:0/1099952652 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7efef808c6c0 msgr2=0x7efef80af950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.387+0000 7efef759e640 1 --2- 172.21.15.18:0/1099952652 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7efef808c6c0 0x7efef80af950 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efef0005fd0 tx=0x7efef002aa50 comp rx=0 tx=0).stop 2024-09-21T07:10:18.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.388+0000 7efef759e640 1 -- 172.21.15.18:0/1099952652 shutdown_connections 2024-09-21T07:10:18.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.388+0000 7efef759e640 1 --2- 172.21.15.18:0/1099952652 >> v2:172.21.15.18:3300/0 conn(0x7efef80ce430 0x7efef80ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.388+0000 7efef759e640 1 --2- 172.21.15.18:0/1099952652 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7efef808c6c0 0x7efef80af950 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.388+0000 7efef759e640 1 -- 172.21.15.18:0/1099952652 >> 172.21.15.18:0/1099952652 conn(0x7efef80b2030 msgr2=0x7efef80b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.388+0000 7efef759e640 1 -- 172.21.15.18:0/1099952652 shutdown_connections 2024-09-21T07:10:18.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.388+0000 7efef759e640 1 -- 172.21.15.18:0/1099952652 wait complete. 2024-09-21T07:10:18.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.391+0000 7efef759e640 1 Processor -- start 2024-09-21T07:10:18.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.392+0000 7efef759e640 1 -- start start 2024-09-21T07:10:18.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.394+0000 7efef759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efef80ce430 0x7efef81fe390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.394+0000 7efef759e640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7efef80cf9d0 0x7efef8073350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.394+0000 7efef759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efef81fe8d0 0x7efef8073890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.394+0000 7efef5d9b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7efef80cf9d0 0x7efef8073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.394+0000 7efef659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efef80ce430 0x7efef81fe390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.394+0000 7efef5d9b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7efef80cf9d0 0x7efef8073350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.18:41480/0 (socket says 172.21.15.18:41480) 2024-09-21T07:10:18.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.394+0000 7efef5d9b640 1 -- 172.21.15.18:0/1507711165 learned_addr learned my addr 172.21.15.18:0/1507711165 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:18.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.394+0000 7efef759e640 1 -- 172.21.15.18:0/1507711165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efef80b5bf0 con 0x7efef81fe8d0 2024-09-21T07:10:18.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.394+0000 7efef6d9d640 1 --2- 172.21.15.18:0/1507711165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efef81fe8d0 0x7efef8073890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.395+0000 7efef759e640 1 -- 172.21.15.18:0/1507711165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efef80b5a70 con 0x7efef80ce430 2024-09-21T07:10:18.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.395+0000 7efef759e640 1 -- 172.21.15.18:0/1507711165 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7efef80b5d70 con 0x7efef80cf9d0 2024-09-21T07:10:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.395+0000 7efef659c640 1 -- 172.21.15.18:0/1507711165 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7efef80cf9d0 msgr2=0x7efef8073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.395+0000 7efef659c640 1 --2- 172.21.15.18:0/1507711165 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7efef80cf9d0 0x7efef8073350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.395+0000 7efef659c640 1 -- 172.21.15.18:0/1507711165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efef81fe8d0 msgr2=0x7efef8073890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.395+0000 7efef659c640 1 --2- 172.21.15.18:0/1507711165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efef81fe8d0 0x7efef8073890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.395+0000 7efef659c640 1 -- 172.21.15.18:0/1507711165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef8073dd0 con 0x7efef80ce430 2024-09-21T07:10:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.395+0000 7efef6d9d640 1 --2- 172.21.15.18:0/1507711165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efef81fe8d0 0x7efef8073890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.396+0000 7efef659c640 1 --2- 172.21.15.18:0/1507711165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efef80ce430 0x7efef81fe390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efee800c3f0 tx=0x7efee800c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.397+0000 7efee6ffd640 1 -- 172.21.15.18:0/1507711165 <== mon.1 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee8017070 con 0x7efef80ce430 2024-09-21T07:10:18.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.398+0000 7fdca58f2640 1 -- 172.21.15.18:0/2110957592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca006e230 msgr2=0x7fdca015c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.398+0000 7fdca58f2640 1 --2- 172.21.15.18:0/2110957592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca006e230 0x7fdca015c500 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdca0072200 tx=0x7fdc9802a6d0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.398+0000 7fdca58f2640 1 -- 172.21.15.18:0/2110957592 shutdown_connections 2024-09-21T07:10:18.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.398+0000 7fdca58f2640 1 --2- 172.21.15.18:0/2110957592 >> v2:172.21.15.18:3300/0 conn(0x7fdca00b61d0 0x7fdca0068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.398+0000 7fdca58f2640 1 --2- 172.21.15.18:0/2110957592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca006e230 0x7fdca015c500 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.398+0000 7fdca58f2640 1 -- 172.21.15.18:0/2110957592 >> 172.21.15.18:0/2110957592 conn(0x7fdca00d1830 msgr2=0x7fdca00d1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.397+0000 7efee6ffd640 1 -- 172.21.15.18:0/1507711165 <== mon.1 v2:172.21.15.49:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efee80053c0 con 0x7efef80ce430 2024-09-21T07:10:18.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.397+0000 7efee6ffd640 1 -- 172.21.15.18:0/1507711165 <== mon.1 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee8003850 con 0x7efef80ce430 2024-09-21T07:10:18.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.397+0000 7efef759e640 1 -- 172.21.15.18:0/1507711165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efef81f9e70 con 0x7efef80ce430 2024-09-21T07:10:18.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.397+0000 7efef759e640 1 -- 172.21.15.18:0/1507711165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efef82003d0 con 0x7efef80ce430 2024-09-21T07:10:18.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.399+0000 7efee6ffd640 1 -- 172.21.15.18:0/1507711165 <== mon.1 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efee801a070 con 0x7efef80ce430 2024-09-21T07:10:18.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.399+0000 7efee6ffd640 1 -- 172.21.15.18:0/1507711165 <== mon.1 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efee801c440 con 0x7efef80ce430 2024-09-21T07:10:18.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.399+0000 7efee4ff9640 1 -- 172.21.15.18:0/1507711165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efef80d1370 con 0x7efef80ce430 2024-09-21T07:10:18.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.401+0000 7fdca58f2640 1 -- 172.21.15.18:0/2110957592 shutdown_connections 2024-09-21T07:10:18.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.401+0000 7fdca58f2640 1 -- 172.21.15.18:0/2110957592 wait complete. 2024-09-21T07:10:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.407+0000 7efee6ffd640 1 -- 172.21.15.18:0/1507711165 <== mon.1 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7efee8021020 con 0x7efef80ce430 2024-09-21T07:10:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.407+0000 7f45527fc640 1 -- 172.21.15.18:0/1962779052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f456c0cc4b0 con 0x7f456c099c00 2024-09-21T07:10:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.404+0000 7fdca58f2640 1 Processor -- start 2024-09-21T07:10:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.404+0000 7fdca58f2640 1 -- start start 2024-09-21T07:10:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.406+0000 7fdca58f2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca006e230 0x7fdca0156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.406+0000 7fdca58f2640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdca0155870 0x7fdca0143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.406+0000 7fdca58f2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca00b20e0 0x7fdca00b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.407+0000 7fdc9e7fc640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdca0155870 0x7fdca0143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.407+0000 7fdc9e7fc640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdca0155870 0x7fdca0143b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.18:41484/0 (socket says 172.21.15.18:41484) 2024-09-21T07:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.407+0000 7fdc9ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca00b20e0 0x7fdca00b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.407+0000 7fdc9ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca00b20e0 0x7fdca00b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37676/0 (socket says 172.21.15.18:37676) 2024-09-21T07:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.407+0000 7fdc9e7fc640 1 -- 172.21.15.18:0/1857008535 learned_addr learned my addr 172.21.15.18:0/1857008535 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.407+0000 7fdca58f2640 1 -- 172.21.15.18:0/1857008535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdca0069280 con 0x7fdca00b20e0 2024-09-21T07:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.407+0000 7fdca58f2640 1 -- 172.21.15.18:0/1857008535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fdca0155e90 con 0x7fdca006e230 2024-09-21T07:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.407+0000 7fdca58f2640 1 -- 172.21.15.18:0/1857008535 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fdca0069400 con 0x7fdca0155870 2024-09-21T07:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.408+0000 7fdc9effd640 1 --2- 172.21.15.18:0/1857008535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca006e230 0x7fdca0156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.408+0000 7fdc9ffff640 1 -- 172.21.15.18:0/1857008535 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdca0155870 msgr2=0x7fdca0143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.408+0000 7fdc9ffff640 1 --2- 172.21.15.18:0/1857008535 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdca0155870 0x7fdca0143b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.408+0000 7fdc9ffff640 1 -- 172.21.15.18:0/1857008535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca006e230 msgr2=0x7fdca0156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.408+0000 7fdc9ffff640 1 --2- 172.21.15.18:0/1857008535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca006e230 0x7fdca0156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.408+0000 7fdc9ffff640 1 -- 172.21.15.18:0/1857008535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca00b2a30 con 0x7fdca00b20e0 2024-09-21T07:10:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.408+0000 7fdc9ffff640 1 --2- 172.21.15.18:0/1857008535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca00b20e0 0x7fdca00b24f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400d950 tx=0x7fdc9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.409+0000 7fdc87fff640 1 -- 172.21.15.18:0/1857008535 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94017070 con 0x7fdca00b20e0 2024-09-21T07:10:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.409+0000 7fdc87fff640 1 -- 172.21.15.18:0/1857008535 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc94004310 con 0x7fdca00b20e0 2024-09-21T07:10:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.410+0000 7fdc87fff640 1 -- 172.21.15.18:0/1857008535 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94005280 con 0x7fdca00b20e0 2024-09-21T07:10:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.410+0000 7fdca58f2640 1 -- 172.21.15.18:0/1857008535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca00aad40 con 0x7fdca00b20e0 2024-09-21T07:10:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.410+0000 7fdca58f2640 1 -- 172.21.15.18:0/1857008535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca00ab300 con 0x7fdca00b20e0 2024-09-21T07:10:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.410+0000 7fdc87fff640 1 -- 172.21.15.18:0/1857008535 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdc94009820 con 0x7fdca00b20e0 2024-09-21T07:10:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.410+0000 7fdc87fff640 1 -- 172.21.15.18:0/1857008535 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdc940035f0 con 0x7fdca00b20e0 2024-09-21T07:10:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.413+0000 7f4568ff9640 1 -- 172.21.15.18:0/1962779052 <== mon.1 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v10)=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7f4560004b30 con 0x7f456c099c00 2024-09-21T07:10:18.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.416+0000 7fdca58f2640 1 -- 172.21.15.18:0/1857008535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc80005290 con 0x7fdca00b20e0 2024-09-21T07:10:18.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.418+0000 7f45527fc640 1 -- 172.21.15.18:0/1962779052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f456c099c00 msgr2=0x7f456c0b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.418+0000 7f45527fc640 1 --2- 172.21.15.18:0/1962779052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f456c099c00 0x7f456c0b1810 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4560006010 tx=0x7f4560003820 comp rx=0 tx=0).stop 2024-09-21T07:10:18.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.418+0000 7f45527fc640 1 -- 172.21.15.18:0/1962779052 shutdown_connections 2024-09-21T07:10:18.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.418+0000 7f45527fc640 1 --2- 172.21.15.18:0/1962779052 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f456c0948a0 0x7f456c094cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.418+0000 7f45527fc640 1 --2- 172.21.15.18:0/1962779052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f456c170390 0x7f456c09daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.418+0000 7f45527fc640 1 --2- 172.21.15.18:0/1962779052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f456c099c00 0x7f456c0b1810 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.418+0000 7f45527fc640 1 -- 172.21.15.18:0/1962779052 >> 172.21.15.18:0/1962779052 conn(0x7f456c0ccd30 msgr2=0x7f456c095750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.422+0000 7f45527fc640 1 -- 172.21.15.18:0/1962779052 shutdown_connections 2024-09-21T07:10:18.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.422+0000 7f45527fc640 1 -- 172.21.15.18:0/1962779052 wait complete. 2024-09-21T07:10:18.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.429+0000 7f84fea39640 1 -- 172.21.15.18:0/1491765290 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f84f80cf880 msgr2=0x7f84f806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.429+0000 7f84fea39640 1 --2- 172.21.15.18:0/1491765290 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f84f80cf880 0x7f84f806fa10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f84f4005fd0 tx=0x7f84f402a460 comp rx=0 tx=0).stop 2024-09-21T07:10:18.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.422+0000 7fdc87fff640 1 -- 172.21.15.18:0/1857008535 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdc94020020 con 0x7fdca00b20e0 2024-09-21T07:10:18.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.431+0000 7f84fea39640 1 -- 172.21.15.18:0/1491765290 shutdown_connections 2024-09-21T07:10:18.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.431+0000 7f84fea39640 1 --2- 172.21.15.18:0/1491765290 >> v2:172.21.15.49:3300/0 conn(0x7f84f806ff50 0x7f84f8162b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.431+0000 7f84fea39640 1 --2- 172.21.15.18:0/1491765290 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f84f80cf880 0x7f84f806fa10 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f84f4005fd0 tx=0x7f84f402a460 comp rx=0 tx=0).stop 2024-09-21T07:10:18.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.431+0000 7f84fea39640 1 -- 172.21.15.18:0/1491765290 >> 172.21.15.18:0/1491765290 conn(0x7f84f80b2030 msgr2=0x7f84f80b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.435+0000 7f84fea39640 1 -- 172.21.15.18:0/1491765290 shutdown_connections 2024-09-21T07:10:18.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.435+0000 7f84fea39640 1 -- 172.21.15.18:0/1491765290 wait complete. 2024-09-21T07:10:18.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.438+0000 7f84fea39640 1 Processor -- start 2024-09-21T07:10:18.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.439+0000 7f84fea39640 1 -- start start 2024-09-21T07:10:18.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.441+0000 7f84fea39640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84f806ff50 0x7f84f80ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.441+0000 7f5e8a6b7640 1 -- 172.21.15.18:0/800507524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e8408c6c0 msgr2=0x7f5e840af950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.441+0000 7f5e8a6b7640 1 --2- 172.21.15.18:0/800507524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e8408c6c0 0x7f5e840af950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e840b33c0 tx=0x7f5e7c02ac40 comp rx=0 tx=0).stop 2024-09-21T07:10:18.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.441+0000 7f5e8a6b7640 1 -- 172.21.15.18:0/800507524 shutdown_connections 2024-09-21T07:10:18.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.441+0000 7f5e8a6b7640 1 --2- 172.21.15.18:0/800507524 >> v2:172.21.15.49:3300/0 conn(0x7f5e840ce430 0x7f5e840ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.441+0000 7f5e8a6b7640 1 --2- 172.21.15.18:0/800507524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e8408c6c0 0x7f5e840af950 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.441+0000 7f5e8a6b7640 1 -- 172.21.15.18:0/800507524 >> 172.21.15.18:0/800507524 conn(0x7f5e840b2030 msgr2=0x7f5e840b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.442+0000 7f84fea39640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f84f80af310 0x7f84f80ac660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.442+0000 7f84fda37640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84f806ff50 0x7f84f80ab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.442+0000 7f84fda37640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84f806ff50 0x7f84f80ab9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:56498/0 (socket says 172.21.15.18:56498) 2024-09-21T07:10:18.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.442+0000 7f84fda37640 1 -- 172.21.15.18:0/3794491929 learned_addr learned my addr 172.21.15.18:0/3794491929 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:18.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.442+0000 7f84fd236640 1 --2- 172.21.15.18:0/3794491929 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f84f80af310 0x7f84f80ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.443+0000 7f84fea39640 1 --2- 172.21.15.18:0/3794491929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f816b430 0x7f84f8164060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.443+0000 7f84fea39640 1 -- 172.21.15.18:0/3794491929 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f84f80b4290 con 0x7f84f816b430 2024-09-21T07:10:18.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.443+0000 7f84fea39640 1 -- 172.21.15.18:0/3794491929 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f84f80aee60 con 0x7f84f806ff50 2024-09-21T07:10:18.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.443+0000 7f84fea39640 1 -- 172.21.15.18:0/3794491929 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f84f80b4410 con 0x7f84f80af310 2024-09-21T07:10:18.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.444+0000 7f84fd236640 1 -- 172.21.15.18:0/3794491929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84f806ff50 msgr2=0x7f84f80ab9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.444+0000 7f84fd236640 1 --2- 172.21.15.18:0/3794491929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84f806ff50 0x7f84f80ab9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.444+0000 7f84fd236640 1 -- 172.21.15.18:0/3794491929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f816b430 msgr2=0x7f84f8164060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.449+0000 7f84fe238640 1 --2- 172.21.15.18:0/3794491929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f816b430 0x7f84f8164060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.449+0000 7f84fd236640 1 --2- 172.21.15.18:0/3794491929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f816b430 0x7f84f8164060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.449+0000 7f84fd236640 1 -- 172.21.15.18:0/3794491929 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f80aa4c0 con 0x7f84f80af310 2024-09-21T07:10:18.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.450+0000 7f84fd236640 1 --2- 172.21.15.18:0/3794491929 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f84f80af310 0x7f84f80ac660 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f84f80cda80 tx=0x7f84e800c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:18.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.450+0000 7f84fe238640 1 --2- 172.21.15.18:0/3794491929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f816b430 0x7f84f8164060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:18.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.450+0000 7f84ee7fc640 1 -- 172.21.15.18:0/3794491929 <== mon.2 v2:172.21.15.49:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8005480 con 0x7f84f80af310 2024-09-21T07:10:18.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.450+0000 7f84fea39640 1 -- 172.21.15.18:0/3794491929 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f80aa930 con 0x7f84f80af310 2024-09-21T07:10:18.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.451+0000 7f84fea39640 1 -- 172.21.15.18:0/3794491929 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f80aaef0 con 0x7f84f80af310 2024-09-21T07:10:18.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.442+0000 7f5e8a6b7640 1 -- 172.21.15.18:0/800507524 shutdown_connections 2024-09-21T07:10:18.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.442+0000 7f5e8a6b7640 1 -- 172.21.15.18:0/800507524 wait complete. 2024-09-21T07:10:18.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.446+0000 7f5e8a6b7640 1 Processor -- start 2024-09-21T07:10:18.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.446+0000 7f5e8a6b7640 1 -- start start 2024-09-21T07:10:18.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.448+0000 7f5e8a6b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e840ce430 0x7f5e840ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.449+0000 7f5e896b5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e840ce430 0x7f5e840ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.449+0000 7f5e896b5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e840ce430 0x7f5e840ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37714/0 (socket says 172.21.15.18:37714) 2024-09-21T07:10:18.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.449+0000 7f5e896b5640 1 -- 172.21.15.18:0/172566743 learned_addr learned my addr 172.21.15.18:0/172566743 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:18.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.449+0000 7f5e8a6b7640 1 --2- 172.21.15.18:0/172566743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e840cf9d0 0x7f5e840ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.449+0000 7f5e8a6b7640 1 --2- 172.21.15.18:0/172566743 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5e841664b0 0x7f5e841668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.449+0000 7f5e8a6b7640 1 -- 172.21.15.18:0/172566743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5e840b5bf0 con 0x7f5e840ce430 2024-09-21T07:10:18.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.449+0000 7f5e8a6b7640 1 -- 172.21.15.18:0/172566743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5e840b5a70 con 0x7f5e840cf9d0 2024-09-21T07:10:18.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.449+0000 7f5e8a6b7640 1 -- 172.21.15.18:0/172566743 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f5e840b5d70 con 0x7f5e841664b0 2024-09-21T07:10:18.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.449+0000 7f5e88eb4640 1 --2- 172.21.15.18:0/172566743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e840cf9d0 0x7f5e840ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.450+0000 7f5e896b5640 1 -- 172.21.15.18:0/172566743 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5e841664b0 msgr2=0x7f5e841668c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:10:18.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.450+0000 7f5e896b5640 1 --2- 172.21.15.18:0/172566743 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5e841664b0 0x7f5e841668c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.450+0000 7f5e896b5640 1 -- 172.21.15.18:0/172566743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e840cf9d0 msgr2=0x7f5e840ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.450+0000 7f5e896b5640 1 --2- 172.21.15.18:0/172566743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e840cf9d0 0x7f5e840ae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.450+0000 7f5e896b5640 1 -- 172.21.15.18:0/172566743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e840af220 con 0x7f5e840ce430 2024-09-21T07:10:18.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.450+0000 7f5e88eb4640 1 --2- 172.21.15.18:0/172566743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e840cf9d0 0x7f5e840ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:18.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.450+0000 7f5e896b5640 1 --2- 172.21.15.18:0/172566743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e840ce430 0x7f5e840ae1a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000b780 tx=0x7f5e8000bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:18.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.452+0000 7f5e79ffb640 1 -- 172.21.15.18:0/172566743 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80019070 con 0x7f5e840ce430 2024-09-21T07:10:18.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.453+0000 7f84ee7fc640 1 -- 172.21.15.18:0/3794491929 <== mon.2 v2:172.21.15.49:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84e80035f0 con 0x7f84f80af310 2024-09-21T07:10:18.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.453+0000 7f84ee7fc640 1 -- 172.21.15.18:0/3794491929 <== mon.2 v2:172.21.15.49:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8003a20 con 0x7f84f80af310 2024-09-21T07:10:18.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.453+0000 7f84ee7fc640 1 -- 172.21.15.18:0/3794491929 <== mon.2 v2:172.21.15.49:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f84e8003c40 con 0x7f84f80af310 2024-09-21T07:10:18.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.453+0000 7f84ee7fc640 1 -- 172.21.15.18:0/3794491929 <== mon.2 v2:172.21.15.49:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f84e80128b0 con 0x7f84f80af310 2024-09-21T07:10:18.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.455+0000 7f84e3fff640 1 -- 172.21.15.18:0/3794491929 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84d8005290 con 0x7f84f80af310 2024-09-21T07:10:18.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.452+0000 7f5e8a6b7640 1 -- 172.21.15.18:0/172566743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e84207410 con 0x7f5e840ce430 2024-09-21T07:10:18.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.453+0000 7f5e8a6b7640 1 -- 172.21.15.18:0/172566743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e842079d0 con 0x7f5e840ce430 2024-09-21T07:10:18.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.457+0000 7f5e79ffb640 1 -- 172.21.15.18:0/172566743 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e8000c830 con 0x7f5e840ce430 2024-09-21T07:10:18.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.457+0000 7f5e79ffb640 1 -- 172.21.15.18:0/172566743 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8000cc80 con 0x7f5e840ce430 2024-09-21T07:10:18.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.457+0000 7f5e79ffb640 1 -- 172.21.15.18:0/172566743 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5e8001c070 con 0x7f5e840ce430 2024-09-21T07:10:18.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.457+0000 7f5e79ffb640 1 -- 172.21.15.18:0/172566743 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5e80014930 con 0x7f5e840ce430 2024-09-21T07:10:18.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.457+0000 7f84ee7fc640 1 -- 172.21.15.18:0/3794491929 <== mon.2 v2:172.21.15.49:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f84e801b450 con 0x7f84f80af310 2024-09-21T07:10:18.470 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.468+0000 7f5e6f7fe640 1 -- 172.21.15.18:0/172566743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e8408c6c0 con 0x7f5e840ce430 2024-09-21T07:10:18.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.473+0000 7f5e79ffb640 1 -- 172.21.15.18:0/172566743 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5e80023070 con 0x7f5e840ce430 2024-09-21T07:10:18.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.519+0000 7f17f67fc640 1 -- 172.21.15.18:0/2606797867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f18040de2a0 con 0x7f1804005cb0 2024-09-21T07:10:18.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.520+0000 7f4de97fa640 1 -- 172.21.15.18:0/2207544182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f4de4005580 con 0x7f4dfc0e7000 2024-09-21T07:10:18.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.526+0000 7f1808ff9640 1 -- 172.21.15.18:0/2606797867 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f180c0bab10 con 0x7f1804005cb0 2024-09-21T07:10:18.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.532+0000 7f4deb7fe640 1 -- 172.21.15.18:0/2207544182 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v12)=0 v12) ==== 119+0+0 (secure 0 0 0) 0x7f4e040d1bb0 con 0x7f4dfc0e7000 2024-09-21T07:10:18.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.534+0000 7f17f67fc640 1 -- 172.21.15.18:0/2606797867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1804005cb0 msgr2=0x7f18040ddd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.534+0000 7f17f67fc640 1 --2- 172.21.15.18:0/2606797867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1804005cb0 0x7f18040ddd60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f180c06a370 tx=0x7f180c0adbd0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.535+0000 7f17f67fc640 1 -- 172.21.15.18:0/2606797867 shutdown_connections 2024-09-21T07:10:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.535+0000 7f17f67fc640 1 --2- 172.21.15.18:0/2606797867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f180401f490 0x7f1804178db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.535+0000 7f17f67fc640 1 --2- 172.21.15.18:0/2606797867 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1804009ba0 0x7f1804178870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.535+0000 7f17f67fc640 1 --2- 172.21.15.18:0/2606797867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1804005cb0 0x7f18040ddd60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.535+0000 7f17f67fc640 1 -- 172.21.15.18:0/2606797867 >> 172.21.15.18:0/2606797867 conn(0x7f1804051420 msgr2=0x7f1804038410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.535+0000 7f17f67fc640 1 -- 172.21.15.18:0/2606797867 shutdown_connections 2024-09-21T07:10:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.535+0000 7f17f67fc640 1 -- 172.21.15.18:0/2606797867 wait complete. 2024-09-21T07:10:18.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.546+0000 7f4de97fa640 1 -- 172.21.15.18:0/2207544182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dfc0e7000 msgr2=0x7f4dfc0ca9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.546+0000 7f4de97fa640 1 --2- 172.21.15.18:0/2207544182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dfc0e7000 0x7f4dfc0ca9e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e04075960 tx=0x7f4e040bd5d0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.546+0000 7f4de97fa640 1 -- 172.21.15.18:0/2207544182 shutdown_connections 2024-09-21T07:10:18.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.546+0000 7f4de97fa640 1 --2- 172.21.15.18:0/2207544182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dfc0e7410 0x7f4dfc0dcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.546+0000 7f4de97fa640 1 --2- 172.21.15.18:0/2207544182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dfc0e7000 0x7f4dfc0ca9e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.546+0000 7f4de97fa640 1 --2- 172.21.15.18:0/2207544182 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4dfc052360 0x7f4dfc032de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.546+0000 7f4de97fa640 1 -- 172.21.15.18:0/2207544182 >> 172.21.15.18:0/2207544182 conn(0x7f4dfc01d9a0 msgr2=0x7f4dfc00ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.546+0000 7f4de97fa640 1 -- 172.21.15.18:0/2207544182 shutdown_connections 2024-09-21T07:10:18.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.546+0000 7f4de97fa640 1 -- 172.21.15.18:0/2207544182 wait complete. 2024-09-21T07:10:18.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.551+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2337648955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39a806e340 msgr2=0x7f39a8070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.551+0000 7f39ae1e6640 1 --2- 172.21.15.18:0/2337648955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39a806e340 0x7f39a8070640 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f39a8073140 tx=0x7f39a002a950 comp rx=0 tx=0).stop 2024-09-21T07:10:18.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.552+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2337648955 shutdown_connections 2024-09-21T07:10:18.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.552+0000 7f39ae1e6640 1 --2- 172.21.15.18:0/2337648955 >> v2:172.21.15.49:3300/0 conn(0x7f39a80b4490 0x7f39a80b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.552+0000 7f39ae1e6640 1 --2- 172.21.15.18:0/2337648955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39a806e340 0x7f39a8070640 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.552+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2337648955 >> 172.21.15.18:0/2337648955 conn(0x7f39a80b3a40 msgr2=0x7f39a80d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.563+0000 7fa921941640 1 -- 172.21.15.18:0/3590299537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa914054750 msgr2=0x7fa914054b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.563+0000 7fa921941640 1 --2- 172.21.15.18:0/3590299537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa914054750 0x7fa914054b60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa914055890 tx=0x7fa90c02a4f0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.559+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2337648955 shutdown_connections 2024-09-21T07:10:18.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.559+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2337648955 wait complete. 2024-09-21T07:10:18.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.562+0000 7f39ae1e6640 1 Processor -- start 2024-09-21T07:10:18.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.562+0000 7f39ae1e6640 1 -- start start 2024-09-21T07:10:18.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.564+0000 7f39ae1e6640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f39a806e340 0x7f39a81545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.564+0000 7f39ae1e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39a80b4490 0x7f39a8154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.567+0000 7f39a6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39a80b4490 0x7f39a8154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.567+0000 7f39a6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39a80b4490 0x7f39a8154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37730/0 (socket says 172.21.15.18:37730) 2024-09-21T07:10:18.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.567+0000 7f39a77fe640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f39a806e340 0x7f39a81545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.567+0000 7f39a6ffd640 1 -- 172.21.15.18:0/2717864995 learned_addr learned my addr 172.21.15.18:0/2717864995 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:18.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.567+0000 7f39ae1e6640 1 --2- 172.21.15.18:0/2717864995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39a815c810 0x7f39a80ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.567+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2717864995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f39a806d0d0 con 0x7f39a80b4490 2024-09-21T07:10:18.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.567+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2717864995 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f39a806cf50 con 0x7f39a815c810 2024-09-21T07:10:18.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.567+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2717864995 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f39a806d250 con 0x7f39a806e340 2024-09-21T07:10:18.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.568+0000 7f39a6ffd640 1 -- 172.21.15.18:0/2717864995 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f39a806e340 msgr2=0x7f39a81545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.568+0000 7f39a7fff640 1 --2- 172.21.15.18:0/2717864995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39a815c810 0x7f39a80ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.568+0000 7f39a6ffd640 1 --2- 172.21.15.18:0/2717864995 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f39a806e340 0x7f39a81545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.568+0000 7f39a6ffd640 1 -- 172.21.15.18:0/2717864995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39a815c810 msgr2=0x7f39a80ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.568+0000 7f39a6ffd640 1 --2- 172.21.15.18:0/2717864995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39a815c810 0x7f39a80ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.568+0000 7f39a6ffd640 1 -- 172.21.15.18:0/2717864995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a8159e90 con 0x7f39a80b4490 2024-09-21T07:10:18.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.569+0000 7f39a77fe640 1 --2- 172.21.15.18:0/2717864995 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f39a806e340 0x7f39a81545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:18.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.569+0000 7f39a6ffd640 1 --2- 172.21.15.18:0/2717864995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39a80b4490 0x7f39a8154b00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f39a0033040 tx=0x7f39a0003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:18.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.570+0000 7f398ffff640 1 -- 172.21.15.18:0/2717864995 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a0031830 con 0x7f39a80b4490 2024-09-21T07:10:18.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.570+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2717864995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a815a580 con 0x7f39a80b4490 2024-09-21T07:10:18.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.570+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2717864995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a80ab7f0 con 0x7f39a80b4490 2024-09-21T07:10:18.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.572+0000 7f398ffff640 1 -- 172.21.15.18:0/2717864995 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39a0040030 con 0x7f39a80b4490 2024-09-21T07:10:18.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.572+0000 7f398ffff640 1 -- 172.21.15.18:0/2717864995 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a0031d40 con 0x7f39a80b4490 2024-09-21T07:10:18.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.572+0000 7f398ffff640 1 -- 172.21.15.18:0/2717864995 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f39a0045420 con 0x7f39a80b4490 2024-09-21T07:10:18.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.572+0000 7f398ffff640 1 -- 172.21.15.18:0/2717864995 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f39a003c700 con 0x7f39a80b4490 2024-09-21T07:10:18.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.574+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2717864995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a806d6e0 con 0x7f39a80b4490 2024-09-21T07:10:18.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.578+0000 7f398ffff640 1 -- 172.21.15.18:0/2717864995 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f39a004a030 con 0x7f39a80b4490 2024-09-21T07:10:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.563+0000 7fa921941640 1 -- 172.21.15.18:0/3590299537 shutdown_connections 2024-09-21T07:10:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.563+0000 7fa921941640 1 --2- 172.21.15.18:0/3590299537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa914054750 0x7fa914054b60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.563+0000 7fa921941640 1 --2- 172.21.15.18:0/3590299537 >> v2:172.21.15.18:3300/0 conn(0x7fa914052390 0x7fa9140e72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.563+0000 7fa921941640 1 -- 172.21.15.18:0/3590299537 >> 172.21.15.18:0/3590299537 conn(0x7fa91401d9d0 msgr2=0x7fa914039690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.563+0000 7fa921941640 1 -- 172.21.15.18:0/3590299537 shutdown_connections 2024-09-21T07:10:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.564+0000 7fa921941640 1 -- 172.21.15.18:0/3590299537 wait complete. 2024-09-21T07:10:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.566+0000 7fa921941640 1 Processor -- start 2024-09-21T07:10:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.567+0000 7fa921941640 1 -- start start 2024-09-21T07:10:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.569+0000 7fa921941640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa914051660 0x7fa9140e5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.569+0000 7fa921941640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa914052390 0x7fa9140c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.569+0000 7fa921941640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa914054750 0x7fa91404ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.569+0000 7fa921941640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9140527a0 con 0x7fa914052390 2024-09-21T07:10:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.569+0000 7fa921941640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa914033ef0 con 0x7fa914054750 2024-09-21T07:10:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.569+0000 7fa921941640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fa914052920 con 0x7fa914051660 2024-09-21T07:10:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.569+0000 7fa91b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa914054750 0x7fa91404ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.577+0000 7fa91b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa914054750 0x7fa91404ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:56544/0 (socket says 172.21.15.18:56544) 2024-09-21T07:10:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.578+0000 7fa91b7fe640 1 -- 172.21.15.18:0/2501276547 learned_addr learned my addr 172.21.15.18:0/2501276547 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.579+0000 7fa91a7fc640 1 --2- 172.21.15.18:0/2501276547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa914052390 0x7fa9140c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.579+0000 7fa91a7fc640 1 -- 172.21.15.18:0/2501276547 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa914051660 msgr2=0x7fa9140e5c70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:10:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.579+0000 7fa91a7fc640 1 --2- 172.21.15.18:0/2501276547 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa914051660 0x7fa9140e5c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.579+0000 7fa91a7fc640 1 -- 172.21.15.18:0/2501276547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa914054750 msgr2=0x7fa91404ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.579+0000 7fa91a7fc640 1 --2- 172.21.15.18:0/2501276547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa914054750 0x7fa91404ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.579+0000 7fa91a7fc640 1 -- 172.21.15.18:0/2501276547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9140c5880 con 0x7fa914052390 2024-09-21T07:10:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.580+0000 7fa91a7fc640 1 --2- 172.21.15.18:0/2501276547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa914052390 0x7fa9140c2980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa91000b750 tx=0x7fa91000bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.581+0000 7fa903fff640 1 -- 172.21.15.18:0/2501276547 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910019070 con 0x7fa914052390 2024-09-21T07:10:18.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.582+0000 7fe3f4f69640 1 -- 172.21.15.18:0/3524843386 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe3f00743c0 msgr2=0x7fe3f00747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.582+0000 7fe3f4f69640 1 --2- 172.21.15.18:0/3524843386 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe3f00743c0 0x7fe3f00747d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009860 tx=0x7fe3e002a510 comp rx=0 tx=0).stop 2024-09-21T07:10:18.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.582+0000 7fe3f4f69640 1 -- 172.21.15.18:0/3524843386 shutdown_connections 2024-09-21T07:10:18.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.582+0000 7fe3f4f69640 1 --2- 172.21.15.18:0/3524843386 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe3f00743c0 0x7fe3f00747d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.582+0000 7fe3f4f69640 1 -- 172.21.15.18:0/3524843386 >> 172.21.15.18:0/3524843386 conn(0x7fe3f00ccd30 msgr2=0x7fe3f00cd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.583+0000 7f2b13fff640 1 -- 172.21.15.18:0/4215371083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f2b30072170 con 0x7f2b3006ff20 2024-09-21T07:10:18.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.582+0000 7fe3f4f69640 1 -- 172.21.15.18:0/3524843386 shutdown_connections 2024-09-21T07:10:18.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.587+0000 7f19255e6640 1 -- 172.21.15.18:0/3444132600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19200b5670 msgr2=0x7f19200b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.582+0000 7fe3f4f69640 1 -- 172.21.15.18:0/3524843386 wait complete. 2024-09-21T07:10:18.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.585+0000 7fe3f4f69640 1 Processor -- start 2024-09-21T07:10:18.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.581+0000 7fa921941640 1 -- 172.21.15.18:0/2501276547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9140e61b0 con 0x7fa914052390 2024-09-21T07:10:18.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.581+0000 7fa921941640 1 -- 172.21.15.18:0/2501276547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa91404cde0 con 0x7fa914052390 2024-09-21T07:10:18.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.589+0000 7f5ee265c640 1 -- 172.21.15.18:0/2125768692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5edc0cf9d0 msgr2=0x7f5edc0af950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.589+0000 7f5ee265c640 1 --2- 172.21.15.18:0/2125768692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5edc0cf9d0 0x7f5edc0af950 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009830 tx=0x7f5ed802a380 comp rx=0 tx=0).stop 2024-09-21T07:10:18.591 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.589+0000 7f5ee265c640 1 -- 172.21.15.18:0/2125768692 shutdown_connections 2024-09-21T07:10:18.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.589+0000 7f19255e6640 1 --2- 172.21.15.18:0/3444132600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19200b5670 0x7f19200b4490 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1920073110 tx=0x7f191802a9c0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.589+0000 7f5ee265c640 1 --2- 172.21.15.18:0/2125768692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5edc0cf9d0 0x7f5edc0af950 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009830 tx=0x7f5ed802a380 comp rx=0 tx=0).stop 2024-09-21T07:10:18.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.589+0000 7f5ee265c640 1 -- 172.21.15.18:0/2125768692 >> 172.21.15.18:0/2125768692 conn(0x7f5edc0b2030 msgr2=0x7f5edc0b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.587+0000 7fa903fff640 1 -- 172.21.15.18:0/2501276547 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa91000c810 con 0x7fa914052390 2024-09-21T07:10:18.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.587+0000 7fa903fff640 1 -- 172.21.15.18:0/2501276547 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91000cc40 con 0x7fa914052390 2024-09-21T07:10:18.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.587+0000 7fa903fff640 1 -- 172.21.15.18:0/2501276547 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa91001c070 con 0x7fa914052390 2024-09-21T07:10:18.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.587+0000 7fa903fff640 1 -- 172.21.15.18:0/2501276547 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa910014850 con 0x7fa914052390 2024-09-21T07:10:18.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.587+0000 7fe3f4f69640 1 -- start start 2024-09-21T07:10:18.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.590+0000 7f2b227fc640 1 -- 172.21.15.18:0/4215371083 <== mon.1 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7f2b2801a060 con 0x7f2b3006ff20 2024-09-21T07:10:18.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.590+0000 7fe3f4f69640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f00743c0 0x7fe3f0146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.590+0000 7fe3f4f69640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe3f00cf2c0 0x7fe3f0154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.590+0000 7fe3f4f69640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3f00cfde0 0x7fe3f015be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.590+0000 7fe3f4f69640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f0162ec0 con 0x7fe3f00743c0 2024-09-21T07:10:18.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.590+0000 7fe3f4f69640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f00ccb30 con 0x7fe3f00cfde0 2024-09-21T07:10:18.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.590+0000 7fe3f4f69640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fe3f0163040 con 0x7fe3f00cf2c0 2024-09-21T07:10:18.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.591+0000 7fa921941640 1 -- 172.21.15.18:0/2501276547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8fc005290 con 0x7fa914052390 2024-09-21T07:10:18.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.591+0000 7fe3eed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3f00cfde0 0x7fe3f015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.591+0000 7fe3eed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3f00cfde0 0x7fe3f015be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:56556/0 (socket says 172.21.15.18:56556) 2024-09-21T07:10:18.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.591+0000 7fe3eed9d640 1 -- 172.21.15.18:0/4163342625 learned_addr learned my addr 172.21.15.18:0/4163342625 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:18.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.591+0000 7fe3edd9b640 1 --2- 172.21.15.18:0/4163342625 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe3f00cf2c0 0x7fe3f0154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.591+0000 7f5ee265c640 1 -- 172.21.15.18:0/2125768692 shutdown_connections 2024-09-21T07:10:18.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.591+0000 7fe3ee59c640 1 --2- 172.21.15.18:0/4163342625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f00743c0 0x7fe3f0146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.591+0000 7fe3edd9b640 1 -- 172.21.15.18:0/4163342625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3f00cfde0 msgr2=0x7fe3f015be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.592+0000 7f19255e6640 1 -- 172.21.15.18:0/3444132600 shutdown_connections 2024-09-21T07:10:18.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.592+0000 7f19255e6640 1 --2- 172.21.15.18:0/3444132600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19200b5670 0x7f19200b4490 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.592+0000 7f19255e6640 1 --2- 172.21.15.18:0/3444132600 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f19200b5260 0x7f1920070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.592+0000 7f19255e6640 1 --2- 172.21.15.18:0/3444132600 >> v2:172.21.15.18:3300/0 conn(0x7f192015c810 0x7f192006e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.592+0000 7f19255e6640 1 -- 172.21.15.18:0/3444132600 >> 172.21.15.18:0/3444132600 conn(0x7f19200b3a40 msgr2=0x7f19200d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.592+0000 7f2b13fff640 1 -- 172.21.15.18:0/4215371083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b3006ff20 msgr2=0x7f2b300cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.592+0000 7f2b13fff640 1 --2- 172.21.15.18:0/4215371083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b3006ff20 0x7f2b300cd430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2b300cef60 tx=0x7f2b2800a7a0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.591+0000 7fe3edd9b640 1 --2- 172.21.15.18:0/4163342625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3f00cfde0 0x7fe3f015be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.591+0000 7fe3edd9b640 1 -- 172.21.15.18:0/4163342625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f00743c0 msgr2=0x7fe3f0146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.591+0000 7fe3edd9b640 1 --2- 172.21.15.18:0/4163342625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f00743c0 0x7fe3f0146650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.591+0000 7fe3edd9b640 1 -- 172.21.15.18:0/4163342625 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f015f450 con 0x7fe3f00cf2c0 2024-09-21T07:10:18.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.592+0000 7fe3eed9d640 1 --2- 172.21.15.18:0/4163342625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3f00cfde0 0x7fe3f015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:18.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.592+0000 7f2b13fff640 1 -- 172.21.15.18:0/4215371083 shutdown_connections 2024-09-21T07:10:18.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.592+0000 7f2b13fff640 1 --2- 172.21.15.18:0/4215371083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b3006ff20 0x7f2b300cd430 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.592+0000 7f2b13fff640 1 --2- 172.21.15.18:0/4215371083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b301fd010 0x7f2b3006f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.592+0000 7f2b13fff640 1 --2- 172.21.15.18:0/4215371083 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2b1c004800 0x7f2b301fdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.592+0000 7f2b13fff640 1 -- 172.21.15.18:0/4215371083 >> 172.21.15.18:0/4215371083 conn(0x7f2b30073d80 msgr2=0x7f2b300ca270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.592+0000 7f19255e6640 1 -- 172.21.15.18:0/3444132600 shutdown_connections 2024-09-21T07:10:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.593+0000 7f19255e6640 1 -- 172.21.15.18:0/3444132600 wait complete. 2024-09-21T07:10:18.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.593+0000 7f2b13fff640 1 -- 172.21.15.18:0/4215371083 shutdown_connections 2024-09-21T07:10:18.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.591+0000 7f5ee265c640 1 -- 172.21.15.18:0/2125768692 wait complete. 2024-09-21T07:10:18.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.594+0000 7f2b13fff640 1 -- 172.21.15.18:0/4215371083 wait complete. 2024-09-21T07:10:18.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.594+0000 7f5ee265c640 1 Processor -- start 2024-09-21T07:10:18.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.593+0000 7fb40d151640 1 -- 172.21.15.18:0/541248488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb408069450 msgr2=0x7fb4080af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.593+0000 7fb40d151640 1 --2- 172.21.15.18:0/541248488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb408069450 0x7fb4080af510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb400005fd0 tx=0x7fb40002aae0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.594+0000 7fb40d151640 1 -- 172.21.15.18:0/541248488 shutdown_connections 2024-09-21T07:10:18.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.594+0000 7fb40d151640 1 --2- 172.21.15.18:0/541248488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb408069450 0x7fb4080af510 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.594+0000 7fb40d151640 1 --2- 172.21.15.18:0/541248488 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb4080b0460 0x7fb40815f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.594+0000 7fb40d151640 1 -- 172.21.15.18:0/541248488 >> 172.21.15.18:0/541248488 conn(0x7fb4080b3a40 msgr2=0x7fb4080d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.594+0000 7fb40d151640 1 -- 172.21.15.18:0/541248488 shutdown_connections 2024-09-21T07:10:18.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.594+0000 7fb40d151640 1 -- 172.21.15.18:0/541248488 wait complete. 2024-09-21T07:10:18.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.596+0000 7fa903fff640 1 -- 172.21.15.18:0/2501276547 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa910023070 con 0x7fa914052390 2024-09-21T07:10:18.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.594+0000 7f5ee265c640 1 -- start start 2024-09-21T07:10:18.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.597+0000 7f5ee265c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5edc08c6c0 0x7f5edc2178a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.597+0000 7f5ee265c640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5edc0ce430 0x7f5edc213880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.597+0000 7f5ee265c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5edc08bd50 0x7f5edc0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.597+0000 7f5ee265c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5edc0ce840 con 0x7f5edc08c6c0 2024-09-21T07:10:18.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.597+0000 7f5ee265c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5edc0b61b0 con 0x7f5edc08bd50 2024-09-21T07:10:18.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.597+0000 7f5ee265c640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f5edc0ce9c0 con 0x7f5edc0ce430 2024-09-21T07:10:18.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.596+0000 7f19255e6640 1 Processor -- start 2024-09-21T07:10:18.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.596+0000 7f19255e6640 1 -- start start 2024-09-21T07:10:18.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.597+0000 7f5ee165a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5edc08c6c0 0x7f5edc2178a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.597+0000 7f5ee165a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5edc08c6c0 0x7f5edc2178a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37788/0 (socket says 172.21.15.18:37788) 2024-09-21T07:10:18.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.597+0000 7f5ee165a640 1 -- 172.21.15.18:0/1878449338 learned_addr learned my addr 172.21.15.18:0/1878449338 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:18.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.597+0000 7fb40d151640 1 Processor -- start 2024-09-21T07:10:18.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.597+0000 7fb40d151640 1 -- start start 2024-09-21T07:10:18.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.598+0000 7f5ee165a640 1 -- 172.21.15.18:0/1878449338 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5edc0ce430 msgr2=0x7f5edc213880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:10:18.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.598+0000 7f5ee165a640 1 --2- 172.21.15.18:0/1878449338 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5edc0ce430 0x7f5edc213880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.598+0000 7f5ee165a640 1 -- 172.21.15.18:0/1878449338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5edc08bd50 msgr2=0x7f5edc0c52a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:10:18.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.598+0000 7f5ee165a640 1 --2- 172.21.15.18:0/1878449338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5edc08bd50 0x7f5edc0c52a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.598+0000 7f5ee165a640 1 -- 172.21.15.18:0/1878449338 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5edc214340 con 0x7f5edc08c6c0 2024-09-21T07:10:18.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.598+0000 7f5ee165a640 1 --2- 172.21.15.18:0/1878449338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5edc08c6c0 0x7f5edc2178a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5ed802a970 tx=0x7f5ed80308e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:18.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.599+0000 7f5ed1ffb640 1 -- 172.21.15.18:0/1878449338 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8037050 con 0x7f5edc08c6c0 2024-09-21T07:10:18.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.599+0000 7f5ee265c640 1 -- 172.21.15.18:0/1878449338 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5edc214620 con 0x7f5edc08c6c0 2024-09-21T07:10:18.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.599+0000 7f5ee265c640 1 -- 172.21.15.18:0/1878449338 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5edc213dc0 con 0x7f5edc08c6c0 2024-09-21T07:10:18.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.599+0000 7f5ed1ffb640 1 -- 172.21.15.18:0/1878449338 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ed8038040 con 0x7f5edc08c6c0 2024-09-21T07:10:18.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.599+0000 7f5ed1ffb640 1 -- 172.21.15.18:0/1878449338 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8005020 con 0x7f5edc08c6c0 2024-09-21T07:10:18.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.598+0000 7fe3edd9b640 1 --2- 172.21.15.18:0/4163342625 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe3f00cf2c0 0x7fe3f0154e50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00ce240 tx=0x7fe3e400c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:18.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fe3deffd640 1 -- 172.21.15.18:0/4163342625 <== mon.2 v2:172.21.15.49:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4011790 con 0x7fe3f00cf2c0 2024-09-21T07:10:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.599+0000 7fb40d151640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb4080b0460 0x7fb40814daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.599+0000 7fb40d151640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4080b4490 0x7fb408158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fb406d9d640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb4080b0460 0x7fb40814daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fb40659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4080b4490 0x7fb408158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fb40659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4080b4490 0x7fb408158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37798/0 (socket says 172.21.15.18:37798) 2024-09-21T07:10:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fb406d9d640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb4080b0460 0x7fb40814daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.18:41574/0 (socket says 172.21.15.18:41574) 2024-09-21T07:10:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fb40659c640 1 -- 172.21.15.18:0/2925660161 learned_addr learned my addr 172.21.15.18:0/2925660161 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fb40d151640 1 --2- 172.21.15.18:0/2925660161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4081569b0 0x7fb408158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fb40d151640 1 -- 172.21.15.18:0/2925660161 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb4080aff20 con 0x7fb4080b4490 2024-09-21T07:10:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fb40d151640 1 -- 172.21.15.18:0/2925660161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb4080afda0 con 0x7fb4081569b0 2024-09-21T07:10:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fb40d151640 1 -- 172.21.15.18:0/2925660161 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fb4080b00a0 con 0x7fb4080b0460 2024-09-21T07:10:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fb40759e640 1 --2- 172.21.15.18:0/2925660161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4081569b0 0x7fb408158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fb40759e640 1 -- 172.21.15.18:0/2925660161 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb4080b0460 msgr2=0x7fb40814daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fb40759e640 1 --2- 172.21.15.18:0/2925660161 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb4080b0460 0x7fb40814daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fb40759e640 1 -- 172.21.15.18:0/2925660161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4080b4490 msgr2=0x7fb408158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fb40759e640 1 --2- 172.21.15.18:0/2925660161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4080b4490 0x7fb408158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7fb40759e640 1 -- 172.21.15.18:0/2925660161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb408150c00 con 0x7fb4081569b0 2024-09-21T07:10:18.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.601+0000 7fe3f4f69640 1 -- 172.21.15.18:0/4163342625 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f015f6f0 con 0x7fe3f00cf2c0 2024-09-21T07:10:18.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.601+0000 7fe3f4f69640 1 -- 172.21.15.18:0/4163342625 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f015fcb0 con 0x7fe3f00cf2c0 2024-09-21T07:10:18.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.601+0000 7fe3deffd640 1 -- 172.21.15.18:0/4163342625 <== mon.2 v2:172.21.15.49:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3e4017070 con 0x7fe3f00cf2c0 2024-09-21T07:10:18.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7f5ed1ffb640 1 -- 172.21.15.18:0/1878449338 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ed8045020 con 0x7f5edc08c6c0 2024-09-21T07:10:18.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.600+0000 7f5ed1ffb640 1 -- 172.21.15.18:0/1878449338 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5ed8004830 con 0x7f5edc08c6c0 2024-09-21T07:10:18.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.601+0000 7fe3deffd640 1 -- 172.21.15.18:0/4163342625 <== mon.2 v2:172.21.15.49:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4011cc0 con 0x7fe3f00cf2c0 2024-09-21T07:10:18.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.603+0000 7fe3deffd640 1 -- 172.21.15.18:0/4163342625 <== mon.2 v2:172.21.15.49:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe3e4005020 con 0x7fe3f00cf2c0 2024-09-21T07:10:18.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.604+0000 7fe3deffd640 1 -- 172.21.15.18:0/4163342625 <== mon.2 v2:172.21.15.49:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe3e401c460 con 0x7fe3f00cf2c0 2024-09-21T07:10:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.604+0000 7fb40659c640 1 --2- 172.21.15.18:0/2925660161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4080b4490 0x7fb408158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.604+0000 7fb406d9d640 1 --2- 172.21.15.18:0/2925660161 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb4080b0460 0x7fb40814daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.605+0000 7fb40759e640 1 --2- 172.21.15.18:0/2925660161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4081569b0 0x7fb408158bb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb4080746d0 tx=0x7fb400004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.606+0000 7fb3ef7fe640 1 -- 172.21.15.18:0/2925660161 <== mon.1 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400044070 con 0x7fb4081569b0 2024-09-21T07:10:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.606+0000 7fb3ef7fe640 1 -- 172.21.15.18:0/2925660161 <== mon.1 v2:172.21.15.49:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb40002cec0 con 0x7fb4081569b0 2024-09-21T07:10:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.606+0000 7fb3ef7fe640 1 -- 172.21.15.18:0/2925660161 <== mon.1 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40002d890 con 0x7fb4081569b0 2024-09-21T07:10:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.608+0000 7fe3f4f69640 1 -- 172.21.15.18:0/4163342625 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d4005290 con 0x7fe3f00cf2c0 2024-09-21T07:10:18.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.602+0000 7f19255e6640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f19200b5260 0x7f192014e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.602+0000 7f19255e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19200b5670 0x7f1920151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.602+0000 7f19255e6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f192015c810 0x7f192015a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.602+0000 7f19255e6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f192006cec0 con 0x7f19200b5670 2024-09-21T07:10:18.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.602+0000 7f19255e6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f192006cd40 con 0x7f192015c810 2024-09-21T07:10:18.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.602+0000 7f19255e6640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f192006d040 con 0x7f19200b5260 2024-09-21T07:10:18.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.604+0000 7f191effd640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f19200b5260 0x7f192014e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.604+0000 7f191effd640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f19200b5260 0x7f192014e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.18:41582/0 (socket says 172.21.15.18:41582) 2024-09-21T07:10:18.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.604+0000 7f191effd640 1 -- 172.21.15.18:0/1226938298 learned_addr learned my addr 172.21.15.18:0/1226938298 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:18.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.604+0000 7f191f7fe640 1 --2- 172.21.15.18:0/1226938298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f192015c810 0x7f192015a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.604+0000 7f191e7fc640 1 --2- 172.21.15.18:0/1226938298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19200b5670 0x7f1920151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.605+0000 7f191effd640 1 -- 172.21.15.18:0/1226938298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f192015c810 msgr2=0x7f192015a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.605+0000 7f191effd640 1 --2- 172.21.15.18:0/1226938298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f192015c810 0x7f192015a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.605+0000 7f191effd640 1 -- 172.21.15.18:0/1226938298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19200b5670 msgr2=0x7f1920151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.605+0000 7f191effd640 1 --2- 172.21.15.18:0/1226938298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19200b5670 0x7f1920151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.605+0000 7f191effd640 1 -- 172.21.15.18:0/1226938298 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19200ad100 con 0x7f19200b5260 2024-09-21T07:10:18.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.605+0000 7f191effd640 1 --2- 172.21.15.18:0/1226938298 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f19200b5260 0x7f192014e2c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f191400b410 tx=0x7f191400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:18.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.605+0000 7f19077fe640 1 -- 172.21.15.18:0/1226938298 <== mon.2 v2:172.21.15.49:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914015020 con 0x7f19200b5260 2024-09-21T07:10:18.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.605+0000 7f19077fe640 1 -- 172.21.15.18:0/1226938298 <== mon.2 v2:172.21.15.49:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1914011920 con 0x7f19200b5260 2024-09-21T07:10:18.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.605+0000 7f19077fe640 1 -- 172.21.15.18:0/1226938298 <== mon.2 v2:172.21.15.49:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914011d70 con 0x7f19200b5260 2024-09-21T07:10:18.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.605+0000 7f19255e6640 1 -- 172.21.15.18:0/1226938298 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19201554d0 con 0x7f19200b5260 2024-09-21T07:10:18.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.606+0000 7f19077fe640 1 -- 172.21.15.18:0/1226938298 <== mon.2 v2:172.21.15.49:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1914018020 con 0x7f19200b5260 2024-09-21T07:10:18.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.606+0000 7f19255e6640 1 -- 172.21.15.18:0/1226938298 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1920155a90 con 0x7f19200b5260 2024-09-21T07:10:18.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.611+0000 7f5ee265c640 1 -- 172.21.15.18:0/1878449338 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ebc005290 con 0x7f5edc08c6c0 2024-09-21T07:10:18.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.613+0000 7f19255e6640 1 -- 172.21.15.18:0/1226938298 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19201552c0 con 0x7f19200b5260 2024-09-21T07:10:18.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.617+0000 7f19077fe640 1 -- 172.21.15.18:0/1226938298 <== mon.2 v2:172.21.15.49:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f19140193b0 con 0x7f19200b5260 2024-09-21T07:10:18.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.617+0000 7fe3deffd640 1 -- 172.21.15.18:0/4163342625 <== mon.2 v2:172.21.15.49:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe3e4021020 con 0x7fe3f00cf2c0 2024-09-21T07:10:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.617+0000 7f5ed1ffb640 1 -- 172.21.15.18:0/1878449338 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5ed80051c0 con 0x7f5edc08c6c0 2024-09-21T07:10:18.621 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.621 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.617+0000 7fb40d151640 1 -- 172.21.15.18:0/2925660161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb408202480 con 0x7fb4081569b0 2024-09-21T07:10:18.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.617+0000 7fb40d151640 1 -- 172.21.15.18:0/2925660161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb408202a40 con 0x7fb4081569b0 2024-09-21T07:10:18.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.619+0000 7f19077fe640 1 -- 172.21.15.18:0/1226938298 <== mon.2 v2:172.21.15.49:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f191401f020 con 0x7f19200b5260 2024-09-21T07:10:18.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.619+0000 7fb3ef7fe640 1 -- 172.21.15.18:0/2925660161 <== mon.1 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb40002da30 con 0x7fb4081569b0 2024-09-21T07:10:18.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.619+0000 7fb3ef7fe640 1 -- 172.21.15.18:0/2925660161 <== mon.1 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb4000365d0 con 0x7fb4081569b0 2024-09-21T07:10:18.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.628+0000 7fb40d151640 1 -- 172.21.15.18:0/2925660161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4080af510 con 0x7fb4081569b0 2024-09-21T07:10:18.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.634+0000 7fb3ef7fe640 1 -- 172.21.15.18:0/2925660161 <== mon.1 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb40004d020 con 0x7fb4081569b0 2024-09-21T07:10:18.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.639+0000 7fdca58f2640 1 -- 172.21.15.18:0/1857008535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fdc80005580 con 0x7fdca00b20e0 2024-09-21T07:10:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.641+0000 7f84e3fff640 1 -- 172.21.15.18:0/3794491929 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f84d8005580 con 0x7f84f80af310 2024-09-21T07:10:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.644+0000 7fdc87fff640 1 -- 172.21.15.18:0/1857008535 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7fdca00b2a30 con 0x7fdca00b20e0 2024-09-21T07:10:18.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.648+0000 7f84ee7fc640 1 -- 172.21.15.18:0/3794491929 <== mon.2 v2:172.21.15.49:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) ==== 120+0+0 (secure 0 0 0) 0x7f84e8012b00 con 0x7f84f80af310 2024-09-21T07:10:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.649+0000 7fdc85ffb640 1 -- 172.21.15.18:0/1857008535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca00b20e0 msgr2=0x7fdca00b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.649+0000 7fdc85ffb640 1 --2- 172.21.15.18:0/1857008535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca00b20e0 0x7fdca00b24f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400d950 tx=0x7fdc9400de10 comp rx=0 tx=0).stop 2024-09-21T07:10:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.649+0000 7fdc85ffb640 1 -- 172.21.15.18:0/1857008535 shutdown_connections 2024-09-21T07:10:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.649+0000 7fdc85ffb640 1 --2- 172.21.15.18:0/1857008535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca00b20e0 0x7fdca00b24f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.649+0000 7fdc85ffb640 1 --2- 172.21.15.18:0/1857008535 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdca0155870 0x7fdca0143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.649+0000 7fdc85ffb640 1 --2- 172.21.15.18:0/1857008535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca006e230 0x7fdca0156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.649+0000 7fdc85ffb640 1 -- 172.21.15.18:0/1857008535 >> 172.21.15.18:0/1857008535 conn(0x7fdca00d1830 msgr2=0x7fdca00732d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.649+0000 7fdc85ffb640 1 -- 172.21.15.18:0/1857008535 shutdown_connections 2024-09-21T07:10:18.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.649+0000 7fdc85ffb640 1 -- 172.21.15.18:0/1857008535 wait complete. 2024-09-21T07:10:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.653+0000 7f84fea39640 1 -- 172.21.15.18:0/3794491929 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f84f80af310 msgr2=0x7f84f80ac660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.653+0000 7f84fea39640 1 --2- 172.21.15.18:0/3794491929 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f84f80af310 0x7f84f80ac660 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f84f80cda80 tx=0x7f84e800c960 comp rx=0 tx=0).stop 2024-09-21T07:10:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.653+0000 7f84fea39640 1 -- 172.21.15.18:0/3794491929 shutdown_connections 2024-09-21T07:10:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.653+0000 7f84fea39640 1 --2- 172.21.15.18:0/3794491929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84f816b430 0x7f84f8164060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.653+0000 7f84fea39640 1 --2- 172.21.15.18:0/3794491929 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f84f80af310 0x7f84f80ac660 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.653+0000 7f84fea39640 1 --2- 172.21.15.18:0/3794491929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84f806ff50 0x7f84f80ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.653+0000 7f84fea39640 1 -- 172.21.15.18:0/3794491929 >> 172.21.15.18:0/3794491929 conn(0x7f84f80b2030 msgr2=0x7f84f80b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.653+0000 7f84fea39640 1 -- 172.21.15.18:0/3794491929 shutdown_connections 2024-09-21T07:10:18.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.653+0000 7f84fea39640 1 -- 172.21.15.18:0/3794491929 wait complete. 2024-09-21T07:10:18.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.661+0000 7f5e6f7fe640 1 -- 172.21.15.18:0/172566743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f5e840701f0 con 0x7f5e840ce430 2024-09-21T07:10:18.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.668+0000 7efee4ff9640 1 -- 172.21.15.18:0/1507711165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7efef80b6270 con 0x7efef80ce430 2024-09-21T07:10:18.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.670+0000 7f5e79ffb640 1 -- 172.21.15.18:0/172566743 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v16)=0 v16) ==== 119+0+0 (secure 0 0 0) 0x7f5e80014c60 con 0x7f5e840ce430 2024-09-21T07:10:18.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.676+0000 7f5e6f7fe640 1 -- 172.21.15.18:0/172566743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e840ce430 msgr2=0x7f5e840ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.676+0000 7f5e6f7fe640 1 --2- 172.21.15.18:0/172566743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e840ce430 0x7f5e840ae1a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000b780 tx=0x7f5e8000bc40 comp rx=0 tx=0).stop 2024-09-21T07:10:18.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.676+0000 7f5e6f7fe640 1 -- 172.21.15.18:0/172566743 shutdown_connections 2024-09-21T07:10:18.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.676+0000 7f5e6f7fe640 1 --2- 172.21.15.18:0/172566743 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5e841664b0 0x7f5e841668c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.676+0000 7f5e6f7fe640 1 --2- 172.21.15.18:0/172566743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e840cf9d0 0x7f5e840ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.676+0000 7f5e6f7fe640 1 --2- 172.21.15.18:0/172566743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e840ce430 0x7f5e840ae1a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.676+0000 7f5e6f7fe640 1 -- 172.21.15.18:0/172566743 >> 172.21.15.18:0/172566743 conn(0x7f5e840b2030 msgr2=0x7f5e8406f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.676+0000 7f5e6f7fe640 1 -- 172.21.15.18:0/172566743 shutdown_connections 2024-09-21T07:10:18.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.676+0000 7f5e6f7fe640 1 -- 172.21.15.18:0/172566743 wait complete. 2024-09-21T07:10:18.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.676+0000 7efee6ffd640 1 -- 172.21.15.18:0/1507711165 <== mon.1 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7efee8011590 con 0x7efef80ce430 2024-09-21T07:10:18.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.678+0000 7efee4ff9640 1 -- 172.21.15.18:0/1507711165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efef80ce430 msgr2=0x7efef81fe390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.678+0000 7efee4ff9640 1 --2- 172.21.15.18:0/1507711165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efef80ce430 0x7efef81fe390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efee800c3f0 tx=0x7efee800c8b0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.678+0000 7efee4ff9640 1 -- 172.21.15.18:0/1507711165 shutdown_connections 2024-09-21T07:10:18.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.678+0000 7efee4ff9640 1 --2- 172.21.15.18:0/1507711165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efef81fe8d0 0x7efef8073890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.678+0000 7efee4ff9640 1 --2- 172.21.15.18:0/1507711165 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7efef80cf9d0 0x7efef8073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.678+0000 7efee4ff9640 1 --2- 172.21.15.18:0/1507711165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efef80ce430 0x7efef81fe390 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.678+0000 7efee4ff9640 1 -- 172.21.15.18:0/1507711165 >> 172.21.15.18:0/1507711165 conn(0x7efef80b2030 msgr2=0x7efef80b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.678+0000 7efee4ff9640 1 -- 172.21.15.18:0/1507711165 shutdown_connections 2024-09-21T07:10:18.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.678+0000 7efee4ff9640 1 -- 172.21.15.18:0/1507711165 wait complete. 2024-09-21T07:10:18.696 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.696 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.696 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.701 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.752+0000 7f19255e6640 1 -- 172.21.15.18:0/1226938298 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f192006d5c0 con 0x7f19200b5260 2024-09-21T07:10:18.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.752+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2717864995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f39a806a890 con 0x7f39a80b4490 2024-09-21T07:10:18.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.756+0000 7f398ffff640 1 -- 172.21.15.18:0/2717864995 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v18)=0 v18) ==== 111+0+0 (secure 0 0 0) 0x7f39a003c950 con 0x7f39a80b4490 2024-09-21T07:10:18.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.758+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2717864995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39a80b4490 msgr2=0x7f39a8154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.758+0000 7f39ae1e6640 1 --2- 172.21.15.18:0/2717864995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39a80b4490 0x7f39a8154b00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f39a0033040 tx=0x7f39a0003ce0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.758+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2717864995 shutdown_connections 2024-09-21T07:10:18.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.759+0000 7f39ae1e6640 1 --2- 172.21.15.18:0/2717864995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39a815c810 0x7f39a80ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.759+0000 7f39ae1e6640 1 --2- 172.21.15.18:0/2717864995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39a80b4490 0x7f39a8154b00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.759+0000 7f39ae1e6640 1 --2- 172.21.15.18:0/2717864995 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f39a806e340 0x7f39a81545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.759+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2717864995 >> 172.21.15.18:0/2717864995 conn(0x7f39a80b3a40 msgr2=0x7f39a815bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.760+0000 7fa921941640 1 -- 172.21.15.18:0/2501276547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fa8fc005580 con 0x7fa914052390 2024-09-21T07:10:18.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.760+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2717864995 shutdown_connections 2024-09-21T07:10:18.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.760+0000 7f39ae1e6640 1 -- 172.21.15.18:0/2717864995 wait complete. 2024-09-21T07:10:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.761+0000 7f19077fe640 1 -- 172.21.15.18:0/1226938298 <== mon.2 v2:172.21.15.49:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v19)=0 v19) ==== 106+0+0 (secure 0 0 0) 0x7f1914019940 con 0x7f19200b5260 2024-09-21T07:10:18.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.762+0000 7f19255e6640 1 -- 172.21.15.18:0/1226938298 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f19200b5260 msgr2=0x7f192014e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.762+0000 7f19255e6640 1 --2- 172.21.15.18:0/1226938298 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f19200b5260 0x7f192014e2c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f191400b410 tx=0x7f191400b8d0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.762+0000 7f19255e6640 1 -- 172.21.15.18:0/1226938298 shutdown_connections 2024-09-21T07:10:18.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.762+0000 7f19255e6640 1 --2- 172.21.15.18:0/1226938298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f192015c810 0x7f192015a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.762+0000 7f19255e6640 1 --2- 172.21.15.18:0/1226938298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19200b5670 0x7f1920151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.763+0000 7f19255e6640 1 --2- 172.21.15.18:0/1226938298 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f19200b5260 0x7f192014e2c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.763+0000 7f19255e6640 1 -- 172.21.15.18:0/1226938298 >> 172.21.15.18:0/1226938298 conn(0x7f19200b3a40 msgr2=0x7f1920159050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.763+0000 7f19255e6640 1 -- 172.21.15.18:0/1226938298 shutdown_connections 2024-09-21T07:10:18.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.763+0000 7f19255e6640 1 -- 172.21.15.18:0/1226938298 wait complete. 2024-09-21T07:10:18.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.773+0000 7fa903fff640 1 -- 172.21.15.18:0/2501276547 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7fa910014aa0 con 0x7fa914052390 2024-09-21T07:10:18.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.775+0000 7fa921941640 1 -- 172.21.15.18:0/2501276547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa914052390 msgr2=0x7fa9140c2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.775+0000 7fa921941640 1 --2- 172.21.15.18:0/2501276547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa914052390 0x7fa9140c2980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa91000b750 tx=0x7fa91000bc10 comp rx=0 tx=0).stop 2024-09-21T07:10:18.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.775+0000 7fa921941640 1 -- 172.21.15.18:0/2501276547 shutdown_connections 2024-09-21T07:10:18.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.775+0000 7fa921941640 1 --2- 172.21.15.18:0/2501276547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa914054750 0x7fa91404ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.775+0000 7fa921941640 1 --2- 172.21.15.18:0/2501276547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa914052390 0x7fa9140c2980 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.775+0000 7fa921941640 1 --2- 172.21.15.18:0/2501276547 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa914051660 0x7fa9140e5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.775+0000 7fa921941640 1 -- 172.21.15.18:0/2501276547 >> 172.21.15.18:0/2501276547 conn(0x7fa91401d9d0 msgr2=0x7fa914009c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.775+0000 7fa921941640 1 -- 172.21.15.18:0/2501276547 shutdown_connections 2024-09-21T07:10:18.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.775+0000 7fa921941640 1 -- 172.21.15.18:0/2501276547 wait complete. 2024-09-21T07:10:18.778 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.775+0000 7fb40d151640 1 -- 172.21.15.18:0/2925660161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fb408150dd0 con 0x7fb4081569b0 2024-09-21T07:10:18.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.779+0000 7fb3ef7fe640 1 -- 172.21.15.18:0/2925660161 <== mon.1 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v21)=0 v21) ==== 125+0+0 (secure 0 0 0) 0x7fb408150dd0 con 0x7fb4081569b0 2024-09-21T07:10:18.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.780+0000 7fb40d151640 1 -- 172.21.15.18:0/2925660161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4081569b0 msgr2=0x7fb408158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.780+0000 7fb40d151640 1 --2- 172.21.15.18:0/2925660161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4081569b0 0x7fb408158bb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb4080746d0 tx=0x7fb400004270 comp rx=0 tx=0).stop 2024-09-21T07:10:18.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.780+0000 7fb40d151640 1 -- 172.21.15.18:0/2925660161 shutdown_connections 2024-09-21T07:10:18.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.780+0000 7fb40d151640 1 --2- 172.21.15.18:0/2925660161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4081569b0 0x7fb408158bb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.780+0000 7fb40d151640 1 --2- 172.21.15.18:0/2925660161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4080b4490 0x7fb408158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.780+0000 7fb40d151640 1 --2- 172.21.15.18:0/2925660161 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb4080b0460 0x7fb40814daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.780+0000 7fb40d151640 1 -- 172.21.15.18:0/2925660161 >> 172.21.15.18:0/2925660161 conn(0x7fb4080b3a40 msgr2=0x7fb40815c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.781+0000 7fb40d151640 1 -- 172.21.15.18:0/2925660161 shutdown_connections 2024-09-21T07:10:18.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.781+0000 7fb40d151640 1 -- 172.21.15.18:0/2925660161 wait complete. 2024-09-21T07:10:18.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.792+0000 7fe3f4f69640 1 -- 172.21.15.18:0/4163342625 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fe3d4005580 con 0x7fe3f00cf2c0 2024-09-21T07:10:18.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.795+0000 7f5ee265c640 1 -- 172.21.15.18:0/1878449338 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f5ebc005580 con 0x7f5edc08c6c0 2024-09-21T07:10:18.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.795+0000 7fe3deffd640 1 -- 172.21.15.18:0/4163342625 <== mon.2 v2:172.21.15.49:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v22)=0 v22) ==== 108+0+0 (secure 0 0 0) 0x7fe3e40046c0 con 0x7fe3f00cf2c0 2024-09-21T07:10:18.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.796+0000 7fe3f4f69640 1 -- 172.21.15.18:0/4163342625 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe3f00cf2c0 msgr2=0x7fe3f0154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.796+0000 7fe3f4f69640 1 --2- 172.21.15.18:0/4163342625 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe3f00cf2c0 0x7fe3f0154e50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00ce240 tx=0x7fe3e400c820 comp rx=0 tx=0).stop 2024-09-21T07:10:18.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.796+0000 7fe3f4f69640 1 -- 172.21.15.18:0/4163342625 shutdown_connections 2024-09-21T07:10:18.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.796+0000 7fe3f4f69640 1 --2- 172.21.15.18:0/4163342625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3f00cfde0 0x7fe3f015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.796+0000 7fe3f4f69640 1 --2- 172.21.15.18:0/4163342625 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe3f00cf2c0 0x7fe3f0154e50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.796+0000 7fe3f4f69640 1 --2- 172.21.15.18:0/4163342625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f00743c0 0x7fe3f0146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.797+0000 7fe3f4f69640 1 -- 172.21.15.18:0/4163342625 >> 172.21.15.18:0/4163342625 conn(0x7fe3f00ccd30 msgr2=0x7fe3f015e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.797+0000 7fe3f4f69640 1 -- 172.21.15.18:0/4163342625 shutdown_connections 2024-09-21T07:10:18.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.797+0000 7fe3f4f69640 1 -- 172.21.15.18:0/4163342625 wait complete. 2024-09-21T07:10:18.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.798+0000 7f5ed1ffb640 1 -- 172.21.15.18:0/1878449338 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f5ed8032440 con 0x7f5edc08c6c0 2024-09-21T07:10:18.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.800+0000 7f5ee265c640 1 -- 172.21.15.18:0/1878449338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5edc08c6c0 msgr2=0x7f5edc2178a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.800+0000 7f5ee265c640 1 --2- 172.21.15.18:0/1878449338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5edc08c6c0 0x7f5edc2178a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5ed802a970 tx=0x7f5ed80308e0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.800+0000 7f5ee265c640 1 -- 172.21.15.18:0/1878449338 shutdown_connections 2024-09-21T07:10:18.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.800+0000 7f5ee265c640 1 --2- 172.21.15.18:0/1878449338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5edc08bd50 0x7f5edc0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.800+0000 7f5ee265c640 1 --2- 172.21.15.18:0/1878449338 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5edc0ce430 0x7f5edc213880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.800+0000 7f5ee265c640 1 --2- 172.21.15.18:0/1878449338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5edc08c6c0 0x7f5edc2178a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.800+0000 7f5ee265c640 1 -- 172.21.15.18:0/1878449338 >> 172.21.15.18:0/1878449338 conn(0x7f5edc0b2030 msgr2=0x7f5edc0b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.800+0000 7f5ee265c640 1 -- 172.21.15.18:0/1878449338 shutdown_connections 2024-09-21T07:10:18.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.800+0000 7f5ee265c640 1 -- 172.21.15.18:0/1878449338 wait complete. 2024-09-21T07:10:18.813 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.813 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.813 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.813 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi018') 2024-09-21T07:10:18.815 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config dump 2024-09-21T07:10:18.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.967+0000 7f0108d13640 1 -- 172.21.15.18:0/698449638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01040b5560 msgr2=0x7f01040b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.967+0000 7f0108d13640 1 --2- 172.21.15.18:0/698449638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01040b5560 0x7f01040b5970 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0104073ed0 tx=0x7f00fc02aa30 comp rx=0 tx=0).stop 2024-09-21T07:10:18.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.967+0000 7f0108d13640 1 -- 172.21.15.18:0/698449638 shutdown_connections 2024-09-21T07:10:18.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.967+0000 7f0108d13640 1 --2- 172.21.15.18:0/698449638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01040b5560 0x7f01040b5970 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.967+0000 7f0108d13640 1 --2- 172.21.15.18:0/698449638 >> v2:172.21.15.49:3300/0 conn(0x7f01040720a0 0x7f01040cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.967+0000 7f0108d13640 1 --2- 172.21.15.18:0/698449638 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0104157050 0x7f01040b7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.967+0000 7f0108d13640 1 -- 172.21.15.18:0/698449638 >> 172.21.15.18:0/698449638 conn(0x7f01040b7a80 msgr2=0x7f01040b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:18.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.967+0000 7f0108d13640 1 -- 172.21.15.18:0/698449638 shutdown_connections 2024-09-21T07:10:18.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.967+0000 7f0108d13640 1 -- 172.21.15.18:0/698449638 wait complete. 2024-09-21T07:10:18.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.969+0000 7f0108d13640 1 Processor -- start 2024-09-21T07:10:18.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.969+0000 7f0108d13640 1 -- start start 2024-09-21T07:10:18.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.970+0000 7f0108d13640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01040720a0 0x7f01041488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.970+0000 7f0108d13640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f01040b5560 0x7f01040b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.970+0000 7f0108d13640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0104157050 0x7f0104149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.970+0000 7f0108d13640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0104160690 con 0x7f01040720a0 2024-09-21T07:10:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.970+0000 7f0108d13640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0104160510 con 0x7f0104157050 2024-09-21T07:10:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.970+0000 7f0108d13640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f0104160810 con 0x7f01040b5560 2024-09-21T07:10:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f010259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01040720a0 0x7f01041488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f010259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01040720a0 0x7f01041488b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37830/0 (socket says 172.21.15.18:37830) 2024-09-21T07:10:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f010259c640 1 -- 172.21.15.18:0/2104464643 learned_addr learned my addr 172.21.15.18:0/2104464643 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f0102d9d640 1 --2- 172.21.15.18:0/2104464643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0104157050 0x7f0104149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f0101d9b640 1 --2- 172.21.15.18:0/2104464643 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f01040b5560 0x7f01040b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f010259c640 1 -- 172.21.15.18:0/2104464643 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f01040b5560 msgr2=0x7f01040b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f010259c640 1 --2- 172.21.15.18:0/2104464643 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f01040b5560 0x7f01040b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f010259c640 1 -- 172.21.15.18:0/2104464643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0104157050 msgr2=0x7f0104149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f010259c640 1 --2- 172.21.15.18:0/2104464643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0104157050 0x7f0104149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f010259c640 1 -- 172.21.15.18:0/2104464643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0104148df0 con 0x7f01040720a0 2024-09-21T07:10:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f010259c640 1 --2- 172.21.15.18:0/2104464643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01040720a0 0x7f01041488b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f00f800e7c0 tx=0x7f00f800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f00f2ffd640 1 -- 172.21.15.18:0/2104464643 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f800ccc0 con 0x7f01040720a0 2024-09-21T07:10:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f00f2ffd640 1 -- 172.21.15.18:0/2104464643 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00f800ce80 con 0x7f01040720a0 2024-09-21T07:10:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f0108d13640 1 -- 172.21.15.18:0/2104464643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f010414bf30 con 0x7f01040720a0 2024-09-21T07:10:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f00f2ffd640 1 -- 172.21.15.18:0/2104464643 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8005280 con 0x7f01040720a0 2024-09-21T07:10:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f0108d13640 1 -- 172.21.15.18:0/2104464643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01040b2de0 con 0x7f01040720a0 2024-09-21T07:10:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.971+0000 7f00f2ffd640 1 -- 172.21.15.18:0/2104464643 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f00f80047a0 con 0x7f01040720a0 2024-09-21T07:10:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.972+0000 7f00f2ffd640 1 -- 172.21.15.18:0/2104464643 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f00f8018430 con 0x7f01040720a0 2024-09-21T07:10:18.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.973+0000 7f0108d13640 1 -- 172.21.15.18:0/2104464643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01040b28f0 con 0x7f01040720a0 2024-09-21T07:10:18.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:18.975+0000 7f00f2ffd640 1 -- 172.21.15.18:0/2104464643 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f00f8004c20 con 0x7f01040720a0 2024-09-21T07:10:19.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.050+0000 7f0108d13640 1 -- 172.21.15.18:0/2104464643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f0104160d30 con 0x7f01040720a0 2024-09-21T07:10:19.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.051+0000 7f00f2ffd640 1 -- 172.21.15.18:0/2104464643 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7f00f8004e00 con 0x7f01040720a0 2024-09-21T07:10:19.052 INFO:teuthology.orchestra.run.smithi018.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:10:19.053 INFO:teuthology.orchestra.run.smithi018.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:10:19.053 INFO:teuthology.orchestra.run.smithi018.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:10:19.053 INFO:teuthology.orchestra.run.smithi018.stdout:mgr advanced debug_client 20/20 2024-09-21T07:10:19.053 INFO:teuthology.orchestra.run.smithi018.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:10:19.053 INFO:teuthology.orchestra.run.smithi018.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:10:19.053 INFO:teuthology.orchestra.run.smithi018.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:10:19.053 INFO:teuthology.orchestra.run.smithi018.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:10:19.053 INFO:teuthology.orchestra.run.smithi018.stdout:mds advanced debug_mds 20/20 2024-09-21T07:10:19.053 INFO:teuthology.orchestra.run.smithi018.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:10:19.053 INFO:teuthology.orchestra.run.smithi018.stdout:mds advanced debug_ms 2/2 2024-09-21T07:10:19.053 INFO:teuthology.orchestra.run.smithi018.stdout:mds dev mds_debug_frag true 2024-09-21T07:10:19.053 INFO:teuthology.orchestra.run.smithi018.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:10:19.053 INFO:teuthology.orchestra.run.smithi018.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:10:19.054 INFO:teuthology.orchestra.run.smithi018.stdout:mds dev mds_verify_scatter true 2024-09-21T07:10:19.054 INFO:teuthology.orchestra.run.smithi018.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:10:19.054 INFO:teuthology.orchestra.run.smithi018.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:10:19.054 INFO:teuthology.orchestra.run.smithi018.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:10:19.054 INFO:teuthology.orchestra.run.smithi018.stdout:client advanced client_mount_timeout 600 2024-09-21T07:10:19.054 INFO:teuthology.orchestra.run.smithi018.stdout:client advanced debug_client 20/20 2024-09-21T07:10:19.054 INFO:teuthology.orchestra.run.smithi018.stdout:client advanced debug_ms 1/1 2024-09-21T07:10:19.054 INFO:teuthology.orchestra.run.smithi018.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:10:19.054 INFO:teuthology.orchestra.run.smithi018.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:10:19.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.051+0000 7f0108d13640 1 -- 172.21.15.18:0/2104464643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01040720a0 msgr2=0x7f01041488b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:19.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.051+0000 7f0108d13640 1 --2- 172.21.15.18:0/2104464643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01040720a0 0x7f01041488b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f00f800e7c0 tx=0x7f00f800ec80 comp rx=0 tx=0).stop 2024-09-21T07:10:19.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.051+0000 7f0108d13640 1 -- 172.21.15.18:0/2104464643 shutdown_connections 2024-09-21T07:10:19.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.051+0000 7f0108d13640 1 --2- 172.21.15.18:0/2104464643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0104157050 0x7f0104149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.051+0000 7f0108d13640 1 --2- 172.21.15.18:0/2104464643 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f01040b5560 0x7f01040b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.051+0000 7f0108d13640 1 --2- 172.21.15.18:0/2104464643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01040720a0 0x7f01041488b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.052+0000 7f0108d13640 1 -- 172.21.15.18:0/2104464643 >> 172.21.15.18:0/2104464643 conn(0x7f01040b7a80 msgr2=0x7f010415d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:19.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.052+0000 7f0108d13640 1 -- 172.21.15.18:0/2104464643 shutdown_connections 2024-09-21T07:10:19.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.052+0000 7f0108d13640 1 -- 172.21.15.18:0/2104464643 wait complete. 2024-09-21T07:10:19.064 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T07:10:19.064 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T07:10:19.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.177+0000 7f40173c3640 1 -- 172.21.15.18:0/3761049593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4010144950 msgr2=0x7f40100cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:19.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.177+0000 7f40173c3640 1 --2- 172.21.15.18:0/3761049593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4010144950 0x7f40100cf670 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f40100b08f0 tx=0x7f400c02a560 comp rx=0 tx=0).stop 2024-09-21T07:10:19.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.177+0000 7f40173c3640 1 -- 172.21.15.18:0/3761049593 shutdown_connections 2024-09-21T07:10:19.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.177+0000 7f40173c3640 1 --2- 172.21.15.18:0/3761049593 >> v2:172.21.15.49:3300/0 conn(0x7f40100d02c0 0x7f40100b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.177+0000 7f40173c3640 1 --2- 172.21.15.18:0/3761049593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4010144950 0x7f40100cf670 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.177+0000 7f40173c3640 1 -- 172.21.15.18:0/3761049593 >> 172.21.15.18:0/3761049593 conn(0x7f40100743e0 msgr2=0x7f401006cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:19.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.177+0000 7f40173c3640 1 -- 172.21.15.18:0/3761049593 shutdown_connections 2024-09-21T07:10:19.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.177+0000 7f40173c3640 1 -- 172.21.15.18:0/3761049593 wait complete. 2024-09-21T07:10:19.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.179+0000 7f40173c3640 1 Processor -- start 2024-09-21T07:10:19.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.179+0000 7f40173c3640 1 -- start start 2024-09-21T07:10:19.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.180+0000 7f40173c3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40100711c0 0x7f401015fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:19.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.180+0000 7f40173c3640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f40100d02c0 0x7f401015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:19.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.180+0000 7f40173c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4010144950 0x7f4010132a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:19.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.180+0000 7f40173c3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f40100b57d0 con 0x7f4010144950 2024-09-21T07:10:19.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.180+0000 7f40173c3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f40100b5650 con 0x7f40100711c0 2024-09-21T07:10:19.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.180+0000 7f40173c3640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f40100b5950 con 0x7f40100d02c0 2024-09-21T07:10:19.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.181+0000 7f4015960640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4010144950 0x7f4010132a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:19.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.181+0000 7f4015960640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4010144950 0x7f4010132a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37836/0 (socket says 172.21.15.18:37836) 2024-09-21T07:10:19.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.181+0000 7f4015960640 1 -- 172.21.15.18:0/3146967662 learned_addr learned my addr 172.21.15.18:0/3146967662 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:19.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.181+0000 7f401515f640 1 --2- 172.21.15.18:0/3146967662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40100711c0 0x7f401015fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:19.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.181+0000 7f401495e640 1 --2- 172.21.15.18:0/3146967662 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f40100d02c0 0x7f401015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:19.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.181+0000 7f4015960640 1 -- 172.21.15.18:0/3146967662 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f40100d02c0 msgr2=0x7f401015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:19.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.181+0000 7f4015960640 1 --2- 172.21.15.18:0/3146967662 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f40100d02c0 0x7f401015afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.181+0000 7f4015960640 1 -- 172.21.15.18:0/3146967662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40100711c0 msgr2=0x7f401015fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:19.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.181+0000 7f4015960640 1 --2- 172.21.15.18:0/3146967662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40100711c0 0x7f401015fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.181+0000 7f4015960640 1 -- 172.21.15.18:0/3146967662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4010136da0 con 0x7f4010144950 2024-09-21T07:10:19.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.181+0000 7f4015960640 1 --2- 172.21.15.18:0/3146967662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4010144950 0x7f4010132a20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f400800ea70 tx=0x7f400800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:19.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.181+0000 7f4005ffb640 1 -- 172.21.15.18:0/3146967662 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400800ce40 con 0x7f4010144950 2024-09-21T07:10:19.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.181+0000 7f4005ffb640 1 -- 172.21.15.18:0/3146967662 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4008004c10 con 0x7f4010144950 2024-09-21T07:10:19.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.181+0000 7f40173c3640 1 -- 172.21.15.18:0/3146967662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4010143370 con 0x7f4010144950 2024-09-21T07:10:19.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.181+0000 7f4005ffb640 1 -- 172.21.15.18:0/3146967662 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4008005020 con 0x7f4010144950 2024-09-21T07:10:19.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.182+0000 7f40173c3640 1 -- 172.21.15.18:0/3146967662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4010143930 con 0x7f4010144950 2024-09-21T07:10:19.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.182+0000 7f4005ffb640 1 -- 172.21.15.18:0/3146967662 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4008005550 con 0x7f4010144950 2024-09-21T07:10:19.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.182+0000 7f4005ffb640 1 -- 172.21.15.18:0/3146967662 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4008010770 con 0x7f4010144950 2024-09-21T07:10:19.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.182+0000 7f40173c3640 1 -- 172.21.15.18:0/3146967662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40101e72d0 con 0x7f4010144950 2024-09-21T07:10:19.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.185+0000 7f4005ffb640 1 -- 172.21.15.18:0/3146967662 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f40101e72d0 con 0x7f4010144950 2024-09-21T07:10:19.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.250+0000 7f40173c3640 1 -- 172.21.15.18:0/3146967662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f40100b5db0 con 0x7f4010144950 2024-09-21T07:10:19.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.252+0000 7f4005ffb640 1 -- 172.21.15.18:0/3146967662 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f4008010970 con 0x7f4010144950 2024-09-21T07:10:19.253 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2024-09-21T07:10:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.253+0000 7f40173c3640 1 -- 172.21.15.18:0/3146967662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4010144950 msgr2=0x7f4010132a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.253+0000 7f40173c3640 1 --2- 172.21.15.18:0/3146967662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4010144950 0x7f4010132a20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f400800ea70 tx=0x7f400800ef30 comp rx=0 tx=0).stop 2024-09-21T07:10:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.253+0000 7f40173c3640 1 -- 172.21.15.18:0/3146967662 shutdown_connections 2024-09-21T07:10:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.253+0000 7f40173c3640 1 --2- 172.21.15.18:0/3146967662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4010144950 0x7f4010132a20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.253+0000 7f40173c3640 1 --2- 172.21.15.18:0/3146967662 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f40100d02c0 0x7f401015afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.253+0000 7f40173c3640 1 --2- 172.21.15.18:0/3146967662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40100711c0 0x7f401015fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.253+0000 7f40173c3640 1 -- 172.21.15.18:0/3146967662 >> 172.21.15.18:0/3146967662 conn(0x7f40100743e0 msgr2=0x7f40100b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.253+0000 7f40173c3640 1 -- 172.21.15.18:0/3146967662 shutdown_connections 2024-09-21T07:10:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:19.253+0000 7f40173c3640 1 -- 172.21.15.18:0/3146967662 wait complete. 2024-09-21T07:10:19.265 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T07:10:19.265 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T07:10:19.265 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:10:19.265 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T07:10:19.291 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:10:19.291 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T07:10:19.357 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:10:19.357 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T07:10:19.423 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:10:19.423 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T07:10:19.489 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:10:19.489 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-21T07:10:19.515 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:10:19.515 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-21T07:10:19.582 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:10:19.582 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-21T07:10:19.648 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:10:19.648 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-21T07:10:19.713 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd new 740113d7-37ab-4a8b-a4bb-ed2e72765a33 0 2024-09-21T07:10:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.868+0000 7f9101f07640 1 -- 172.21.15.49:0/1576969463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90fc06f850 msgr2=0x7f90fc15ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.868+0000 7f9101f07640 1 --2- 172.21.15.49:0/1576969463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90fc06f850 0x7f90fc15ea60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f90fc072170 tx=0x7f90f002a560 comp rx=0 tx=0).stop 2024-09-21T07:10:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.868+0000 7f9101f07640 1 -- 172.21.15.49:0/1576969463 shutdown_connections 2024-09-21T07:10:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.868+0000 7f9101f07640 1 --2- 172.21.15.49:0/1576969463 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f90fc15efa0 0x7f90fc15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.868+0000 7f9101f07640 1 --2- 172.21.15.49:0/1576969463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90fc06f850 0x7f90fc15ea60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.868+0000 7f9101f07640 1 --2- 172.21.15.49:0/1576969463 >> v2:172.21.15.18:3300/0 conn(0x7f90fc0d0b20 0x7f90fc0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.868+0000 7f9101f07640 1 -- 172.21.15.49:0/1576969463 >> 172.21.15.49:0/1576969463 conn(0x7f90fc0b1fe0 msgr2=0x7f90fc0b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.868+0000 7f9101f07640 1 -- 172.21.15.49:0/1576969463 shutdown_connections 2024-09-21T07:10:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.868+0000 7f9101f07640 1 -- 172.21.15.49:0/1576969463 wait complete. 2024-09-21T07:10:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.870+0000 7f9101f07640 1 Processor -- start 2024-09-21T07:10:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.870+0000 7f9101f07640 1 -- start start 2024-09-21T07:10:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f9101f07640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90fc06f850 0x7f90fc1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f9101f07640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f90fc0d0b20 0x7f90fc158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f9101f07640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90fc15efa0 0x7f90fc15d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f9101f07640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc0d0290 con 0x7f90fc06f850 2024-09-21T07:10:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f9101f07640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc15f5c0 con 0x7f90fc15efa0 2024-09-21T07:10:19.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f9101f07640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f90fc0d0410 con 0x7f90fc0d0b20 2024-09-21T07:10:19.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f90faffd640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f90fc0d0b20 0x7f90fc158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:19.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f90fbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90fc15efa0 0x7f90fc15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:19.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f90fbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90fc15efa0 0x7f90fc15d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40106/0 (socket says 172.21.15.49:40106) 2024-09-21T07:10:19.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f90fbfff640 1 -- 172.21.15.49:0/191681353 learned_addr learned my addr 172.21.15.49:0/191681353 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T07:10:19.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f90faffd640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f90fc0d0b20 0x7f90fc158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.49:47524/0 (socket says 172.21.15.49:47524) 2024-09-21T07:10:19.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f90fb7fe640 1 --2- 172.21.15.49:0/191681353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90fc06f850 0x7f90fc1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:19.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f90faffd640 1 -- 172.21.15.49:0/191681353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90fc15efa0 msgr2=0x7f90fc15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:19.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f90faffd640 1 --2- 172.21.15.49:0/191681353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90fc15efa0 0x7f90fc15d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f90faffd640 1 -- 172.21.15.49:0/191681353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90fc06f850 msgr2=0x7f90fc1578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f90faffd640 1 --2- 172.21.15.49:0/191681353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90fc06f850 0x7f90fc1578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f90faffd640 1 -- 172.21.15.49:0/191681353 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90fc1f7060 con 0x7f90fc0d0b20 2024-09-21T07:10:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f90fbfff640 1 --2- 172.21.15.49:0/191681353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90fc15efa0 0x7f90fc15d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.872+0000 7f90faffd640 1 --2- 172.21.15.49:0/191681353 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f90fc0d0b20 0x7f90fc158460 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f90f0031000 tx=0x7f90f00038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.873+0000 7f90e3fff640 1 -- 172.21.15.49:0/191681353 <== mon.2 v2:172.21.15.49:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f003e030 con 0x7f90fc0d0b20 2024-09-21T07:10:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.873+0000 7f90e3fff640 1 -- 172.21.15.49:0/191681353 <== mon.2 v2:172.21.15.49:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90f0003e50 con 0x7f90fc0d0b20 2024-09-21T07:10:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.873+0000 7f9101f07640 1 -- 172.21.15.49:0/191681353 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90fc1f7340 con 0x7f90fc0d0b20 2024-09-21T07:10:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.873+0000 7f90e3fff640 1 -- 172.21.15.49:0/191681353 <== mon.2 v2:172.21.15.49:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0035040 con 0x7f90fc0d0b20 2024-09-21T07:10:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.873+0000 7f9101f07640 1 -- 172.21.15.49:0/191681353 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f90fc1f7900 con 0x7f90fc0d0b20 2024-09-21T07:10:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.873+0000 7f90e3fff640 1 -- 172.21.15.49:0/191681353 <== mon.2 v2:172.21.15.49:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f90f0041030 con 0x7f90fc0d0b20 2024-09-21T07:10:19.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.873+0000 7f90e3fff640 1 -- 172.21.15.49:0/191681353 <== mon.2 v2:172.21.15.49:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f90f0043b80 con 0x7f90fc0d0b20 2024-09-21T07:10:19.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.874+0000 7f9101f07640 1 -- 172.21.15.49:0/191681353 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90fc1f37d0 con 0x7f90fc0d0b20 2024-09-21T07:10:19.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.876+0000 7f90e3fff640 1 -- 172.21.15.49:0/191681353 <== mon.2 v2:172.21.15.49:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f90f0004eb0 con 0x7f90fc0d0b20 2024-09-21T07:10:19.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.948+0000 7f9101f07640 1 -- 172.21.15.49:0/191681353 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "osd new", "uuid": "740113d7-37ab-4a8b-a4bb-ed2e72765a33", "id": 0} v 0) -- 0x7f90fc0d08a0 con 0x7f90fc0d0b20 2024-09-21T07:10:19.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.951+0000 7f90e3fff640 1 -- 172.21.15.49:0/191681353 <== mon.2 v2:172.21.15.49:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "740113d7-37ab-4a8b-a4bb-ed2e72765a33", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f90f004d480 con 0x7f90fc0d0b20 2024-09-21T07:10:19.954 INFO:teuthology.orchestra.run.smithi049.stdout:0 2024-09-21T07:10:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.952+0000 7f9101f07640 1 -- 172.21.15.49:0/191681353 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f90fc0d0b20 msgr2=0x7f90fc158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.952+0000 7f9101f07640 1 --2- 172.21.15.49:0/191681353 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f90fc0d0b20 0x7f90fc158460 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f90f0031000 tx=0x7f90f00038a0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.952+0000 7f9101f07640 1 -- 172.21.15.49:0/191681353 shutdown_connections 2024-09-21T07:10:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.952+0000 7f9101f07640 1 --2- 172.21.15.49:0/191681353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90fc15efa0 0x7f90fc15d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.952+0000 7f9101f07640 1 --2- 172.21.15.49:0/191681353 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f90fc0d0b20 0x7f90fc158460 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.952+0000 7f9101f07640 1 --2- 172.21.15.49:0/191681353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90fc06f850 0x7f90fc1578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.952+0000 7f9101f07640 1 -- 172.21.15.49:0/191681353 >> 172.21.15.49:0/191681353 conn(0x7f90fc0b1fe0 msgr2=0x7f90fc0cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.953+0000 7f9101f07640 1 -- 172.21.15.49:0/191681353 shutdown_connections 2024-09-21T07:10:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:19.953+0000 7f9101f07640 1 -- 172.21.15.49:0/191681353 wait complete. 2024-09-21T07:10:19.965 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd new 2ef92c25-ee40-4bdc-9903-7c5fab9bc76c 1 2024-09-21T07:10:20.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.080+0000 7f055d9b6640 1 -- 172.21.15.49:0/3180099097 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0540005280 msgr2=0x7f054000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.080+0000 7f055d9b6640 1 --2- 172.21.15.49:0/3180099097 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0540005280 0x7f054000b9c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f055000c610 tx=0x7f0540005830 comp rx=0 tx=0).stop 2024-09-21T07:10:20.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.080+0000 7f055d9b6640 1 -- 172.21.15.49:0/3180099097 shutdown_connections 2024-09-21T07:10:20.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.080+0000 7f055d9b6640 1 --2- 172.21.15.49:0/3180099097 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0540005280 0x7f054000b9c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.080+0000 7f055d9b6640 1 -- 172.21.15.49:0/3180099097 >> 172.21.15.49:0/3180099097 conn(0x7f0558073f60 msgr2=0x7f05580b6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:20.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.081+0000 7f055d9b6640 1 -- 172.21.15.49:0/3180099097 shutdown_connections 2024-09-21T07:10:20.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.081+0000 7f055d9b6640 1 -- 172.21.15.49:0/3180099097 wait complete. 2024-09-21T07:10:20.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.082+0000 7f055d9b6640 1 Processor -- start 2024-09-21T07:10:20.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.083+0000 7f055d9b6640 1 -- start start 2024-09-21T07:10:20.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f055d9b6640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0540005280 0x7f05580ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:20.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f055d9b6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f055814eb30 0x7f055814f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:20.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f055d9b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05580cdaa0 0x7f05580cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:20.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f055d9b6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05580d1060 con 0x7f055814eb30 2024-09-21T07:10:20.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f055d9b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f055815ecd0 con 0x7f05580cdaa0 2024-09-21T07:10:20.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f055d9b6640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f05580d11e0 con 0x7f0540005280 2024-09-21T07:10:20.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f0556ffd640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0540005280 0x7f05580ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:20.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f05577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05580cdaa0 0x7f05580cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:20.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f05577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05580cdaa0 0x7f05580cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40120/0 (socket says 172.21.15.49:40120) 2024-09-21T07:10:20.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f0556ffd640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0540005280 0x7f05580ac5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.49:47538/0 (socket says 172.21.15.49:47538) 2024-09-21T07:10:20.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f05577fe640 1 -- 172.21.15.49:0/3149798859 learned_addr learned my addr 172.21.15.49:0/3149798859 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T07:10:20.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f05567fc640 1 --2- 172.21.15.49:0/3149798859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f055814eb30 0x7f055814f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:20.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f0556ffd640 1 -- 172.21.15.49:0/3149798859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05580cdaa0 msgr2=0x7f05580cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f0556ffd640 1 --2- 172.21.15.49:0/3149798859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05580cdaa0 0x7f05580cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f0556ffd640 1 -- 172.21.15.49:0/3149798859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f055814eb30 msgr2=0x7f055814f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f0556ffd640 1 --2- 172.21.15.49:0/3149798859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f055814eb30 0x7f055814f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f0556ffd640 1 -- 172.21.15.49:0/3149798859 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05580acae0 con 0x7f0540005280 2024-09-21T07:10:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f05577fe640 1 --2- 172.21.15.49:0/3149798859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05580cdaa0 0x7f05580cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.084+0000 7f0556ffd640 1 --2- 172.21.15.49:0/3149798859 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0540005280 0x7f05580ac5a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0548011810 tx=0x7f0548011c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.085+0000 7f053ffff640 1 -- 172.21.15.49:0/3149798859 <== mon.2 v2:172.21.15.49:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548011e60 con 0x7f0540005280 2024-09-21T07:10:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.085+0000 7f053ffff640 1 -- 172.21.15.49:0/3149798859 <== mon.2 v2:172.21.15.49:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f054800fdb0 con 0x7f0540005280 2024-09-21T07:10:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.085+0000 7f053ffff640 1 -- 172.21.15.49:0/3149798859 <== mon.2 v2:172.21.15.49:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548004290 con 0x7f0540005280 2024-09-21T07:10:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.085+0000 7f055d9b6640 1 -- 172.21.15.49:0/3149798859 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05580ab500 con 0x7f0540005280 2024-09-21T07:10:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.085+0000 7f055d9b6640 1 -- 172.21.15.49:0/3149798859 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f05580abac0 con 0x7f0540005280 2024-09-21T07:10:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.085+0000 7f053ffff640 1 -- 172.21.15.49:0/3149798859 <== mon.2 v2:172.21.15.49:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f05480035f0 con 0x7f0540005280 2024-09-21T07:10:20.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.085+0000 7f053ffff640 1 -- 172.21.15.49:0/3149798859 <== mon.2 v2:172.21.15.49:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f0548019c70 con 0x7f0540005280 2024-09-21T07:10:20.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.086+0000 7f055d9b6640 1 -- 172.21.15.49:0/3149798859 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f055806cd40 con 0x7f0540005280 2024-09-21T07:10:20.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.088+0000 7f053ffff640 1 -- 172.21.15.49:0/3149798859 <== mon.2 v2:172.21.15.49:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0548019420 con 0x7f0540005280 2024-09-21T07:10:20.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.159+0000 7f055d9b6640 1 -- 172.21.15.49:0/3149798859 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2ef92c25-ee40-4bdc-9903-7c5fab9bc76c", "id": 1} v 0) -- 0x7f05580b9f90 con 0x7f0540005280 2024-09-21T07:10:20.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.163+0000 7f053ffff640 1 -- 172.21.15.49:0/3149798859 <== mon.2 v2:172.21.15.49:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2ef92c25-ee40-4bdc-9903-7c5fab9bc76c", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f0548004430 con 0x7f0540005280 2024-09-21T07:10:20.165 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-09-21T07:10:20.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.164+0000 7f055d9b6640 1 -- 172.21.15.49:0/3149798859 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0540005280 msgr2=0x7f05580ac5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.164+0000 7f055d9b6640 1 --2- 172.21.15.49:0/3149798859 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0540005280 0x7f05580ac5a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0548011810 tx=0x7f0548011c10 comp rx=0 tx=0).stop 2024-09-21T07:10:20.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.164+0000 7f055d9b6640 1 -- 172.21.15.49:0/3149798859 shutdown_connections 2024-09-21T07:10:20.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.164+0000 7f055d9b6640 1 --2- 172.21.15.49:0/3149798859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05580cdaa0 0x7f05580cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.164+0000 7f055d9b6640 1 --2- 172.21.15.49:0/3149798859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f055814eb30 0x7f055814f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.164+0000 7f055d9b6640 1 --2- 172.21.15.49:0/3149798859 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0540005280 0x7f05580ac5a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.164+0000 7f055d9b6640 1 -- 172.21.15.49:0/3149798859 >> 172.21.15.49:0/3149798859 conn(0x7f0558073f60 msgr2=0x7f05580b7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:20.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.164+0000 7f055d9b6640 1 -- 172.21.15.49:0/3149798859 shutdown_connections 2024-09-21T07:10:20.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.164+0000 7f055d9b6640 1 -- 172.21.15.49:0/3149798859 wait complete. 2024-09-21T07:10:20.177 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd new 01334c6d-8f7c-46bd-9d29-2077a1919c62 2 2024-09-21T07:10:20.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.291+0000 7f9c1d663640 1 -- 172.21.15.49:0/2788013168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c180b7a60 msgr2=0x7f9c1815ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.291+0000 7f9c1d663640 1 --2- 172.21.15.49:0/2788013168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c180b7a60 0x7f9c1815ea10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009900 tx=0x7f9c0802a6e0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.291+0000 7f9c1d663640 1 -- 172.21.15.49:0/2788013168 shutdown_connections 2024-09-21T07:10:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.291+0000 7f9c1d663640 1 --2- 172.21.15.49:0/2788013168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c180b7a60 0x7f9c1815ea10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.291+0000 7f9c1d663640 1 -- 172.21.15.49:0/2788013168 >> 172.21.15.49:0/2788013168 conn(0x7f9c18073f60 msgr2=0x7f9c180b6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.291+0000 7f9c1d663640 1 -- 172.21.15.49:0/2788013168 shutdown_connections 2024-09-21T07:10:20.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.291+0000 7f9c1d663640 1 -- 172.21.15.49:0/2788013168 wait complete. 2024-09-21T07:10:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.294+0000 7f9c1d663640 1 Processor -- start 2024-09-21T07:10:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.294+0000 7f9c1d663640 1 -- start start 2024-09-21T07:10:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.296+0000 7f9c1d663640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c180b7a60 0x7f9c180cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.296+0000 7f9c1d663640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9c180d1770 0x7f9c181516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.296+0000 7f9c1d663640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c180d3dc0 0x7f9c181f9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.296+0000 7f9c1d663640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9c180d3610 con 0x7f9c180d3dc0 2024-09-21T07:10:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.296+0000 7f9c1d663640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9c180d3490 con 0x7f9c180b7a60 2024-09-21T07:10:20.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.296+0000 7f9c1d663640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f9c180d3790 con 0x7f9c180d1770 2024-09-21T07:10:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9c167fc640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9c180d1770 0x7f9c181516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9c16ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c180b7a60 0x7f9c180cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9c167fc640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9c180d1770 0x7f9c181516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.49:47548/0 (socket says 172.21.15.49:47548) 2024-09-21T07:10:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9c167fc640 1 -- 172.21.15.49:0/684135811 learned_addr learned my addr 172.21.15.49:0/684135811 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T07:10:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9c16ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c180b7a60 0x7f9c180cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40130/0 (socket says 172.21.15.49:40130) 2024-09-21T07:10:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9c177fe640 1 --2- 172.21.15.49:0/684135811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c180d3dc0 0x7f9c181f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9c167fc640 1 -- 172.21.15.49:0/684135811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c180b7a60 msgr2=0x7f9c180cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9c167fc640 1 --2- 172.21.15.49:0/684135811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c180b7a60 0x7f9c180cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9c167fc640 1 -- 172.21.15.49:0/684135811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c180d3dc0 msgr2=0x7f9c181f9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9c167fc640 1 --2- 172.21.15.49:0/684135811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c180d3dc0 0x7f9c181f9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9c167fc640 1 -- 172.21.15.49:0/684135811 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c18160ab0 con 0x7f9c180d1770 2024-09-21T07:10:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9c167fc640 1 --2- 172.21.15.49:0/684135811 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9c180d1770 0x7f9c181516a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00c460 tx=0x7f9c0c00c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9bff7fe640 1 -- 172.21.15.49:0/684135811 <== mon.2 v2:172.21.15.49:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c017070 con 0x7f9c180d1770 2024-09-21T07:10:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9bff7fe640 1 -- 172.21.15.49:0/684135811 <== mon.2 v2:172.21.15.49:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c0c0053c0 con 0x7f9c180d1770 2024-09-21T07:10:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9c1d663640 1 -- 172.21.15.49:0/684135811 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c18160210 con 0x7f9c180d1770 2024-09-21T07:10:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.297+0000 7f9bff7fe640 1 -- 172.21.15.49:0/684135811 <== mon.2 v2:172.21.15.49:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c0038a0 con 0x7f9c180d1770 2024-09-21T07:10:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.298+0000 7f9c1d663640 1 -- 172.21.15.49:0/684135811 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c181607d0 con 0x7f9c180d1770 2024-09-21T07:10:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.298+0000 7f9bff7fe640 1 -- 172.21.15.49:0/684135811 <== mon.2 v2:172.21.15.49:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9c0c01a070 con 0x7f9c180d1770 2024-09-21T07:10:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.298+0000 7f9bff7fe640 1 -- 172.21.15.49:0/684135811 <== mon.2 v2:172.21.15.49:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f9c0c012cc0 con 0x7f9c180d1770 2024-09-21T07:10:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.299+0000 7f9c1d663640 1 -- 172.21.15.49:0/684135811 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c18077190 con 0x7f9c180d1770 2024-09-21T07:10:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.301+0000 7f9bff7fe640 1 -- 172.21.15.49:0/684135811 <== mon.2 v2:172.21.15.49:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9c18077190 con 0x7f9c180d1770 2024-09-21T07:10:20.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.383+0000 7f9c1d663640 1 -- 172.21.15.49:0/684135811 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "osd new", "uuid": "01334c6d-8f7c-46bd-9d29-2077a1919c62", "id": 2} v 0) -- 0x7f9c1815ea10 con 0x7f9c180d1770 2024-09-21T07:10:20.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.387+0000 7f9bff7fe640 1 -- 172.21.15.49:0/684135811 <== mon.2 v2:172.21.15.49:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01334c6d-8f7c-46bd-9d29-2077a1919c62", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f9c0c021020 con 0x7f9c180d1770 2024-09-21T07:10:20.389 INFO:teuthology.orchestra.run.smithi049.stdout:2 2024-09-21T07:10:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.387+0000 7f9c1d663640 1 -- 172.21.15.49:0/684135811 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9c180d1770 msgr2=0x7f9c181516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.387+0000 7f9c1d663640 1 --2- 172.21.15.49:0/684135811 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9c180d1770 0x7f9c181516a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00c460 tx=0x7f9c0c00c920 comp rx=0 tx=0).stop 2024-09-21T07:10:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.387+0000 7f9c1d663640 1 -- 172.21.15.49:0/684135811 shutdown_connections 2024-09-21T07:10:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.387+0000 7f9c1d663640 1 --2- 172.21.15.49:0/684135811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c180d3dc0 0x7f9c181f9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.387+0000 7f9c1d663640 1 --2- 172.21.15.49:0/684135811 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9c180d1770 0x7f9c181516a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.388+0000 7f9c1d663640 1 --2- 172.21.15.49:0/684135811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c180b7a60 0x7f9c180cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.388+0000 7f9c1d663640 1 -- 172.21.15.49:0/684135811 >> 172.21.15.49:0/684135811 conn(0x7f9c18073f60 msgr2=0x7f9c181571b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.388+0000 7f9c1d663640 1 -- 172.21.15.49:0/684135811 shutdown_connections 2024-09-21T07:10:20.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.388+0000 7f9c1d663640 1 -- 172.21.15.49:0/684135811 wait complete. 2024-09-21T07:10:20.400 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd new 4a9fd998-c17c-470b-bfd7-5fa5afdbef54 3 2024-09-21T07:10:20.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.515+0000 7f1b95216640 1 -- 172.21.15.49:0/3730523855 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1b9006f9b0 msgr2=0x7f1b90074150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.515+0000 7f1b95216640 1 --2- 172.21.15.49:0/3730523855 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1b9006f9b0 0x7f1b90074150 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1b88005fd0 tx=0x7f1b8802a8b0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.515+0000 7f1b95216640 1 -- 172.21.15.49:0/3730523855 shutdown_connections 2024-09-21T07:10:20.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.515+0000 7f1b95216640 1 --2- 172.21.15.49:0/3730523855 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1b9006f9b0 0x7f1b90074150 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.515+0000 7f1b95216640 1 --2- 172.21.15.49:0/3730523855 >> v2:172.21.15.49:3300/0 conn(0x7f1b9006f5a0 0x7f1b90073c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.515+0000 7f1b95216640 1 -- 172.21.15.49:0/3730523855 >> 172.21.15.49:0/3730523855 conn(0x7f1b900d0d10 msgr2=0x7f1b900d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:20.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.515+0000 7f1b95216640 1 -- 172.21.15.49:0/3730523855 shutdown_connections 2024-09-21T07:10:20.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.515+0000 7f1b95216640 1 -- 172.21.15.49:0/3730523855 wait complete. 2024-09-21T07:10:20.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.517+0000 7f1b95216640 1 Processor -- start 2024-09-21T07:10:20.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.517+0000 7f1b95216640 1 -- start start 2024-09-21T07:10:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.518+0000 7f1b95216640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1b9006f5a0 0x7f1b900c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.518+0000 7f1b95216640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b9006f9b0 0x7f1b9014f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.518+0000 7f1b95216640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b9015b870 0x7f1b900cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.518+0000 7f1b95216640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1b900ce120 con 0x7f1b9015b870 2024-09-21T07:10:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.518+0000 7f1b95216640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1b900cdfa0 con 0x7f1b9006f9b0 2024-09-21T07:10:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.518+0000 7f1b95216640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f1b900ce2a0 con 0x7f1b9006f5a0 2024-09-21T07:10:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.518+0000 7f1b8ed9d640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1b9006f5a0 0x7f1b900c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.518+0000 7f1b8e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b9006f9b0 0x7f1b9014f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.518+0000 7f1b8ed9d640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1b9006f5a0 0x7f1b900c9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.49:47558/0 (socket says 172.21.15.49:47558) 2024-09-21T07:10:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.518+0000 7f1b8ed9d640 1 -- 172.21.15.49:0/791755409 learned_addr learned my addr 172.21.15.49:0/791755409 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T07:10:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.519+0000 7f1b8f59e640 1 --2- 172.21.15.49:0/791755409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b9015b870 0x7f1b900cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:20.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.519+0000 7f1b8e59c640 1 -- 172.21.15.49:0/791755409 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1b9006f5a0 msgr2=0x7f1b900c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.519+0000 7f1b8e59c640 1 --2- 172.21.15.49:0/791755409 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1b9006f5a0 0x7f1b900c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.519+0000 7f1b8e59c640 1 -- 172.21.15.49:0/791755409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b9015b870 msgr2=0x7f1b900cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.519+0000 7f1b8e59c640 1 --2- 172.21.15.49:0/791755409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b9015b870 0x7f1b900cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.519+0000 7f1b8e59c640 1 -- 172.21.15.49:0/791755409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b900ca460 con 0x7f1b9006f9b0 2024-09-21T07:10:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.519+0000 7f1b8ed9d640 1 --2- 172.21.15.49:0/791755409 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1b9006f5a0 0x7f1b900c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.519+0000 7f1b8e59c640 1 --2- 172.21.15.49:0/791755409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b9006f9b0 0x7f1b9014f640 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000e9f0 tx=0x7f1b8000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.519+0000 7f1b777fe640 1 -- 172.21.15.49:0/791755409 <== mon.1 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8000ccc0 con 0x7f1b9006f9b0 2024-09-21T07:10:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.519+0000 7f1b777fe640 1 -- 172.21.15.49:0/791755409 <== mon.1 v2:172.21.15.49:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b80004020 con 0x7f1b9006f9b0 2024-09-21T07:10:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.519+0000 7f1b95216640 1 -- 172.21.15.49:0/791755409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b9014ff00 con 0x7f1b9006f9b0 2024-09-21T07:10:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.519+0000 7f1b777fe640 1 -- 172.21.15.49:0/791755409 <== mon.1 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8000ce60 con 0x7f1b9006f9b0 2024-09-21T07:10:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.519+0000 7f1b95216640 1 -- 172.21.15.49:0/791755409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b901504c0 con 0x7f1b9006f9b0 2024-09-21T07:10:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.520+0000 7f1b777fe640 1 -- 172.21.15.49:0/791755409 <== mon.1 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1b80004b50 con 0x7f1b9006f9b0 2024-09-21T07:10:20.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.520+0000 7f1b777fe640 1 -- 172.21.15.49:0/791755409 <== mon.1 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1b800054b0 con 0x7f1b9006f9b0 2024-09-21T07:10:20.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.520+0000 7f1b95216640 1 -- 172.21.15.49:0/791755409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b900ce730 con 0x7f1b9006f9b0 2024-09-21T07:10:20.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.522+0000 7f1b777fe640 1 -- 172.21.15.49:0/791755409 <== mon.1 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1b80009390 con 0x7f1b9006f9b0 2024-09-21T07:10:20.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.594+0000 7f1b95216640 1 -- 172.21.15.49:0/791755409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4a9fd998-c17c-470b-bfd7-5fa5afdbef54", "id": 3} v 0) -- 0x7f1b900d12c0 con 0x7f1b9006f9b0 2024-09-21T07:10:20.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.598+0000 7f1b777fe640 1 -- 172.21.15.49:0/791755409 <== mon.1 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4a9fd998-c17c-470b-bfd7-5fa5afdbef54", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1b80005020 con 0x7f1b9006f9b0 2024-09-21T07:10:20.601 INFO:teuthology.orchestra.run.smithi049.stdout:3 2024-09-21T07:10:20.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.599+0000 7f1b95216640 1 -- 172.21.15.49:0/791755409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b9006f9b0 msgr2=0x7f1b9014f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.599+0000 7f1b95216640 1 --2- 172.21.15.49:0/791755409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b9006f9b0 0x7f1b9014f640 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000e9f0 tx=0x7f1b8000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.599+0000 7f1b95216640 1 -- 172.21.15.49:0/791755409 shutdown_connections 2024-09-21T07:10:20.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.599+0000 7f1b95216640 1 --2- 172.21.15.49:0/791755409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b9015b870 0x7f1b900cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.599+0000 7f1b95216640 1 --2- 172.21.15.49:0/791755409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b9006f9b0 0x7f1b9014f640 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.599+0000 7f1b95216640 1 --2- 172.21.15.49:0/791755409 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1b9006f5a0 0x7f1b900c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.599+0000 7f1b95216640 1 -- 172.21.15.49:0/791755409 >> 172.21.15.49:0/791755409 conn(0x7f1b900d0d10 msgr2=0x7f1b90072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:20.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.599+0000 7f1b95216640 1 -- 172.21.15.49:0/791755409 shutdown_connections 2024-09-21T07:10:20.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.600+0000 7f1b95216640 1 -- 172.21.15.49:0/791755409 wait complete. 2024-09-21T07:10:20.612 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd new 97f7cc69-c331-487c-b458-95a6bf18d474 4 2024-09-21T07:10:20.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.727+0000 7f59b7d69640 1 -- 172.21.15.49:0/3424224794 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f59b006f8c0 msgr2=0x7f59b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.727+0000 7f59b7d69640 1 --2- 172.21.15.49:0/3424224794 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f59b006f8c0 0x7f59b006d300 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f59a8005fd0 tx=0x7f59a802a8b0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.727+0000 7f59b7d69640 1 -- 172.21.15.49:0/3424224794 shutdown_connections 2024-09-21T07:10:20.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.727+0000 7f59b7d69640 1 --2- 172.21.15.49:0/3424224794 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f59b006f8c0 0x7f59b006d300 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.727+0000 7f59b7d69640 1 --2- 172.21.15.49:0/3424224794 >> v2:172.21.15.18:3300/0 conn(0x7f59b006e220 0x7f59b006f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.727+0000 7f59b7d69640 1 -- 172.21.15.49:0/3424224794 >> 172.21.15.49:0/3424224794 conn(0x7f59b00b3a40 msgr2=0x7f59b00d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:20.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.727+0000 7f59b7d69640 1 -- 172.21.15.49:0/3424224794 shutdown_connections 2024-09-21T07:10:20.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.727+0000 7f59b7d69640 1 -- 172.21.15.49:0/3424224794 wait complete. 2024-09-21T07:10:20.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.729+0000 7f59b7d69640 1 Processor -- start 2024-09-21T07:10:20.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.729+0000 7f59b7d69640 1 -- start start 2024-09-21T07:10:20.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b7d69640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59b006e220 0x7f59b00ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:20.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b7d69640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f59b006f8c0 0x7f59b00c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:20.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b7d69640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59b00cd9f0 0x7f59b01f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:20.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b7d69640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f59b0068ec0 con 0x7f59b00cd9f0 2024-09-21T07:10:20.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b7d69640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f59b0068d40 con 0x7f59b006e220 2024-09-21T07:10:20.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b7d69640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f59b0069040 con 0x7f59b006f8c0 2024-09-21T07:10:20.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b5b05640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59b006e220 0x7f59b00ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:20.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b5304640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f59b006f8c0 0x7f59b00c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:20.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b5b05640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59b006e220 0x7f59b00ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40156/0 (socket says 172.21.15.49:40156) 2024-09-21T07:10:20.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b5b05640 1 -- 172.21.15.49:0/3160613433 learned_addr learned my addr 172.21.15.49:0/3160613433 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T07:10:20.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b5304640 1 --2- 172.21.15.49:0/3160613433 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f59b006f8c0 0x7f59b00c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.49:47580/0 (socket says 172.21.15.49:47580) 2024-09-21T07:10:20.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b6306640 1 --2- 172.21.15.49:0/3160613433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59b00cd9f0 0x7f59b01f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:20.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b5b05640 1 -- 172.21.15.49:0/3160613433 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f59b006f8c0 msgr2=0x7f59b00c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b5b05640 1 --2- 172.21.15.49:0/3160613433 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f59b006f8c0 0x7f59b00c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b5b05640 1 -- 172.21.15.49:0/3160613433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59b00cd9f0 msgr2=0x7f59b01f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.730+0000 7f59b5b05640 1 --2- 172.21.15.49:0/3160613433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59b00cd9f0 0x7f59b01f6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.731+0000 7f59b5b05640 1 -- 172.21.15.49:0/3160613433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b015c560 con 0x7f59b006e220 2024-09-21T07:10:20.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.731+0000 7f59b5304640 1 --2- 172.21.15.49:0/3160613433 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f59b006f8c0 0x7f59b00c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:20.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.731+0000 7f59b5b05640 1 --2- 172.21.15.49:0/3160613433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59b006e220 0x7f59b00ccfd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00c3e0 tx=0x7f59ac00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:20.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.731+0000 7f59a27fc640 1 -- 172.21.15.49:0/3160613433 <== mon.1 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac011790 con 0x7f59b006e220 2024-09-21T07:10:20.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.731+0000 7f59a27fc640 1 -- 172.21.15.49:0/3160613433 <== mon.1 v2:172.21.15.49:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59ac017070 con 0x7f59b006e220 2024-09-21T07:10:20.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.731+0000 7f59b7d69640 1 -- 172.21.15.49:0/3160613433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b00abf20 con 0x7f59b006e220 2024-09-21T07:10:20.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.731+0000 7f59a27fc640 1 -- 172.21.15.49:0/3160613433 <== mon.1 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac011ce0 con 0x7f59b006e220 2024-09-21T07:10:20.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.731+0000 7f59b7d69640 1 -- 172.21.15.49:0/3160613433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b00ac4e0 con 0x7f59b006e220 2024-09-21T07:10:20.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.731+0000 7f59a27fc640 1 -- 172.21.15.49:0/3160613433 <== mon.1 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f59ac01c460 con 0x7f59b006e220 2024-09-21T07:10:20.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.731+0000 7f59a27fc640 1 -- 172.21.15.49:0/3160613433 <== mon.1 v2:172.21.15.49:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f59ac012cf0 con 0x7f59b006e220 2024-09-21T07:10:20.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.732+0000 7f59b7d69640 1 -- 172.21.15.49:0/3160613433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b00694f0 con 0x7f59b006e220 2024-09-21T07:10:20.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.734+0000 7f59a27fc640 1 -- 172.21.15.49:0/3160613433 <== mon.1 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f59ac0127e0 con 0x7f59b006e220 2024-09-21T07:10:20.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.807+0000 7f59b7d69640 1 -- 172.21.15.49:0/3160613433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd new", "uuid": "97f7cc69-c331-487c-b458-95a6bf18d474", "id": 4} v 0) -- 0x7f59b00d1480 con 0x7f59b006e220 2024-09-21T07:10:20.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.811+0000 7f59a27fc640 1 -- 172.21.15.49:0/3160613433 <== mon.1 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "97f7cc69-c331-487c-b458-95a6bf18d474", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f59ac0129c0 con 0x7f59b006e220 2024-09-21T07:10:20.813 INFO:teuthology.orchestra.run.smithi049.stdout:4 2024-09-21T07:10:20.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.812+0000 7f59b7d69640 1 -- 172.21.15.49:0/3160613433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59b006e220 msgr2=0x7f59b00ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.812+0000 7f59b7d69640 1 --2- 172.21.15.49:0/3160613433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59b006e220 0x7f59b00ccfd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00c3e0 tx=0x7f59ac00c8a0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.812+0000 7f59b7d69640 1 -- 172.21.15.49:0/3160613433 shutdown_connections 2024-09-21T07:10:20.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.812+0000 7f59b7d69640 1 --2- 172.21.15.49:0/3160613433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59b00cd9f0 0x7f59b01f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.812+0000 7f59b7d69640 1 --2- 172.21.15.49:0/3160613433 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f59b006f8c0 0x7f59b00c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.812+0000 7f59b7d69640 1 --2- 172.21.15.49:0/3160613433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59b006e220 0x7f59b00ccfd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.812+0000 7f59b7d69640 1 -- 172.21.15.49:0/3160613433 >> 172.21.15.49:0/3160613433 conn(0x7f59b00b3a40 msgr2=0x7f59b014fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:20.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.812+0000 7f59b7d69640 1 -- 172.21.15.49:0/3160613433 shutdown_connections 2024-09-21T07:10:20.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.812+0000 7f59b7d69640 1 -- 172.21.15.49:0/3160613433 wait complete. 2024-09-21T07:10:20.825 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd new 225d9626-3dbe-4db5-8f17-92f7b7b7b315 5 2024-09-21T07:10:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.938+0000 7f6dc8db6640 1 -- 172.21.15.49:0/1612433724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc40d05d0 msgr2=0x7f6dc415ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.938+0000 7f6dc8db6640 1 --2- 172.21.15.49:0/1612433724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc40d05d0 0x7f6dc415ff80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4074f80 tx=0x7f6dbc02ab40 comp rx=0 tx=0).stop 2024-09-21T07:10:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.938+0000 7f6dc8db6640 1 -- 172.21.15.49:0/1612433724 shutdown_connections 2024-09-21T07:10:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.938+0000 7f6dc8db6640 1 --2- 172.21.15.49:0/1612433724 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc40d05d0 0x7f6dc415ff80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.938+0000 7f6dc8db6640 1 -- 172.21.15.49:0/1612433724 >> 172.21.15.49:0/1612433724 conn(0x7f6dc40d0d70 msgr2=0x7f6dc40d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.938+0000 7f6dc8db6640 1 -- 172.21.15.49:0/1612433724 shutdown_connections 2024-09-21T07:10:20.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.938+0000 7f6dc8db6640 1 -- 172.21.15.49:0/1612433724 wait complete. 2024-09-21T07:10:20.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.940+0000 7f6dc8db6640 1 Processor -- start 2024-09-21T07:10:20.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.940+0000 7f6dc8db6640 1 -- start start 2024-09-21T07:10:20.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.941+0000 7f6dc8db6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dc4070090 0x7f6dc40cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:20.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.941+0000 7f6dc8db6640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6dc40d05d0 0x7f6dc40cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:20.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.941+0000 7f6dc8db6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc4159560 0x7f6dc41f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:20.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.941+0000 7f6dc8db6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc415c590 con 0x7f6dc4070090 2024-09-21T07:10:20.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.941+0000 7f6dc8db6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc4073990 con 0x7f6dc4159560 2024-09-21T07:10:20.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.941+0000 7f6dc8db6640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc415c710 con 0x7f6dc40d05d0 2024-09-21T07:10:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.942+0000 7f6dc2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc4159560 0x7f6dc41f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.942+0000 7f6dc1d9b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6dc40d05d0 0x7f6dc40cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.942+0000 7f6dc2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc4159560 0x7f6dc41f3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40186/0 (socket says 172.21.15.49:40186) 2024-09-21T07:10:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.942+0000 7f6dc2d9d640 1 -- 172.21.15.49:0/1686959990 learned_addr learned my addr 172.21.15.49:0/1686959990 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T07:10:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.942+0000 7f6dc259c640 1 --2- 172.21.15.49:0/1686959990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dc4070090 0x7f6dc40cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.942+0000 7f6dc2d9d640 1 -- 172.21.15.49:0/1686959990 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6dc40d05d0 msgr2=0x7f6dc40cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.942+0000 7f6dc2d9d640 1 --2- 172.21.15.49:0/1686959990 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6dc40d05d0 0x7f6dc40cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.942+0000 7f6dc2d9d640 1 -- 172.21.15.49:0/1686959990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dc4070090 msgr2=0x7f6dc40cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.942+0000 7f6dc2d9d640 1 --2- 172.21.15.49:0/1686959990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dc4070090 0x7f6dc40cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.942+0000 7f6dc2d9d640 1 -- 172.21.15.49:0/1686959990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc41f7f60 con 0x7f6dc4159560 2024-09-21T07:10:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.942+0000 7f6dc1d9b640 1 --2- 172.21.15.49:0/1686959990 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6dc40d05d0 0x7f6dc40cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.942+0000 7f6dc259c640 1 --2- 172.21.15.49:0/1686959990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dc4070090 0x7f6dc40cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.942+0000 7f6dc2d9d640 1 --2- 172.21.15.49:0/1686959990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc4159560 0x7f6dc41f3e30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc02b130 tx=0x7f6dbc02c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:20.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.942+0000 7f6db2ffd640 1 -- 172.21.15.49:0/1686959990 <== mon.1 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc004250 con 0x7f6dc4159560 2024-09-21T07:10:20.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.942+0000 7f6db2ffd640 1 -- 172.21.15.49:0/1686959990 <== mon.1 v2:172.21.15.49:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dbc0043f0 con 0x7f6dc4159560 2024-09-21T07:10:20.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.943+0000 7f6dc8db6640 1 -- 172.21.15.49:0/1686959990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc41f73e0 con 0x7f6dc4159560 2024-09-21T07:10:20.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.943+0000 7f6db2ffd640 1 -- 172.21.15.49:0/1686959990 <== mon.1 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc004800 con 0x7f6dc4159560 2024-09-21T07:10:20.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.943+0000 7f6dc8db6640 1 -- 172.21.15.49:0/1686959990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc41f79a0 con 0x7f6dc4159560 2024-09-21T07:10:20.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.943+0000 7f6db2ffd640 1 -- 172.21.15.49:0/1686959990 <== mon.1 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6dbc02d470 con 0x7f6dc4159560 2024-09-21T07:10:20.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.943+0000 7f6db2ffd640 1 -- 172.21.15.49:0/1686959990 <== mon.1 v2:172.21.15.49:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f6dbc0499b0 con 0x7f6dc4159560 2024-09-21T07:10:20.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.944+0000 7f6dc8db6640 1 -- 172.21.15.49:0/1686959990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc415ff80 con 0x7f6dc4159560 2024-09-21T07:10:20.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:20.946+0000 7f6db2ffd640 1 -- 172.21.15.49:0/1686959990 <== mon.1 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6dbc032030 con 0x7f6dc4159560 2024-09-21T07:10:21.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.018+0000 7f6dc8db6640 1 -- 172.21.15.49:0/1686959990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd new", "uuid": "225d9626-3dbe-4db5-8f17-92f7b7b7b315", "id": 5} v 0) -- 0x7f6dc4073e20 con 0x7f6dc4159560 2024-09-21T07:10:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.021+0000 7f6db2ffd640 1 -- 172.21.15.49:0/1686959990 <== mon.1 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "225d9626-3dbe-4db5-8f17-92f7b7b7b315", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f6dbc049bb0 con 0x7f6dc4159560 2024-09-21T07:10:21.024 INFO:teuthology.orchestra.run.smithi049.stdout:5 2024-09-21T07:10:21.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.022+0000 7f6dc8db6640 1 -- 172.21.15.49:0/1686959990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc4159560 msgr2=0x7f6dc41f3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:21.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.022+0000 7f6dc8db6640 1 --2- 172.21.15.49:0/1686959990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc4159560 0x7f6dc41f3e30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc02b130 tx=0x7f6dbc02c8b0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.022+0000 7f6dc8db6640 1 -- 172.21.15.49:0/1686959990 shutdown_connections 2024-09-21T07:10:21.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.022+0000 7f6dc8db6640 1 --2- 172.21.15.49:0/1686959990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dc4159560 0x7f6dc41f3e30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.022+0000 7f6dc8db6640 1 --2- 172.21.15.49:0/1686959990 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6dc40d05d0 0x7f6dc40cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.022+0000 7f6dc8db6640 1 --2- 172.21.15.49:0/1686959990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dc4070090 0x7f6dc40cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.022+0000 7f6dc8db6640 1 -- 172.21.15.49:0/1686959990 >> 172.21.15.49:0/1686959990 conn(0x7f6dc40d0d70 msgr2=0x7f6dc40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:21.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.022+0000 7f6dc8db6640 1 -- 172.21.15.49:0/1686959990 shutdown_connections 2024-09-21T07:10:21.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.022+0000 7f6dc8db6640 1 -- 172.21.15.49:0/1686959990 wait complete. 2024-09-21T07:10:21.035 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd new d8cb64cb-22da-4a12-a567-0d7cc022b638 6 2024-09-21T07:10:21.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.148+0000 7f2a7374a640 1 -- 172.21.15.49:0/2093827398 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2a6c0d05d0 msgr2=0x7f2a6c15ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:21.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.148+0000 7f2a7374a640 1 --2- 172.21.15.49:0/2093827398 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2a6c0d05d0 0x7f2a6c15ff80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009be0 tx=0x7f2a6402a920 comp rx=0 tx=0).stop 2024-09-21T07:10:21.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.148+0000 7f2a7374a640 1 -- 172.21.15.49:0/2093827398 shutdown_connections 2024-09-21T07:10:21.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.148+0000 7f2a7374a640 1 --2- 172.21.15.49:0/2093827398 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2a6c0d05d0 0x7f2a6c15ff80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.148+0000 7f2a7374a640 1 -- 172.21.15.49:0/2093827398 >> 172.21.15.49:0/2093827398 conn(0x7f2a6c0d0d70 msgr2=0x7f2a6c0d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:21.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.148+0000 7f2a7374a640 1 -- 172.21.15.49:0/2093827398 shutdown_connections 2024-09-21T07:10:21.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.148+0000 7f2a7374a640 1 -- 172.21.15.49:0/2093827398 wait complete. 2024-09-21T07:10:21.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.150+0000 7f2a7374a640 1 Processor -- start 2024-09-21T07:10:21.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.150+0000 7f2a7374a640 1 -- start start 2024-09-21T07:10:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.151+0000 7f2a7374a640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2a6c070090 0x7f2a6c14f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.151+0000 7f2a7374a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a6c0d05d0 0x7f2a6c0cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.151+0000 7f2a7374a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a6c0cfe20 0x7f2a6c1e7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.151+0000 7f2a7374a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c15c590 con 0x7f2a6c0cfe20 2024-09-21T07:10:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.151+0000 7f2a7374a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c15c710 con 0x7f2a6c0d05d0 2024-09-21T07:10:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.151+0000 7f2a7374a640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f2a6c15c890 con 0x7f2a6c070090 2024-09-21T07:10:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.151+0000 7f2a70ce5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a6c0d05d0 0x7f2a6c0cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.152+0000 7f2a70ce5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a6c0d05d0 0x7f2a6c0cf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40188/0 (socket says 172.21.15.49:40188) 2024-09-21T07:10:21.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.152+0000 7f2a70ce5640 1 -- 172.21.15.49:0/2952617207 learned_addr learned my addr 172.21.15.49:0/2952617207 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T07:10:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.152+0000 7f2a71ce7640 1 --2- 172.21.15.49:0/2952617207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a6c0cfe20 0x7f2a6c1e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.152+0000 7f2a714e6640 1 --2- 172.21.15.49:0/2952617207 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2a6c070090 0x7f2a6c14f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.152+0000 7f2a70ce5640 1 -- 172.21.15.49:0/2952617207 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2a6c070090 msgr2=0x7f2a6c14f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.152+0000 7f2a70ce5640 1 --2- 172.21.15.49:0/2952617207 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2a6c070090 0x7f2a6c14f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.152+0000 7f2a70ce5640 1 -- 172.21.15.49:0/2952617207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a6c0cfe20 msgr2=0x7f2a6c1e7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.152+0000 7f2a70ce5640 1 --2- 172.21.15.49:0/2952617207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a6c0cfe20 0x7f2a6c1e7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.152+0000 7f2a70ce5640 1 -- 172.21.15.49:0/2952617207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6c0cde70 con 0x7f2a6c0d05d0 2024-09-21T07:10:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.152+0000 7f2a71ce7640 1 --2- 172.21.15.49:0/2952617207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a6c0cfe20 0x7f2a6c1e7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.152+0000 7f2a70ce5640 1 --2- 172.21.15.49:0/2952617207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a6c0d05d0 0x7f2a6c0cf8e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2a600017a0 tx=0x7f2a60001c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.152+0000 7f2a5dffb640 1 -- 172.21.15.49:0/2952617207 <== mon.1 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a600050d0 con 0x7f2a6c0d05d0 2024-09-21T07:10:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.152+0000 7f2a5dffb640 1 -- 172.21.15.49:0/2952617207 <== mon.1 v2:172.21.15.49:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a60005360 con 0x7f2a6c0d05d0 2024-09-21T07:10:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.152+0000 7f2a7374a640 1 -- 172.21.15.49:0/2952617207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a6c1f2c30 con 0x7f2a6c0d05d0 2024-09-21T07:10:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.152+0000 7f2a5dffb640 1 -- 172.21.15.49:0/2952617207 <== mon.1 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6000a8a0 con 0x7f2a6c0d05d0 2024-09-21T07:10:21.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.153+0000 7f2a5dffb640 1 -- 172.21.15.49:0/2952617207 <== mon.1 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2a600035f0 con 0x7f2a6c0d05d0 2024-09-21T07:10:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.153+0000 7f2a7374a640 1 -- 172.21.15.49:0/2952617207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a6c1f31f0 con 0x7f2a6c0d05d0 2024-09-21T07:10:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.153+0000 7f2a5dffb640 1 -- 172.21.15.49:0/2952617207 <== mon.1 v2:172.21.15.49:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f2a6000add0 con 0x7f2a6c0d05d0 2024-09-21T07:10:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.153+0000 7f2a7374a640 1 -- 172.21.15.49:0/2952617207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a6c1f3840 con 0x7f2a6c0d05d0 2024-09-21T07:10:21.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.156+0000 7f2a5dffb640 1 -- 172.21.15.49:0/2952617207 <== mon.1 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2a600038e0 con 0x7f2a6c0d05d0 2024-09-21T07:10:21.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.228+0000 7f2a7374a640 1 -- 172.21.15.49:0/2952617207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d8cb64cb-22da-4a12-a567-0d7cc022b638", "id": 6} v 0) -- 0x7f2a6c15ff80 con 0x7f2a6c0d05d0 2024-09-21T07:10:21.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.231+0000 7f2a5dffb640 1 -- 172.21.15.49:0/2952617207 <== mon.1 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d8cb64cb-22da-4a12-a567-0d7cc022b638", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f2a60003ac0 con 0x7f2a6c0d05d0 2024-09-21T07:10:21.234 INFO:teuthology.orchestra.run.smithi049.stdout:6 2024-09-21T07:10:21.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.233+0000 7f2a7374a640 1 -- 172.21.15.49:0/2952617207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a6c0d05d0 msgr2=0x7f2a6c0cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:21.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.233+0000 7f2a7374a640 1 --2- 172.21.15.49:0/2952617207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a6c0d05d0 0x7f2a6c0cf8e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2a600017a0 tx=0x7f2a60001c60 comp rx=0 tx=0).stop 2024-09-21T07:10:21.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.233+0000 7f2a7374a640 1 -- 172.21.15.49:0/2952617207 shutdown_connections 2024-09-21T07:10:21.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.233+0000 7f2a7374a640 1 --2- 172.21.15.49:0/2952617207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a6c0cfe20 0x7f2a6c1e7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.233+0000 7f2a7374a640 1 --2- 172.21.15.49:0/2952617207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a6c0d05d0 0x7f2a6c0cf8e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.233+0000 7f2a7374a640 1 --2- 172.21.15.49:0/2952617207 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2a6c070090 0x7f2a6c14f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.233+0000 7f2a7374a640 1 -- 172.21.15.49:0/2952617207 >> 172.21.15.49:0/2952617207 conn(0x7f2a6c0d0d70 msgr2=0x7f2a6c152530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:21.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.233+0000 7f2a7374a640 1 -- 172.21.15.49:0/2952617207 shutdown_connections 2024-09-21T07:10:21.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.233+0000 7f2a7374a640 1 -- 172.21.15.49:0/2952617207 wait complete. 2024-09-21T07:10:21.246 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd new daad8f96-b2d9-4d12-ac59-07e9d7fa876d 7 2024-09-21T07:10:21.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.359+0000 7facce4cc640 1 -- 172.21.15.49:0/1982135157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc815ce70 msgr2=0x7facc80d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.359+0000 7facce4cc640 1 --2- 172.21.15.49:0/1982135157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc815ce70 0x7facc80d0ec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7facb0009830 tx=0x7facb002a510 comp rx=0 tx=0).stop 2024-09-21T07:10:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.359+0000 7facce4cc640 1 -- 172.21.15.49:0/1982135157 shutdown_connections 2024-09-21T07:10:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.359+0000 7facce4cc640 1 --2- 172.21.15.49:0/1982135157 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7facc815f9b0 0x7facc80d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.359+0000 7facce4cc640 1 --2- 172.21.15.49:0/1982135157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc815ce70 0x7facc80d0ec0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.359+0000 7facce4cc640 1 -- 172.21.15.49:0/1982135157 >> 172.21.15.49:0/1982135157 conn(0x7facc80739d0 msgr2=0x7facc8073e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.359+0000 7facce4cc640 1 -- 172.21.15.49:0/1982135157 shutdown_connections 2024-09-21T07:10:21.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.359+0000 7facce4cc640 1 -- 172.21.15.49:0/1982135157 wait complete. 2024-09-21T07:10:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.361+0000 7facce4cc640 1 Processor -- start 2024-09-21T07:10:21.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.361+0000 7facce4cc640 1 -- start start 2024-09-21T07:10:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.362+0000 7facce4cc640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7facc80cddb0 0x7facc8154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.362+0000 7facce4cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc815ce70 0x7facc80711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.362+0000 7facce4cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc81e9bf0 0x7facc8071720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.362+0000 7facce4cc640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7facc815e8f0 con 0x7facc815ce70 2024-09-21T07:10:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.362+0000 7facce4cc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7facc815e770 con 0x7facc81e9bf0 2024-09-21T07:10:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.362+0000 7facce4cc640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7facc815ea70 con 0x7facc80cddb0 2024-09-21T07:10:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.362+0000 7faccca69640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc81e9bf0 0x7facc8071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.362+0000 7facc7fff640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7facc80cddb0 0x7facc8154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.362+0000 7faccca69640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc81e9bf0 0x7facc8071720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40192/0 (socket says 172.21.15.49:40192) 2024-09-21T07:10:21.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.362+0000 7facc7fff640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7facc80cddb0 0x7facc8154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.49:47618/0 (socket says 172.21.15.49:47618) 2024-09-21T07:10:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.362+0000 7faccca69640 1 -- 172.21.15.49:0/870709795 learned_addr learned my addr 172.21.15.49:0/870709795 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T07:10:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.363+0000 7facc77fe640 1 --2- 172.21.15.49:0/870709795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc815ce70 0x7facc80711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.363+0000 7faccca69640 1 -- 172.21.15.49:0/870709795 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7facc80cddb0 msgr2=0x7facc8154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.363+0000 7faccca69640 1 --2- 172.21.15.49:0/870709795 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7facc80cddb0 0x7facc8154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.363+0000 7faccca69640 1 -- 172.21.15.49:0/870709795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc815ce70 msgr2=0x7facc80711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.363+0000 7faccca69640 1 --2- 172.21.15.49:0/870709795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc815ce70 0x7facc80711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.363+0000 7faccca69640 1 -- 172.21.15.49:0/870709795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc8154a60 con 0x7facc81e9bf0 2024-09-21T07:10:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.363+0000 7facc7fff640 1 --2- 172.21.15.49:0/870709795 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7facc80cddb0 0x7facc8154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.363+0000 7faccca69640 1 --2- 172.21.15.49:0/870709795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc81e9bf0 0x7facc8071720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7facc0009f80 tx=0x7facc000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.363+0000 7facc4ff9640 1 -- 172.21.15.49:0/870709795 <== mon.1 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0003970 con 0x7facc81e9bf0 2024-09-21T07:10:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.363+0000 7facce4cc640 1 -- 172.21.15.49:0/870709795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc8070140 con 0x7facc81e9bf0 2024-09-21T07:10:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.363+0000 7facc4ff9640 1 -- 172.21.15.49:0/870709795 <== mon.1 v2:172.21.15.49:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7facc0003c20 con 0x7facc81e9bf0 2024-09-21T07:10:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.363+0000 7facc4ff9640 1 -- 172.21.15.49:0/870709795 <== mon.1 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0004280 con 0x7facc81e9bf0 2024-09-21T07:10:21.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.363+0000 7facce4cc640 1 -- 172.21.15.49:0/870709795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc8070700 con 0x7facc81e9bf0 2024-09-21T07:10:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.363+0000 7facc4ff9640 1 -- 172.21.15.49:0/870709795 <== mon.1 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7facc001d020 con 0x7facc81e9bf0 2024-09-21T07:10:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.364+0000 7facc4ff9640 1 -- 172.21.15.49:0/870709795 <== mon.1 v2:172.21.15.49:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7facc0005680 con 0x7facc81e9bf0 2024-09-21T07:10:21.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.364+0000 7facce4cc640 1 -- 172.21.15.49:0/870709795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc81ea140 con 0x7facc81e9bf0 2024-09-21T07:10:21.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.368+0000 7facc4ff9640 1 -- 172.21.15.49:0/870709795 <== mon.1 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7facc0024070 con 0x7facc81e9bf0 2024-09-21T07:10:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.441+0000 7facce4cc640 1 -- 172.21.15.49:0/870709795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd new", "uuid": "daad8f96-b2d9-4d12-ac59-07e9d7fa876d", "id": 7} v 0) -- 0x7facc806a820 con 0x7facc81e9bf0 2024-09-21T07:10:21.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.444+0000 7facc4ff9640 1 -- 172.21.15.49:0/870709795 <== mon.1 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "daad8f96-b2d9-4d12-ac59-07e9d7fa876d", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7facc806a820 con 0x7facc81e9bf0 2024-09-21T07:10:21.447 INFO:teuthology.orchestra.run.smithi049.stdout:7 2024-09-21T07:10:21.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.445+0000 7facce4cc640 1 -- 172.21.15.49:0/870709795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc81e9bf0 msgr2=0x7facc8071720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:21.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.445+0000 7facce4cc640 1 --2- 172.21.15.49:0/870709795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc81e9bf0 0x7facc8071720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7facc0009f80 tx=0x7facc000c800 comp rx=0 tx=0).stop 2024-09-21T07:10:21.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.445+0000 7facce4cc640 1 -- 172.21.15.49:0/870709795 shutdown_connections 2024-09-21T07:10:21.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.445+0000 7facce4cc640 1 --2- 172.21.15.49:0/870709795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc81e9bf0 0x7facc8071720 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.445+0000 7facce4cc640 1 --2- 172.21.15.49:0/870709795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc815ce70 0x7facc80711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.445+0000 7facce4cc640 1 --2- 172.21.15.49:0/870709795 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7facc80cddb0 0x7facc8154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.445+0000 7facce4cc640 1 -- 172.21.15.49:0/870709795 >> 172.21.15.49:0/870709795 conn(0x7facc80739d0 msgr2=0x7facc8155690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:21.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.445+0000 7facce4cc640 1 -- 172.21.15.49:0/870709795 shutdown_connections 2024-09-21T07:10:21.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:10:21.446+0000 7facce4cc640 1 -- 172.21.15.49:0/870709795 wait complete. 2024-09-21T07:10:21.458 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T07:10:21.458 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-21T07:10:21.461 INFO:tasks.ceph.osd.0:Started 2024-09-21T07:10:21.461 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T07:10:21.461 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-21T07:10:21.463 INFO:tasks.ceph.osd.1:Started 2024-09-21T07:10:21.463 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T07:10:21.463 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-21T07:10:21.465 INFO:tasks.ceph.osd.2:Started 2024-09-21T07:10:21.465 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T07:10:21.465 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T07:10:21.467 INFO:tasks.ceph.osd.3:Started 2024-09-21T07:10:21.467 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-21T07:10:21.468 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-21T07:10:21.470 INFO:tasks.ceph.osd.4:Started 2024-09-21T07:10:21.470 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-21T07:10:21.470 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-21T07:10:21.472 INFO:tasks.ceph.osd.5:Started 2024-09-21T07:10:21.472 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-21T07:10:21.472 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-21T07:10:21.474 INFO:tasks.ceph.osd.6:Started 2024-09-21T07:10:21.474 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-21T07:10:21.474 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-21T07:10:21.476 INFO:tasks.ceph.osd.7:Started 2024-09-21T07:10:21.477 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:10:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.621+0000 7f55e748b640 1 -- 172.21.15.18:0/625055845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e00709b0 msgr2=0x7f55e015d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.621+0000 7f55e748b640 1 --2- 172.21.15.18:0/625055845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e00709b0 0x7f55e015d0f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f55d8005fd0 tx=0x7f55d802a8b0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.621+0000 7f55e748b640 1 -- 172.21.15.18:0/625055845 shutdown_connections 2024-09-21T07:10:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.621+0000 7f55e748b640 1 --2- 172.21.15.18:0/625055845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e00709b0 0x7f55e015d0f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.621+0000 7f55e748b640 1 --2- 172.21.15.18:0/625055845 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f55e00afe70 0x7f55e0070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.621+0000 7f55e748b640 1 -- 172.21.15.18:0/625055845 >> 172.21.15.18:0/625055845 conn(0x7f55e009ba60 msgr2=0x7f55e00b78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:21.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.621+0000 7f55e748b640 1 -- 172.21.15.18:0/625055845 shutdown_connections 2024-09-21T07:10:21.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.621+0000 7f55e748b640 1 -- 172.21.15.18:0/625055845 wait complete. 2024-09-21T07:10:21.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.623+0000 7f55e748b640 1 Processor -- start 2024-09-21T07:10:21.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.623+0000 7f55e748b640 1 -- start start 2024-09-21T07:10:21.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.624+0000 7f55e748b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55e00709b0 0x7f55e0139490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:21.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.624+0000 7f55e748b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e00afe70 0x7f55e0159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:21.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.624+0000 7f55e748b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f55e00b6a00 0x7f55e01f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:21.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.624+0000 7f55e748b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f55e015d630 con 0x7f55e00709b0 2024-09-21T07:10:21.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.624+0000 7f55e748b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f55e015d7b0 con 0x7f55e00afe70 2024-09-21T07:10:21.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.624+0000 7f55e748b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f55e015d930 con 0x7f55e00b6a00 2024-09-21T07:10:21.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.624+0000 7f55e5227640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55e00709b0 0x7f55e0139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:21.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.624+0000 7f55e5227640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55e00709b0 0x7f55e0139490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37886/0 (socket says 172.21.15.18:37886) 2024-09-21T07:10:21.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.624+0000 7f55e5227640 1 -- 172.21.15.18:0/3377217054 learned_addr learned my addr 172.21.15.18:0/3377217054 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:21.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.624+0000 7f55e5a28640 1 --2- 172.21.15.18:0/3377217054 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f55e00b6a00 0x7f55e01f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:21.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.624+0000 7f55e4a26640 1 --2- 172.21.15.18:0/3377217054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e00afe70 0x7f55e0159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:21.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.625+0000 7f55e5227640 1 -- 172.21.15.18:0/3377217054 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f55e00b6a00 msgr2=0x7f55e01f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:21.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.625+0000 7f55e5227640 1 --2- 172.21.15.18:0/3377217054 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f55e00b6a00 0x7f55e01f3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.625+0000 7f55e5227640 1 -- 172.21.15.18:0/3377217054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e00afe70 msgr2=0x7f55e0159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:21.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.625+0000 7f55e5227640 1 --2- 172.21.15.18:0/3377217054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e00afe70 0x7f55e0159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.625+0000 7f55e5227640 1 -- 172.21.15.18:0/3377217054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e01f3c40 con 0x7f55e00709b0 2024-09-21T07:10:21.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.625+0000 7f55e5a28640 1 --2- 172.21.15.18:0/3377217054 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f55e00b6a00 0x7f55e01f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:21.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.625+0000 7f55e5227640 1 --2- 172.21.15.18:0/3377217054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55e00709b0 0x7f55e0139490 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00c430 tx=0x7f55dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:21.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.625+0000 7f55d5ffb640 1 -- 172.21.15.18:0/3377217054 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc011790 con 0x7f55e00709b0 2024-09-21T07:10:21.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.625+0000 7f55d5ffb640 1 -- 172.21.15.18:0/3377217054 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55dc017070 con 0x7f55e00709b0 2024-09-21T07:10:21.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.625+0000 7f55e748b640 1 -- 172.21.15.18:0/3377217054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e01f3f20 con 0x7f55e00709b0 2024-09-21T07:10:21.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.625+0000 7f55d5ffb640 1 -- 172.21.15.18:0/3377217054 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc011ce0 con 0x7f55e00709b0 2024-09-21T07:10:21.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.625+0000 7f55e748b640 1 -- 172.21.15.18:0/3377217054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e0138970 con 0x7f55e00709b0 2024-09-21T07:10:21.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.625+0000 7f55d5ffb640 1 -- 172.21.15.18:0/3377217054 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f55dc01c460 con 0x7f55e00709b0 2024-09-21T07:10:21.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.625+0000 7f55d5ffb640 1 -- 172.21.15.18:0/3377217054 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f55dc01b3c0 con 0x7f55e00709b0 2024-09-21T07:10:21.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.627+0000 7f55e748b640 1 -- 172.21.15.18:0/3377217054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e015d0f0 con 0x7f55e00709b0 2024-09-21T07:10:21.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.629+0000 7f55d5ffb640 1 -- 172.21.15.18:0/3377217054 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f55dc012790 con 0x7f55e00709b0 2024-09-21T07:10:21.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.701+0000 7f55e748b640 1 -- 172.21.15.18:0/3377217054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55e0069870 con 0x7f55e00709b0 2024-09-21T07:10:21.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.701+0000 7f55d5ffb640 1 -- 172.21.15.18:0/3377217054 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f55dc012970 con 0x7f55e00709b0 2024-09-21T07:10:21.703 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:21.703 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":10,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:10:21.443447+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:10:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.702+0000 7f55e748b640 1 -- 172.21.15.18:0/3377217054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55e00709b0 msgr2=0x7f55e0139490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.702+0000 7f55e748b640 1 --2- 172.21.15.18:0/3377217054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55e00709b0 0x7f55e0139490 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00c430 tx=0x7f55dc00c8f0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.702+0000 7f55e748b640 1 -- 172.21.15.18:0/3377217054 shutdown_connections 2024-09-21T07:10:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.702+0000 7f55e748b640 1 --2- 172.21.15.18:0/3377217054 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f55e00b6a00 0x7f55e01f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.702+0000 7f55e748b640 1 --2- 172.21.15.18:0/3377217054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e00afe70 0x7f55e0159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.702+0000 7f55e748b640 1 --2- 172.21.15.18:0/3377217054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55e00709b0 0x7f55e0139490 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.702+0000 7f55e748b640 1 -- 172.21.15.18:0/3377217054 >> 172.21.15.18:0/3377217054 conn(0x7f55e009ba60 msgr2=0x7f55e0071bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.702+0000 7f55e748b640 1 -- 172.21.15.18:0/3377217054 shutdown_connections 2024-09-21T07:10:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:21.702+0000 7f55e748b640 1 -- 172.21.15.18:0/3377217054 wait complete. 2024-09-21T07:10:21.714 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T07:10:21.715 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T07:10:22.439 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-21T07:10:22.437+0000 7f1d1fa64640 -1 Falling back to public interface 2024-09-21T07:10:22.521 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T07:10:22.629 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.627+0000 7f6acc038640 1 -- 172.21.15.18:0/93093932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ac4072b00 msgr2=0x7f6ac406ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:22.629 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.627+0000 7f6acc038640 1 --2- 172.21.15.18:0/93093932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ac4072b00 0x7f6ac406ec60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6abc005fd0 tx=0x7f6abc02aa90 comp rx=0 tx=0).stop 2024-09-21T07:10:22.629 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.627+0000 7f6acc038640 1 -- 172.21.15.18:0/93093932 shutdown_connections 2024-09-21T07:10:22.629 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.627+0000 7f6acc038640 1 --2- 172.21.15.18:0/93093932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ac4072b00 0x7f6ac406ec60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:22.629 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.627+0000 7f6acc038640 1 --2- 172.21.15.18:0/93093932 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6ac40ce110 0x7f6ac40b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:22.629 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.627+0000 7f6acc038640 1 -- 172.21.15.18:0/93093932 >> 172.21.15.18:0/93093932 conn(0x7f6ac406cf20 msgr2=0x7f6ac406d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:22.630 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.627+0000 7f6acc038640 1 -- 172.21.15.18:0/93093932 shutdown_connections 2024-09-21T07:10:22.630 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.627+0000 7f6acc038640 1 -- 172.21.15.18:0/93093932 wait complete. 2024-09-21T07:10:22.630 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.629+0000 7f6acc038640 1 Processor -- start 2024-09-21T07:10:22.631 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.629+0000 7f6acc038640 1 -- start start 2024-09-21T07:10:22.633 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.630+0000 7f6acc038640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6ac4072b00 0x7f6ac40b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:22.633 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.630+0000 7f6acc038640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ac40d05f0 0x7f6ac414fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:22.634 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.630+0000 7f6acc038640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ac41509a0 0x7f6ac41e7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:22.634 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.630+0000 7f6acc038640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac406f610 con 0x7f6ac40d05f0 2024-09-21T07:10:22.634 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.630+0000 7f6acc038640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac406f490 con 0x7f6ac41509a0 2024-09-21T07:10:22.634 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.630+0000 7f6acc038640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac406f790 con 0x7f6ac4072b00 2024-09-21T07:10:22.634 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.630+0000 7f6ac95d3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ac40d05f0 0x7f6ac414fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:22.634 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6ac95d3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ac40d05f0 0x7f6ac414fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37902/0 (socket says 172.21.15.18:37902) 2024-09-21T07:10:22.634 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6ac95d3640 1 -- 172.21.15.18:0/1991166807 learned_addr learned my addr 172.21.15.18:0/1991166807 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:22.634 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6aca5d5640 1 --2- 172.21.15.18:0/1991166807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ac41509a0 0x7f6ac41e7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:22.634 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6ac9dd4640 1 --2- 172.21.15.18:0/1991166807 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6ac4072b00 0x7f6ac40b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:22.634 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6ac95d3640 1 -- 172.21.15.18:0/1991166807 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6ac4072b00 msgr2=0x7f6ac40b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:22.634 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6ac95d3640 1 --2- 172.21.15.18:0/1991166807 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6ac4072b00 0x7f6ac40b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:22.634 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6ac95d3640 1 -- 172.21.15.18:0/1991166807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ac41509a0 msgr2=0x7f6ac41e7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:22.634 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6ac95d3640 1 --2- 172.21.15.18:0/1991166807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ac41509a0 0x7f6ac41e7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:22.634 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6ac95d3640 1 -- 172.21.15.18:0/1991166807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac40b0e60 con 0x7f6ac40d05f0 2024-09-21T07:10:22.635 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6aca5d5640 1 --2- 172.21.15.18:0/1991166807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ac41509a0 0x7f6ac41e7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:10:22.635 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6ac95d3640 1 --2- 172.21.15.18:0/1991166807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ac40d05f0 0x7f6ac414fca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000e700 tx=0x7f6ac000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:22.635 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6aba7fc640 1 -- 172.21.15.18:0/1991166807 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac000cab0 con 0x7f6ac40d05f0 2024-09-21T07:10:22.635 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6aba7fc640 1 -- 172.21.15.18:0/1991166807 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ac000cd40 con 0x7f6ac40d05f0 2024-09-21T07:10:22.635 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6acc038640 1 -- 172.21.15.18:0/1991166807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac41e66c0 con 0x7f6ac40d05f0 2024-09-21T07:10:22.635 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6aba7fc640 1 -- 172.21.15.18:0/1991166807 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0010690 con 0x7f6ac40d05f0 2024-09-21T07:10:22.635 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.631+0000 7f6acc038640 1 -- 172.21.15.18:0/1991166807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac41e6960 con 0x7f6ac40d05f0 2024-09-21T07:10:22.636 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.632+0000 7f6acc038640 1 -- 172.21.15.18:0/1991166807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac406ec60 con 0x7f6ac40d05f0 2024-09-21T07:10:22.636 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.633+0000 7f6aba7fc640 1 -- 172.21.15.18:0/1991166807 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f6ac0010830 con 0x7f6ac40d05f0 2024-09-21T07:10:22.636 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.633+0000 7f6aba7fc640 1 -- 172.21.15.18:0/1991166807 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6ac0052cf0 con 0x7f6ac40d05f0 2024-09-21T07:10:22.636 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.635+0000 7f6aba7fc640 1 -- 172.21.15.18:0/1991166807 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6ac0017dc0 con 0x7f6ac40d05f0 2024-09-21T07:10:22.682 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-21T07:10:22.680+0000 7f202801a640 -1 Falling back to public interface 2024-09-21T07:10:22.699 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.697+0000 7f6acc038640 1 -- 172.21.15.18:0/1991166807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ac40cd490 con 0x7f6ac40d05f0 2024-09-21T07:10:22.699 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.698+0000 7f6aba7fc640 1 -- 172.21.15.18:0/1991166807 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6ac0020360 con 0x7f6ac40d05f0 2024-09-21T07:10:22.700 INFO:teuthology.misc.health.smithi018.stdout: 2024-09-21T07:10:22.700 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":10,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:10:21.443447+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:10:22.701 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.699+0000 7f6acc038640 1 -- 172.21.15.18:0/1991166807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ac40d05f0 msgr2=0x7f6ac414fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:22.701 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.699+0000 7f6acc038640 1 --2- 172.21.15.18:0/1991166807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ac40d05f0 0x7f6ac414fca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000e700 tx=0x7f6ac000ebc0 comp rx=0 tx=0).stop 2024-09-21T07:10:22.701 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.699+0000 7f6acc038640 1 -- 172.21.15.18:0/1991166807 shutdown_connections 2024-09-21T07:10:22.701 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.699+0000 7f6acc038640 1 --2- 172.21.15.18:0/1991166807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ac41509a0 0x7f6ac41e7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:22.702 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.699+0000 7f6acc038640 1 --2- 172.21.15.18:0/1991166807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ac40d05f0 0x7f6ac414fca0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:22.702 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.699+0000 7f6acc038640 1 --2- 172.21.15.18:0/1991166807 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6ac4072b00 0x7f6ac40b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:22.702 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.699+0000 7f6acc038640 1 -- 172.21.15.18:0/1991166807 >> 172.21.15.18:0/1991166807 conn(0x7f6ac406cf20 msgr2=0x7f6ac40aebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:22.702 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.699+0000 7f6acc038640 1 -- 172.21.15.18:0/1991166807 shutdown_connections 2024-09-21T07:10:22.702 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:22.699+0000 7f6acc038640 1 -- 172.21.15.18:0/1991166807 wait complete. 2024-09-21T07:10:22.714 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T07:10:22.961 INFO:tasks.ceph.osd.6.smithi049.stderr:2024-09-21T07:10:22.959+0000 7f3b94b17640 -1 Falling back to public interface 2024-09-21T07:10:22.967 INFO:tasks.ceph.osd.5.smithi049.stderr:2024-09-21T07:10:22.966+0000 7f9ae8ce4640 -1 Falling back to public interface 2024-09-21T07:10:23.174 INFO:tasks.ceph.osd.4.smithi049.stderr:2024-09-21T07:10:23.172+0000 7ff1791fd640 -1 Falling back to public interface 2024-09-21T07:10:23.321 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:10:23.319+0000 7efe6c5d7640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T07:10:23.321 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:10:23.319+0000 7efe6c5d7640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T07:10:23.434 INFO:tasks.ceph.osd.7.smithi049.stderr:2024-09-21T07:10:23.432+0000 7f044cc0d640 -1 Falling back to public interface 2024-09-21T07:10:23.435 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-21T07:10:23.434+0000 7f3a1705e640 -1 Falling back to public interface 2024-09-21T07:10:23.452 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-21T07:10:23.450+0000 7fb878460640 -1 Falling back to public interface 2024-09-21T07:10:26.006 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-21T07:10:26.005+0000 7f1d1fa64640 -1 osd.1 0 log_to_monitors true 2024-09-21T07:10:26.228 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-21T07:10:26.226+0000 7f202801a640 -1 osd.0 0 log_to_monitors true 2024-09-21T07:10:26.770 INFO:tasks.ceph.osd.5.smithi049.stderr:2024-09-21T07:10:26.768+0000 7f9ae8ce4640 -1 osd.5 0 log_to_monitors true 2024-09-21T07:10:27.017 INFO:tasks.ceph.osd.6.smithi049.stderr:2024-09-21T07:10:27.015+0000 7f3b94b17640 -1 osd.6 0 log_to_monitors true 2024-09-21T07:10:27.230 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-21T07:10:27.228+0000 7fb878460640 -1 osd.3 0 log_to_monitors true 2024-09-21T07:10:27.231 INFO:tasks.ceph.osd.7.smithi049.stderr:2024-09-21T07:10:27.229+0000 7f044cc0d640 -1 osd.7 0 log_to_monitors true 2024-09-21T07:10:27.269 INFO:tasks.ceph.osd.4.smithi049.stderr:2024-09-21T07:10:27.267+0000 7ff1791fd640 -1 osd.4 0 log_to_monitors true 2024-09-21T07:10:27.471 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-21T07:10:27.470+0000 7f3a1705e640 -1 osd.2 0 log_to_monitors true 2024-09-21T07:10:28.441 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-21T07:10:28.439+0000 7f20239e7640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T07:10:28.456 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-21T07:10:28.455+0000 7f201b7dd640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:10:28.463 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-21T07:10:28.461+0000 7f1d1b9f2640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T07:10:28.481 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-21T07:10:28.480+0000 7f1d137e8640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:10:29.184 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-21T07:10:29.182+0000 7fb874c03640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T07:10:29.199 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-21T07:10:29.197+0000 7fb86c1e4640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:10:29.521 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T07:10:29.640 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.638+0000 7f569a3e6640 1 -- 172.21.15.18:0/2643891659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56940cef70 msgr2=0x7f56940d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:29.641 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.638+0000 7f569a3e6640 1 --2- 172.21.15.18:0/2643891659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56940cef70 0x7f56940d3040 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f569406dd50 tx=0x7f567c02a540 comp rx=0 tx=0).stop 2024-09-21T07:10:29.641 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.639+0000 7f569a3e6640 1 -- 172.21.15.18:0/2643891659 shutdown_connections 2024-09-21T07:10:29.641 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.639+0000 7f569a3e6640 1 --2- 172.21.15.18:0/2643891659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56940cef70 0x7f56940d3040 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:29.641 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.639+0000 7f569a3e6640 1 --2- 172.21.15.18:0/2643891659 >> v2:172.21.15.49:3300/0 conn(0x7f569415ef50 0x7f569415c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:29.641 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.639+0000 7f569a3e6640 1 -- 172.21.15.18:0/2643891659 >> 172.21.15.18:0/2643891659 conn(0x7f5694073f30 msgr2=0x7f56940b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:29.641 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.639+0000 7f569a3e6640 1 -- 172.21.15.18:0/2643891659 shutdown_connections 2024-09-21T07:10:29.641 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.639+0000 7f569a3e6640 1 -- 172.21.15.18:0/2643891659 wait complete. 2024-09-21T07:10:29.643 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.642+0000 7f569a3e6640 1 Processor -- start 2024-09-21T07:10:29.643 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.642+0000 7f569a3e6640 1 -- start start 2024-09-21T07:10:29.647 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f569a3e6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56940cef70 0x7f569415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:29.647 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f569a3e6640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f56940d3580 0x7f56940ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:29.647 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f569a3e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f569415ef50 0x7f56940b91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:29.647 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f569a3e6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f56940d1020 con 0x7f569415ef50 2024-09-21T07:10:29.647 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f569a3e6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5694163360 con 0x7f56940cef70 2024-09-21T07:10:29.647 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f569a3e6640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f56940d11a0 con 0x7f56940d3580 2024-09-21T07:10:29.647 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f5698983640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f569415ef50 0x7f56940b91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:29.647 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f5698983640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f569415ef50 0x7f56940b91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55100/0 (socket says 172.21.15.18:55100) 2024-09-21T07:10:29.647 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f5698983640 1 -- 172.21.15.18:0/3346249117 learned_addr learned my addr 172.21.15.18:0/3346249117 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:29.647 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f5693fff640 1 --2- 172.21.15.18:0/3346249117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56940cef70 0x7f569415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:29.648 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f568bfff640 1 --2- 172.21.15.18:0/3346249117 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f56940d3580 0x7f56940ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:29.648 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f5698983640 1 -- 172.21.15.18:0/3346249117 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f56940d3580 msgr2=0x7f56940ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:29.648 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f5698983640 1 --2- 172.21.15.18:0/3346249117 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f56940d3580 0x7f56940ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:29.648 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f5698983640 1 -- 172.21.15.18:0/3346249117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56940cef70 msgr2=0x7f569415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:29.648 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f5698983640 1 --2- 172.21.15.18:0/3346249117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56940cef70 0x7f569415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:29.648 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.644+0000 7f5698983640 1 -- 172.21.15.18:0/3346249117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56940c8640 con 0x7f569415ef50 2024-09-21T07:10:29.648 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.645+0000 7f5698983640 1 --2- 172.21.15.18:0/3346249117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f569415ef50 0x7f56940b91a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f568c00b960 tx=0x7f568c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:29.648 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.645+0000 7f56917fa640 1 -- 172.21.15.18:0/3346249117 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c019070 con 0x7f569415ef50 2024-09-21T07:10:29.648 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.645+0000 7f56917fa640 1 -- 172.21.15.18:0/3346249117 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f568c00cc10 con 0x7f569415ef50 2024-09-21T07:10:29.648 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.645+0000 7f569a3e6640 1 -- 172.21.15.18:0/3346249117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56940c8920 con 0x7f569415ef50 2024-09-21T07:10:29.648 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.645+0000 7f56917fa640 1 -- 172.21.15.18:0/3346249117 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c014440 con 0x7f569415ef50 2024-09-21T07:10:29.648 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.645+0000 7f569a3e6640 1 -- 172.21.15.18:0/3346249117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56940c8ee0 con 0x7f569415ef50 2024-09-21T07:10:29.649 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.646+0000 7f569a3e6640 1 -- 172.21.15.18:0/3346249117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5694162ee0 con 0x7f569415ef50 2024-09-21T07:10:29.649 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.648+0000 7f56917fa640 1 -- 172.21.15.18:0/3346249117 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f568c01c070 con 0x7f569415ef50 2024-09-21T07:10:29.650 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.648+0000 7f56917fa640 1 --2- 172.21.15.18:0/3346249117 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5674078b00 0x7f567407b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:29.650 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.648+0000 7f56917fa640 1 -- 172.21.15.18:0/3346249117 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3071+0+0 (secure 0 0 0) 0x7f568c099db0 con 0x7f569415ef50 2024-09-21T07:10:29.650 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.648+0000 7f5693fff640 1 --2- 172.21.15.18:0/3346249117 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5674078b00 0x7f567407b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:29.650 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.649+0000 7f5693fff640 1 --2- 172.21.15.18:0/3346249117 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5674078b00 0x7f567407b010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5684009b30 tx=0x7f5684005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:29.659 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.658+0000 7f56917fa640 1 -- 172.21.15.18:0/3346249117 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f568c062760 con 0x7f569415ef50 2024-09-21T07:10:29.881 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.880+0000 7f569a3e6640 1 -- 172.21.15.18:0/3346249117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56940d16a0 con 0x7f569415ef50 2024-09-21T07:10:29.882 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.881+0000 7f56917fa640 1 -- 172.21.15.18:0/3346249117 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8503 (secure 0 0 0) 0x7f568c067190 con 0x7f569415ef50 2024-09-21T07:10:29.882 INFO:teuthology.misc.health.smithi018.stdout: 2024-09-21T07:10:29.883 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":14,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:10:29.338859+0000","last_up_change":"2024-09-21T07:10:29.338859+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:10:29.885 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.883+0000 7f569a3e6640 1 -- 172.21.15.18:0/3346249117 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5674078b00 msgr2=0x7f567407b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:29.885 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.883+0000 7f569a3e6640 1 --2- 172.21.15.18:0/3346249117 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5674078b00 0x7f567407b010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5684009b30 tx=0x7f5684005f90 comp rx=0 tx=0).stop 2024-09-21T07:10:29.885 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.883+0000 7f569a3e6640 1 -- 172.21.15.18:0/3346249117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f569415ef50 msgr2=0x7f56940b91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:29.885 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.883+0000 7f569a3e6640 1 --2- 172.21.15.18:0/3346249117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f569415ef50 0x7f56940b91a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f568c00b960 tx=0x7f568c00be20 comp rx=0 tx=0).stop 2024-09-21T07:10:29.886 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.883+0000 7f569a3e6640 1 -- 172.21.15.18:0/3346249117 shutdown_connections 2024-09-21T07:10:29.886 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.883+0000 7f569a3e6640 1 --2- 172.21.15.18:0/3346249117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f569415ef50 0x7f56940b91a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:29.886 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.883+0000 7f569a3e6640 1 --2- 172.21.15.18:0/3346249117 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5674078b00 0x7f567407b010 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:29.886 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.883+0000 7f569a3e6640 1 --2- 172.21.15.18:0/3346249117 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f56940d3580 0x7f56940ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:29.886 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.883+0000 7f569a3e6640 1 --2- 172.21.15.18:0/3346249117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56940cef70 0x7f569415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:29.886 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.883+0000 7f569a3e6640 1 -- 172.21.15.18:0/3346249117 >> 172.21.15.18:0/3346249117 conn(0x7f5694073f30 msgr2=0x7f56940d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:29.886 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.884+0000 7f569a3e6640 1 -- 172.21.15.18:0/3346249117 shutdown_connections 2024-09-21T07:10:29.886 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:29.884+0000 7f569a3e6640 1 -- 172.21.15.18:0/3346249117 wait complete. 2024-09-21T07:10:29.898 DEBUG:teuthology.misc:3 of 8 OSDs are up 2024-09-21T07:10:29.997 INFO:tasks.ceph.osd.4.smithi049.stderr:2024-09-21T07:10:29.994+0000 7ff17518b640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T07:10:30.003 INFO:tasks.ceph.osd.5.smithi049.stderr:2024-09-21T07:10:30.001+0000 7f9ae4c72640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T07:10:30.006 INFO:tasks.ceph.osd.7.smithi049.stderr:2024-09-21T07:10:30.004+0000 7f0448591640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T07:10:30.013 INFO:tasks.ceph.osd.4.smithi049.stderr:2024-09-21T07:10:30.011+0000 7ff16cf81640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:10:30.017 INFO:tasks.ceph.osd.5.smithi049.stderr:2024-09-21T07:10:30.015+0000 7f9adca68640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:10:30.021 INFO:tasks.ceph.osd.6.smithi049.stderr:2024-09-21T07:10:30.019+0000 7f3b90aa5640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T07:10:30.023 INFO:tasks.ceph.osd.7.smithi049.stderr:2024-09-21T07:10:30.022+0000 7f0440387640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:10:30.037 INFO:tasks.ceph.osd.6.smithi049.stderr:2024-09-21T07:10:30.035+0000 7f3b8889b640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:10:30.182 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-21T07:10:30.180+0000 7f3a12fec640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T07:10:30.195 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-21T07:10:30.194+0000 7f3a0ade2640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:10:36.705 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T07:10:36.827 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.825+0000 7f136b40e640 1 -- 172.21.15.18:0/1444614916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13640cef70 msgr2=0x7f13640d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:36.828 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.825+0000 7f136b40e640 1 --2- 172.21.15.18:0/1444614916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13640cef70 0x7f13640d3040 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f136406dd50 tx=0x7f135402a530 comp rx=0 tx=0).stop 2024-09-21T07:10:36.828 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.825+0000 7f136b40e640 1 -- 172.21.15.18:0/1444614916 shutdown_connections 2024-09-21T07:10:36.828 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.825+0000 7f136b40e640 1 --2- 172.21.15.18:0/1444614916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13640cef70 0x7f13640d3040 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:36.828 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.825+0000 7f136b40e640 1 --2- 172.21.15.18:0/1444614916 >> v2:172.21.15.49:3300/0 conn(0x7f136415ef50 0x7f136415c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:36.828 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.825+0000 7f136b40e640 1 -- 172.21.15.18:0/1444614916 >> 172.21.15.18:0/1444614916 conn(0x7f1364073f30 msgr2=0x7f13640b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:36.828 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.825+0000 7f136b40e640 1 -- 172.21.15.18:0/1444614916 shutdown_connections 2024-09-21T07:10:36.828 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.825+0000 7f136b40e640 1 -- 172.21.15.18:0/1444614916 wait complete. 2024-09-21T07:10:36.829 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.827+0000 7f136b40e640 1 Processor -- start 2024-09-21T07:10:36.829 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.827+0000 7f136b40e640 1 -- start start 2024-09-21T07:10:36.831 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f136b40e640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f13640cef70 0x7f1364151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:36.832 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f136b40e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13640d3580 0x7f13640b9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:36.832 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f136b40e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f136415ef50 0x7f13640b9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:36.832 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f136b40e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f13640d1020 con 0x7f136415ef50 2024-09-21T07:10:36.832 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f136b40e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1364163360 con 0x7f13640d3580 2024-09-21T07:10:36.832 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f136b40e640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f13640d11a0 con 0x7f13640cef70 2024-09-21T07:10:36.832 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f13699ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f136415ef50 0x7f13640b9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:36.832 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f13699ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f136415ef50 0x7f13640b9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34904/0 (socket says 172.21.15.18:34904) 2024-09-21T07:10:36.832 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f13699ab640 1 -- 172.21.15.18:0/3212372771 learned_addr learned my addr 172.21.15.18:0/3212372771 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:36.832 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f13691aa640 1 --2- 172.21.15.18:0/3212372771 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f13640cef70 0x7f1364151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:36.832 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f13689a9640 1 --2- 172.21.15.18:0/3212372771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13640d3580 0x7f13640b9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:36.832 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f13699ab640 1 -- 172.21.15.18:0/3212372771 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f13640cef70 msgr2=0x7f1364151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:36.832 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f13699ab640 1 --2- 172.21.15.18:0/3212372771 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f13640cef70 0x7f1364151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:36.832 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f13699ab640 1 -- 172.21.15.18:0/3212372771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13640d3580 msgr2=0x7f13640b9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:36.833 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f13699ab640 1 --2- 172.21.15.18:0/3212372771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13640d3580 0x7f13640b9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:36.833 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f13699ab640 1 -- 172.21.15.18:0/3212372771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13641f9120 con 0x7f136415ef50 2024-09-21T07:10:36.833 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f13689a9640 1 --2- 172.21.15.18:0/3212372771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13640d3580 0x7f13640b9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:36.833 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f13699ab640 1 --2- 172.21.15.18:0/3212372771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f136415ef50 0x7f13640b9540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f135c00ca80 tx=0x7f135c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:36.833 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f1359ffb640 1 -- 172.21.15.18:0/3212372771 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c016020 con 0x7f136415ef50 2024-09-21T07:10:36.833 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f1359ffb640 1 -- 172.21.15.18:0/3212372771 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f135c00ad20 con 0x7f136415ef50 2024-09-21T07:10:36.833 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f136b40e640 1 -- 172.21.15.18:0/3212372771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13641f9400 con 0x7f136415ef50 2024-09-21T07:10:36.833 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.829+0000 7f1359ffb640 1 -- 172.21.15.18:0/3212372771 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c012680 con 0x7f136415ef50 2024-09-21T07:10:36.833 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.830+0000 7f136b40e640 1 -- 172.21.15.18:0/3212372771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13641f99c0 con 0x7f136415ef50 2024-09-21T07:10:36.834 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.831+0000 7f136b40e640 1 -- 172.21.15.18:0/3212372771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13640d0230 con 0x7f136415ef50 2024-09-21T07:10:36.834 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.831+0000 7f1359ffb640 1 -- 172.21.15.18:0/3212372771 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f135c019020 con 0x7f136415ef50 2024-09-21T07:10:36.834 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.832+0000 7f1359ffb640 1 --2- 172.21.15.18:0/3212372771 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1348078b90 0x7f134807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:36.834 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.832+0000 7f1359ffb640 1 -- 172.21.15.18:0/3212372771 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f135c09ad20 con 0x7f136415ef50 2024-09-21T07:10:36.834 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.832+0000 7f13691aa640 1 --2- 172.21.15.18:0/3212372771 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1348078b90 0x7f134807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:36.834 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.833+0000 7f13691aa640 1 --2- 172.21.15.18:0/3212372771 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1348078b90 0x7f134807b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1360009a00 tx=0x7f1360005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:36.838 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:36.837+0000 7f1359ffb640 1 -- 172.21.15.18:0/3212372771 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f13640d0230 con 0x7f136415ef50 2024-09-21T07:10:37.028 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:37.027+0000 7f136b40e640 1 -- 172.21.15.18:0/3212372771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13641f8eb0 con 0x7f136415ef50 2024-09-21T07:10:37.029 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:37.027+0000 7f1359ffb640 1 -- 172.21.15.18:0/3212372771 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12872 (secure 0 0 0) 0x7f135c020030 con 0x7f136415ef50 2024-09-21T07:10:37.029 INFO:teuthology.misc.health.smithi018.stdout: 2024-09-21T07:10:37.029 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":17,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:10:33.014872+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:10:37.032 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:37.030+0000 7f136b40e640 1 -- 172.21.15.18:0/3212372771 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1348078b90 msgr2=0x7f134807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:37.032 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:37.030+0000 7f136b40e640 1 --2- 172.21.15.18:0/3212372771 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1348078b90 0x7f134807b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1360009a00 tx=0x7f1360005f90 comp rx=0 tx=0).stop 2024-09-21T07:10:37.032 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:37.030+0000 7f136b40e640 1 -- 172.21.15.18:0/3212372771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f136415ef50 msgr2=0x7f13640b9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:37.032 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:37.030+0000 7f136b40e640 1 --2- 172.21.15.18:0/3212372771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f136415ef50 0x7f13640b9540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f135c00ca80 tx=0x7f135c00cf40 comp rx=0 tx=0).stop 2024-09-21T07:10:37.032 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:37.030+0000 7f136b40e640 1 -- 172.21.15.18:0/3212372771 shutdown_connections 2024-09-21T07:10:37.032 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:37.030+0000 7f136b40e640 1 --2- 172.21.15.18:0/3212372771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f136415ef50 0x7f13640b9540 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:37.032 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:37.030+0000 7f136b40e640 1 --2- 172.21.15.18:0/3212372771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13640d3580 0x7f13640b9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:37.032 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:37.030+0000 7f136b40e640 1 --2- 172.21.15.18:0/3212372771 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1348078b90 0x7f134807b0a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:37.032 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:37.030+0000 7f136b40e640 1 --2- 172.21.15.18:0/3212372771 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f13640cef70 0x7f1364151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:37.032 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:37.030+0000 7f136b40e640 1 -- 172.21.15.18:0/3212372771 >> 172.21.15.18:0/3212372771 conn(0x7f1364073f30 msgr2=0x7f136415df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:37.032 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:37.030+0000 7f136b40e640 1 -- 172.21.15.18:0/3212372771 shutdown_connections 2024-09-21T07:10:37.033 INFO:teuthology.misc.health.smithi018.stderr:2024-09-21T07:10:37.030+0000 7f136b40e640 1 -- 172.21.15.18:0/3212372771 wait complete. 2024-09-21T07:10:37.042 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-21T07:10:37.042 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T07:10:37.043 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:10:37.043 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:10:37.045 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:10:37.046 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:10:37.046 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:10:37.048 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:10:37.048 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:10:37.048 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:10:37.051 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:10:37.051 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:10:37.051 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:10:37.053 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:10:37.053 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-21T07:10:37.053 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:10:37.135 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-21T07:10:37.135 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-21T07:10:37.153 INFO:tasks.ceph.mds.b.smithi049.stdout:starting mds.b at 2024-09-21T07:10:37.154 INFO:tasks.ceph.mds.d.smithi049.stdout:starting mds.d at 2024-09-21T07:10:37.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.174+0000 7f9759a7e640 1 -- 172.21.15.18:0/2820705684 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f975415c520 msgr2=0x7f97540d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:37.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.174+0000 7f9759a7e640 1 --2- 172.21.15.18:0/2820705684 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f975415c520 0x7f97540d3040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9748009820 tx=0x7f974802a4a0 comp rx=0 tx=0).stop 2024-09-21T07:10:37.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.174+0000 7f9759a7e640 1 -- 172.21.15.18:0/2820705684 shutdown_connections 2024-09-21T07:10:37.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.174+0000 7f9759a7e640 1 --2- 172.21.15.18:0/2820705684 >> v2:172.21.15.49:3300/0 conn(0x7f97540d3580 0x7f9754162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:37.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.174+0000 7f9759a7e640 1 --2- 172.21.15.18:0/2820705684 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f975415c520 0x7f97540d3040 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:37.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.174+0000 7f9759a7e640 1 -- 172.21.15.18:0/2820705684 >> 172.21.15.18:0/2820705684 conn(0x7f9754073f30 msgr2=0x7f97540b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:37.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.174+0000 7f9759a7e640 1 -- 172.21.15.18:0/2820705684 shutdown_connections 2024-09-21T07:10:37.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.174+0000 7f9759a7e640 1 -- 172.21.15.18:0/2820705684 wait complete. 2024-09-21T07:10:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.175+0000 7f9759a7e640 1 Processor -- start 2024-09-21T07:10:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.176+0000 7f9759a7e640 1 -- start start 2024-09-21T07:10:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f9759a7e640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f97540d3580 0x7f97540abe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f9759a7e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f975415c520 0x7f97540cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f9759a7e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f975415ef50 0x7f97541f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f9759a7e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f97540d11a0 con 0x7f975415c520 2024-09-21T07:10:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f9759a7e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f97540d1020 con 0x7f975415ef50 2024-09-21T07:10:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f9759a7e640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f97540d1320 con 0x7f97540d3580 2024-09-21T07:10:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f9752ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f975415c520 0x7f97540cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f9752ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f975415c520 0x7f97540cdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34950/0 (socket says 172.21.15.18:34950) 2024-09-21T07:10:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f9752ffd640 1 -- 172.21.15.18:0/2917875901 learned_addr learned my addr 172.21.15.18:0/2917875901 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f97537fe640 1 --2- 172.21.15.18:0/2917875901 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f97540d3580 0x7f97540abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f9753fff640 1 --2- 172.21.15.18:0/2917875901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f975415ef50 0x7f97541f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f9752ffd640 1 -- 172.21.15.18:0/2917875901 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f97540d3580 msgr2=0x7f97540abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f9752ffd640 1 --2- 172.21.15.18:0/2917875901 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f97540d3580 0x7f97540abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f9752ffd640 1 -- 172.21.15.18:0/2917875901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f975415ef50 msgr2=0x7f97541f5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f9752ffd640 1 --2- 172.21.15.18:0/2917875901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f975415ef50 0x7f97541f5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f9752ffd640 1 -- 172.21.15.18:0/2917875901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97540ce680 con 0x7f975415c520 2024-09-21T07:10:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.177+0000 7f97537fe640 1 --2- 172.21.15.18:0/2917875901 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f97540d3580 0x7f97540abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.178+0000 7f9752ffd640 1 --2- 172.21.15.18:0/2917875901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f975415c520 0x7f97540cdb80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9748009910 tx=0x7f9748003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.178+0000 7f973bfff640 1 -- 172.21.15.18:0/2917875901 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974803f070 con 0x7f975415c520 2024-09-21T07:10:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.178+0000 7f973bfff640 1 -- 172.21.15.18:0/2917875901 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9748004510 con 0x7f975415c520 2024-09-21T07:10:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.178+0000 7f9759a7e640 1 -- 172.21.15.18:0/2917875901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97540ab370 con 0x7f975415c520 2024-09-21T07:10:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.178+0000 7f973bfff640 1 -- 172.21.15.18:0/2917875901 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748003e30 con 0x7f975415c520 2024-09-21T07:10:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.178+0000 7f9759a7e640 1 -- 172.21.15.18:0/2917875901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97541f6570 con 0x7f975415c520 2024-09-21T07:10:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.179+0000 7f9759a7e640 1 -- 172.21.15.18:0/2917875901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97540d17d0 con 0x7f975415c520 2024-09-21T07:10:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.180+0000 7f973bfff640 1 -- 172.21.15.18:0/2917875901 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9748042070 con 0x7f975415c520 2024-09-21T07:10:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.180+0000 7f973bfff640 1 --2- 172.21.15.18:0/2917875901 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9740078bc0 0x7f974007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:37.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.180+0000 7f973bfff640 1 -- 172.21.15.18:0/2917875901 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f97480bb740 con 0x7f975415c520 2024-09-21T07:10:37.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.180+0000 7f97537fe640 1 --2- 172.21.15.18:0/2917875901 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9740078bc0 0x7f974007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:37.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.181+0000 7f97537fe640 1 --2- 172.21.15.18:0/2917875901 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9740078bc0 0x7f974007b0d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9744007d40 tx=0x7f9744001d50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:37.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.185+0000 7f973bfff640 1 -- 172.21.15.18:0/2917875901 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9748083890 con 0x7f975415c520 2024-09-21T07:10:37.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.410+0000 7f9759a7e640 1 -- 172.21.15.18:0/2917875901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97540b6180 con 0x7f975415c520 2024-09-21T07:10:37.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.410+0000 7f973bfff640 1 -- 172.21.15.18:0/2917875901 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f97480882c0 con 0x7f975415c520 2024-09-21T07:10:37.412 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:37.413 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":2,"btime":"2024-09-21T07:10:37:139065+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2651218421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2651218421},{"type":"v1","addr":"172.21.15.18:6834","nonce":2651218421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T07:10:37.413 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 2 2024-09-21T07:10:37.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.413+0000 7f9759a7e640 1 -- 172.21.15.18:0/2917875901 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9740078bc0 msgr2=0x7f974007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:37.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.413+0000 7f9759a7e640 1 --2- 172.21.15.18:0/2917875901 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9740078bc0 0x7f974007b0d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9744007d40 tx=0x7f9744001d50 comp rx=0 tx=0).stop 2024-09-21T07:10:37.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.413+0000 7f9759a7e640 1 -- 172.21.15.18:0/2917875901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f975415c520 msgr2=0x7f97540cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:37.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.413+0000 7f9759a7e640 1 --2- 172.21.15.18:0/2917875901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f975415c520 0x7f97540cdb80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9748009910 tx=0x7f9748003c10 comp rx=0 tx=0).stop 2024-09-21T07:10:37.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.413+0000 7f9759a7e640 1 -- 172.21.15.18:0/2917875901 shutdown_connections 2024-09-21T07:10:37.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.413+0000 7f9759a7e640 1 --2- 172.21.15.18:0/2917875901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f975415ef50 0x7f97541f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:37.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.413+0000 7f9759a7e640 1 --2- 172.21.15.18:0/2917875901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f975415c520 0x7f97540cdb80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:37.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.413+0000 7f9759a7e640 1 --2- 172.21.15.18:0/2917875901 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9740078bc0 0x7f974007b0d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:37.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.413+0000 7f9759a7e640 1 --2- 172.21.15.18:0/2917875901 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f97540d3580 0x7f97540abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:37.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.413+0000 7f9759a7e640 1 -- 172.21.15.18:0/2917875901 >> 172.21.15.18:0/2917875901 conn(0x7f9754073f30 msgr2=0x7f97540b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:37.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.413+0000 7f9759a7e640 1 -- 172.21.15.18:0/2917875901 shutdown_connections 2024-09-21T07:10:37.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:37.413+0000 7f9759a7e640 1 -- 172.21.15.18:0/2917875901 wait complete. 2024-09-21T07:10:39.426 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:10:39.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.556+0000 7fcbe4b21640 1 -- 172.21.15.18:0/2831937873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0162a40 msgr2=0x7fcbe0162e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:39.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.556+0000 7fcbe4b21640 1 --2- 172.21.15.18:0/2831937873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0162a40 0x7fcbe0162e50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcbe006dd50 tx=0x7fcbd802a560 comp rx=0 tx=0).stop 2024-09-21T07:10:39.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.556+0000 7fcbe4b21640 1 -- 172.21.15.18:0/2831937873 shutdown_connections 2024-09-21T07:10:39.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.556+0000 7fcbe4b21640 1 --2- 172.21.15.18:0/2831937873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0162a40 0x7fcbe0162e50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:39.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.556+0000 7fcbe4b21640 1 --2- 172.21.15.18:0/2831937873 >> v2:172.21.15.49:3300/0 conn(0x7fcbe015ef50 0x7fcbe015c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:39.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.556+0000 7fcbe4b21640 1 -- 172.21.15.18:0/2831937873 >> 172.21.15.18:0/2831937873 conn(0x7fcbe0073f30 msgr2=0x7fcbe00b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:39.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.556+0000 7fcbe4b21640 1 -- 172.21.15.18:0/2831937873 shutdown_connections 2024-09-21T07:10:39.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.556+0000 7fcbe4b21640 1 -- 172.21.15.18:0/2831937873 wait complete. 2024-09-21T07:10:39.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.558+0000 7fcbe4b21640 1 Processor -- start 2024-09-21T07:10:39.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.558+0000 7fcbe4b21640 1 -- start start 2024-09-21T07:10:39.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbe4b21640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcbe00cef70 0x7fcbe00b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:39.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbe4b21640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe015ef50 0x7fcbe00ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:39.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbe4b21640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0162a40 0x7fcbe00b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:39.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbe4b21640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00d11a0 con 0x7fcbe0162a40 2024-09-21T07:10:39.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbe4b21640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00d1020 con 0x7fcbe015ef50 2024-09-21T07:10:39.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbe4b21640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe00d1320 con 0x7fcbe00cef70 2024-09-21T07:10:39.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbded9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0162a40 0x7fcbe00b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:39.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbded9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0162a40 0x7fcbe00b51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34962/0 (socket says 172.21.15.18:34962) 2024-09-21T07:10:39.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbded9d640 1 -- 172.21.15.18:0/925243672 learned_addr learned my addr 172.21.15.18:0/925243672 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:39.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbde59c640 1 --2- 172.21.15.18:0/925243672 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcbe00cef70 0x7fcbe00b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:39.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbddd9b640 1 --2- 172.21.15.18:0/925243672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe015ef50 0x7fcbe00ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbded9d640 1 -- 172.21.15.18:0/925243672 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcbe00cef70 msgr2=0x7fcbe00b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbded9d640 1 --2- 172.21.15.18:0/925243672 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcbe00cef70 0x7fcbe00b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbded9d640 1 -- 172.21.15.18:0/925243672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe015ef50 msgr2=0x7fcbe00ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbded9d640 1 --2- 172.21.15.18:0/925243672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe015ef50 0x7fcbe00ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.560+0000 7fcbded9d640 1 -- 172.21.15.18:0/925243672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe00abcb0 con 0x7fcbe0162a40 2024-09-21T07:10:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.561+0000 7fcbded9d640 1 --2- 172.21.15.18:0/925243672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0162a40 0x7fcbe00b51c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8034040 tx=0x7fcbd8003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.561+0000 7fcbceffd640 1 -- 172.21.15.18:0/925243672 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd803e030 con 0x7fcbe0162a40 2024-09-21T07:10:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.561+0000 7fcbceffd640 1 -- 172.21.15.18:0/925243672 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbd8003e50 con 0x7fcbe0162a40 2024-09-21T07:10:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.561+0000 7fcbe4b21640 1 -- 172.21.15.18:0/925243672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe01f5520 con 0x7fcbe0162a40 2024-09-21T07:10:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.561+0000 7fcbceffd640 1 -- 172.21.15.18:0/925243672 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8035040 con 0x7fcbe0162a40 2024-09-21T07:10:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.561+0000 7fcbe4b21640 1 -- 172.21.15.18:0/925243672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe01f5ae0 con 0x7fcbe0162a40 2024-09-21T07:10:39.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.562+0000 7fcbe4b21640 1 -- 172.21.15.18:0/925243672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe015c160 con 0x7fcbe0162a40 2024-09-21T07:10:39.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.563+0000 7fcbceffd640 1 -- 172.21.15.18:0/925243672 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcbd8041030 con 0x7fcbe0162a40 2024-09-21T07:10:39.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.563+0000 7fcbceffd640 1 --2- 172.21.15.18:0/925243672 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbc0078b90 0x7fcbc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:39.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.563+0000 7fcbceffd640 1 -- 172.21.15.18:0/925243672 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fcbd80bb160 con 0x7fcbe0162a40 2024-09-21T07:10:39.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.563+0000 7fcbde59c640 1 --2- 172.21.15.18:0/925243672 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbc0078b90 0x7fcbc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:39.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.564+0000 7fcbde59c640 1 --2- 172.21.15.18:0/925243672 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbc0078b90 0x7fcbc007b0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0005fd0 tx=0x7fcbd00095e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.568+0000 7fcbceffd640 1 -- 172.21.15.18:0/925243672 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcbe015c160 con 0x7fcbe0162a40 2024-09-21T07:10:39.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.793+0000 7fcbe4b21640 1 -- 172.21.15.18:0/925243672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbe0069870 con 0x7fcbe0162a40 2024-09-21T07:10:39.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.794+0000 7fcbceffd640 1 -- 172.21.15.18:0/925243672 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3903 (secure 0 0 0) 0x7fcbd8083220 con 0x7fcbe0162a40 2024-09-21T07:10:39.797 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:39.797 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":3,"btime":"2024-09-21T07:10:38:140054+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/760501489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":760501489},{"type":"v1","addr":"172.21.15.49:6835","nonce":760501489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2249656343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2249656343},{"type":"v1","addr":"172.21.15.49:6837","nonce":2249656343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2651218421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2651218421},{"type":"v1","addr":"172.21.15.18:6834","nonce":2651218421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4395,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/2785506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2785506081},{"type":"v1","addr":"172.21.15.18:6835","nonce":2785506081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T07:10:39.797 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 3 2024-09-21T07:10:39.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.796+0000 7fcbe4b21640 1 -- 172.21.15.18:0/925243672 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbc0078b90 msgr2=0x7fcbc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:39.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.796+0000 7fcbe4b21640 1 --2- 172.21.15.18:0/925243672 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbc0078b90 0x7fcbc007b0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0005fd0 tx=0x7fcbd00095e0 comp rx=0 tx=0).stop 2024-09-21T07:10:39.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.796+0000 7fcbe4b21640 1 -- 172.21.15.18:0/925243672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0162a40 msgr2=0x7fcbe00b51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:39.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.796+0000 7fcbe4b21640 1 --2- 172.21.15.18:0/925243672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0162a40 0x7fcbe00b51c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8034040 tx=0x7fcbd8003960 comp rx=0 tx=0).stop 2024-09-21T07:10:39.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.796+0000 7fcbe4b21640 1 -- 172.21.15.18:0/925243672 shutdown_connections 2024-09-21T07:10:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.796+0000 7fcbe4b21640 1 --2- 172.21.15.18:0/925243672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0162a40 0x7fcbe00b51c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.796+0000 7fcbe4b21640 1 --2- 172.21.15.18:0/925243672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcbe015ef50 0x7fcbe00ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.796+0000 7fcbe4b21640 1 --2- 172.21.15.18:0/925243672 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbc0078b90 0x7fcbc007b0a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.796+0000 7fcbe4b21640 1 --2- 172.21.15.18:0/925243672 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcbe00cef70 0x7fcbe00b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.796+0000 7fcbe4b21640 1 -- 172.21.15.18:0/925243672 >> 172.21.15.18:0/925243672 conn(0x7fcbe0073f30 msgr2=0x7fcbe015cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.796+0000 7fcbe4b21640 1 -- 172.21.15.18:0/925243672 shutdown_connections 2024-09-21T07:10:39.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.796+0000 7fcbe4b21640 1 -- 172.21.15.18:0/925243672 wait complete. 2024-09-21T07:10:39.809 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:10:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.922+0000 7f6186d33640 1 -- 172.21.15.18:0/3560112845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f618015e090 msgr2=0x7f618015e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.922+0000 7f6186d33640 1 --2- 172.21.15.18:0/3560112845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f618015e090 0x7f618015e4a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f61800d34f0 tx=0x7f617802aac0 comp rx=0 tx=0).stop 2024-09-21T07:10:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.922+0000 7f6186d33640 1 -- 172.21.15.18:0/3560112845 shutdown_connections 2024-09-21T07:10:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.922+0000 7f6186d33640 1 --2- 172.21.15.18:0/3560112845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f618015e090 0x7f618015e4a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.922+0000 7f6186d33640 1 --2- 172.21.15.18:0/3560112845 >> v2:172.21.15.49:3300/0 conn(0x7f618015a2c0 0x7f61800b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.922+0000 7f6186d33640 1 -- 172.21.15.18:0/3560112845 >> 172.21.15.18:0/3560112845 conn(0x7f618009ba60 msgr2=0x7f61800b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.922+0000 7f6186d33640 1 -- 172.21.15.18:0/3560112845 shutdown_connections 2024-09-21T07:10:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.922+0000 7f6186d33640 1 -- 172.21.15.18:0/3560112845 wait complete. 2024-09-21T07:10:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.924+0000 7f6186d33640 1 Processor -- start 2024-09-21T07:10:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.924+0000 7f6186d33640 1 -- start start 2024-09-21T07:10:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.925+0000 7f6186d33640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f618015a2c0 0x7f618014aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.925+0000 7f6186d33640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618015e090 0x7f61800d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.925+0000 7f6186d33640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61801603e0 0x7f61800d1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f6186d33640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f618015e9e0 con 0x7f61801603e0 2024-09-21T07:10:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f6186d33640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f61800b4f50 con 0x7f618015e090 2024-09-21T07:10:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f6186d33640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f618015eb60 con 0x7f618015a2c0 2024-09-21T07:10:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f61852d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61801603e0 0x7f61800d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f61852d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61801603e0 0x7f61800d1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34984/0 (socket says 172.21.15.18:34984) 2024-09-21T07:10:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f61852d0640 1 -- 172.21.15.18:0/2115792900 learned_addr learned my addr 172.21.15.18:0/2115792900 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f6184acf640 1 --2- 172.21.15.18:0/2115792900 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f618015a2c0 0x7f618014aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f617ffff640 1 --2- 172.21.15.18:0/2115792900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618015e090 0x7f61800d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f61852d0640 1 -- 172.21.15.18:0/2115792900 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f618015a2c0 msgr2=0x7f618014aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f61852d0640 1 --2- 172.21.15.18:0/2115792900 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f618015a2c0 0x7f618014aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f61852d0640 1 -- 172.21.15.18:0/2115792900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618015e090 msgr2=0x7f61800d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f61852d0640 1 --2- 172.21.15.18:0/2115792900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618015e090 0x7f61800d0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f61852d0640 1 -- 172.21.15.18:0/2115792900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61800cc120 con 0x7f61801603e0 2024-09-21T07:10:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f61852d0640 1 --2- 172.21.15.18:0/2115792900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61801603e0 0x7f61800d1280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f617802b0b0 tx=0x7f6178003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f617d7fa640 1 -- 172.21.15.18:0/2115792900 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178004250 con 0x7f61801603e0 2024-09-21T07:10:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f617d7fa640 1 -- 172.21.15.18:0/2115792900 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61780043f0 con 0x7f61801603e0 2024-09-21T07:10:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f6186d33640 1 -- 172.21.15.18:0/2115792900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61800ce360 con 0x7f61801603e0 2024-09-21T07:10:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f617d7fa640 1 -- 172.21.15.18:0/2115792900 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178004840 con 0x7f61801603e0 2024-09-21T07:10:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.926+0000 7f6186d33640 1 -- 172.21.15.18:0/2115792900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61800cc670 con 0x7f61801603e0 2024-09-21T07:10:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.927+0000 7f6186d33640 1 -- 172.21.15.18:0/2115792900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61800767c0 con 0x7f61801603e0 2024-09-21T07:10:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.928+0000 7f617d7fa640 1 -- 172.21.15.18:0/2115792900 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6178049430 con 0x7f61801603e0 2024-09-21T07:10:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.929+0000 7f617d7fa640 1 --2- 172.21.15.18:0/2115792900 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6160078b90 0x7f616007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.929+0000 7f617d7fa640 1 -- 172.21.15.18:0/2115792900 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f61780bb890 con 0x7f61801603e0 2024-09-21T07:10:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.929+0000 7f6184acf640 1 --2- 172.21.15.18:0/2115792900 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6160078b90 0x7f616007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:39.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.929+0000 7f6184acf640 1 --2- 172.21.15.18:0/2115792900 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6160078b90 0x7f616007b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6168005fd0 tx=0x7f6168005850 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:39.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:39.933+0000 7f617d7fa640 1 -- 172.21.15.18:0/2115792900 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6178032030 con 0x7f61801603e0 2024-09-21T07:10:40.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.124+0000 7f6186d33640 1 -- 172.21.15.18:0/2115792900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f61801562f0 con 0x7f61801603e0 2024-09-21T07:10:40.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.124+0000 7f617d7fa640 1 -- 172.21.15.18:0/2115792900 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f6178084030 con 0x7f61801603e0 2024-09-21T07:10:40.126 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:40.126 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-21T07:10:40.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:10:40.127 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-21T07:10:40.127 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-21T07:10:40.127 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:10:40.127 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-21T07:10:40.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.127+0000 7f6186d33640 1 -- 172.21.15.18:0/2115792900 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6160078b90 msgr2=0x7f616007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:40.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.127+0000 7f6186d33640 1 --2- 172.21.15.18:0/2115792900 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6160078b90 0x7f616007b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6168005fd0 tx=0x7f6168005850 comp rx=0 tx=0).stop 2024-09-21T07:10:40.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.127+0000 7f6186d33640 1 -- 172.21.15.18:0/2115792900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61801603e0 msgr2=0x7f61800d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:40.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.127+0000 7f6186d33640 1 --2- 172.21.15.18:0/2115792900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61801603e0 0x7f61800d1280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f617802b0b0 tx=0x7f6178003ce0 comp rx=0 tx=0).stop 2024-09-21T07:10:40.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.127+0000 7f6186d33640 1 -- 172.21.15.18:0/2115792900 shutdown_connections 2024-09-21T07:10:40.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.127+0000 7f6186d33640 1 --2- 172.21.15.18:0/2115792900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61801603e0 0x7f61800d1280 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:40.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.127+0000 7f6186d33640 1 --2- 172.21.15.18:0/2115792900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f618015e090 0x7f61800d0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:40.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.127+0000 7f6186d33640 1 --2- 172.21.15.18:0/2115792900 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6160078b90 0x7f616007b0a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:40.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.127+0000 7f6186d33640 1 --2- 172.21.15.18:0/2115792900 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f618015a2c0 0x7f618014aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:40.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.127+0000 7f6186d33640 1 -- 172.21.15.18:0/2115792900 >> 172.21.15.18:0/2115792900 conn(0x7f618009ba60 msgr2=0x7f618015c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:40.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.127+0000 7f6186d33640 1 -- 172.21.15.18:0/2115792900 shutdown_connections 2024-09-21T07:10:40.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.127+0000 7f6186d33640 1 -- 172.21.15.18:0/2115792900 wait complete. 2024-09-21T07:10:40.139 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:10:40.139 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:10:40.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.257+0000 7f2b5334a640 1 -- 172.21.15.18:0/1916650741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ef50 msgr2=0x7f2b4c15c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:40.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.257+0000 7f2b5334a640 1 --2- 172.21.15.18:0/1916650741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ef50 0x7f2b4c15c520 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009830 tx=0x7f2b4002a510 comp rx=0 tx=0).stop 2024-09-21T07:10:40.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.257+0000 7f2b5334a640 1 -- 172.21.15.18:0/1916650741 shutdown_connections 2024-09-21T07:10:40.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.257+0000 7f2b5334a640 1 --2- 172.21.15.18:0/1916650741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ef50 0x7f2b4c15c520 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:40.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.257+0000 7f2b5334a640 1 -- 172.21.15.18:0/1916650741 >> 172.21.15.18:0/1916650741 conn(0x7f2b4c073f30 msgr2=0x7f2b4c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:40.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.258+0000 7f2b5334a640 1 -- 172.21.15.18:0/1916650741 shutdown_connections 2024-09-21T07:10:40.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.258+0000 7f2b5334a640 1 -- 172.21.15.18:0/1916650741 wait complete. 2024-09-21T07:10:40.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.259+0000 7f2b5334a640 1 Processor -- start 2024-09-21T07:10:40.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.259+0000 7f2b5334a640 1 -- start start 2024-09-21T07:10:40.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b5334a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b4c0cef70 0x7f2b4c0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:40.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b5334a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ef50 0x7f2b4c15b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:40.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b5334a640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2b4c162a40 0x7f2b4c0ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:40.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b5334a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4c0d13b0 con 0x7f2b4c15ef50 2024-09-21T07:10:40.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b5334a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4c0d1230 con 0x7f2b4c0cef70 2024-09-21T07:10:40.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b5334a640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f2b4c0d1530 con 0x7f2b4c162a40 2024-09-21T07:10:40.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b508e5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ef50 0x7f2b4c15b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:40.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b510e6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b4c0cef70 0x7f2b4c0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:40.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b508e5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ef50 0x7f2b4c15b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34994/0 (socket says 172.21.15.18:34994) 2024-09-21T07:10:40.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b508e5640 1 -- 172.21.15.18:0/809591976 learned_addr learned my addr 172.21.15.18:0/809591976 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:40.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b518e7640 1 --2- 172.21.15.18:0/809591976 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2b4c162a40 0x7f2b4c0ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:40.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b508e5640 1 -- 172.21.15.18:0/809591976 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2b4c162a40 msgr2=0x7f2b4c0ab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:40.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b508e5640 1 --2- 172.21.15.18:0/809591976 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2b4c162a40 0x7f2b4c0ab9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:40.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b508e5640 1 -- 172.21.15.18:0/809591976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b4c0cef70 msgr2=0x7f2b4c0cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:40.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b508e5640 1 --2- 172.21.15.18:0/809591976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b4c0cef70 0x7f2b4c0cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:40.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b508e5640 1 -- 172.21.15.18:0/809591976 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4c0acab0 con 0x7f2b4c15ef50 2024-09-21T07:10:40.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b508e5640 1 --2- 172.21.15.18:0/809591976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ef50 0x7f2b4c15b040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800b3e0 tx=0x7f2b4800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:40.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b3dffb640 1 -- 172.21.15.18:0/809591976 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b48015020 con 0x7f2b4c15ef50 2024-09-21T07:10:40.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b3dffb640 1 -- 172.21.15.18:0/809591976 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b48011940 con 0x7f2b4c15ef50 2024-09-21T07:10:40.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b5334a640 1 -- 172.21.15.18:0/809591976 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b4c0acd90 con 0x7f2b4c15ef50 2024-09-21T07:10:40.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.261+0000 7f2b3dffb640 1 -- 172.21.15.18:0/809591976 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b48011dd0 con 0x7f2b4c15ef50 2024-09-21T07:10:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.262+0000 7f2b5334a640 1 -- 172.21.15.18:0/809591976 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b4c0ad070 con 0x7f2b4c15ef50 2024-09-21T07:10:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.263+0000 7f2b5334a640 1 -- 172.21.15.18:0/809591976 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b4c15c520 con 0x7f2b4c15ef50 2024-09-21T07:10:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.264+0000 7f2b3dffb640 1 -- 172.21.15.18:0/809591976 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b48018020 con 0x7f2b4c15ef50 2024-09-21T07:10:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.264+0000 7f2b3dffb640 1 --2- 172.21.15.18:0/809591976 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2b30078b90 0x7f2b3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.264+0000 7f2b3dffb640 1 -- 172.21.15.18:0/809591976 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2b4809a620 con 0x7f2b4c15ef50 2024-09-21T07:10:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.264+0000 7f2b510e6640 1 --2- 172.21.15.18:0/809591976 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2b30078b90 0x7f2b3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.265+0000 7f2b510e6640 1 --2- 172.21.15.18:0/809591976 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2b30078b90 0x7f2b3007b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2b40034000 tx=0x7f2b40004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:40.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.269+0000 7f2b3dffb640 1 -- 172.21.15.18:0/809591976 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2b480627f0 con 0x7f2b4c15ef50 2024-09-21T07:10:40.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:40.458+0000 7f2b5334a640 1 -- 172.21.15.18:0/809591976 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2b4c050f60 con 0x7f2b4c15ef50 2024-09-21T07:10:41.241 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:10:41.245 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:10:41.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.378+0000 7f2b3dffb640 1 -- 172.21.15.18:0/809591976 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f2b48067220 con 0x7f2b4c15ef50 2024-09-21T07:10:41.380 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-21T07:10:41.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.383+0000 7f2b5334a640 1 -- 172.21.15.18:0/809591976 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2b30078b90 msgr2=0x7f2b3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:41.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.383+0000 7f2b5334a640 1 --2- 172.21.15.18:0/809591976 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2b30078b90 0x7f2b3007b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2b40034000 tx=0x7f2b40004730 comp rx=0 tx=0).stop 2024-09-21T07:10:41.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.383+0000 7f2b5334a640 1 -- 172.21.15.18:0/809591976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ef50 msgr2=0x7f2b4c15b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:41.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.383+0000 7f2b5334a640 1 --2- 172.21.15.18:0/809591976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ef50 0x7f2b4c15b040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800b3e0 tx=0x7f2b4800b8a0 comp rx=0 tx=0).stop 2024-09-21T07:10:41.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.383+0000 7f2b5334a640 1 -- 172.21.15.18:0/809591976 shutdown_connections 2024-09-21T07:10:41.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.383+0000 7f2b5334a640 1 --2- 172.21.15.18:0/809591976 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2b30078b90 0x7f2b3007b0a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:41.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.384+0000 7f2b5334a640 1 --2- 172.21.15.18:0/809591976 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2b4c162a40 0x7f2b4c0ab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:41.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.384+0000 7f2b5334a640 1 --2- 172.21.15.18:0/809591976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ef50 0x7f2b4c15b040 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:41.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.384+0000 7f2b5334a640 1 --2- 172.21.15.18:0/809591976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b4c0cef70 0x7f2b4c0cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:41.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.384+0000 7f2b5334a640 1 -- 172.21.15.18:0/809591976 >> 172.21.15.18:0/809591976 conn(0x7f2b4c073f30 msgr2=0x7f2b4c0b6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:41.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.384+0000 7f2b5334a640 1 -- 172.21.15.18:0/809591976 shutdown_connections 2024-09-21T07:10:41.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.384+0000 7f2b5334a640 1 -- 172.21.15.18:0/809591976 wait complete. 2024-09-21T07:10:41.403 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:10:41.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.531+0000 7f44b1372640 1 -- 172.21.15.18:0/939483751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44ac162a40 msgr2=0x7f44ac162e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:41.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.531+0000 7f44b1372640 1 --2- 172.21.15.18:0/939483751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44ac162a40 0x7f44ac162e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f449c005fd0 tx=0x7f449c02a8b0 comp rx=0 tx=0).stop 2024-09-21T07:10:41.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.531+0000 7f44b1372640 1 -- 172.21.15.18:0/939483751 shutdown_connections 2024-09-21T07:10:41.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.531+0000 7f44b1372640 1 --2- 172.21.15.18:0/939483751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44ac162a40 0x7f44ac162e50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:41.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.531+0000 7f44b1372640 1 --2- 172.21.15.18:0/939483751 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f44ac15ef50 0x7f44ac15c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:41.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.531+0000 7f44b1372640 1 -- 172.21.15.18:0/939483751 >> 172.21.15.18:0/939483751 conn(0x7f44ac073f30 msgr2=0x7f44ac0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:41.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.531+0000 7f44b1372640 1 -- 172.21.15.18:0/939483751 shutdown_connections 2024-09-21T07:10:41.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.531+0000 7f44b1372640 1 -- 172.21.15.18:0/939483751 wait complete. 2024-09-21T07:10:41.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.533+0000 7f44b1372640 1 Processor -- start 2024-09-21T07:10:41.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.533+0000 7f44b1372640 1 -- start start 2024-09-21T07:10:41.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.534+0000 7f44b1372640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44ac0cef70 0x7f44ac158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:41.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.534+0000 7f44b1372640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44ac15ef50 0x7f44ac1f96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:41.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.534+0000 7f44b1372640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f44ac162a40 0x7f44ac0abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:41.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.534+0000 7f44b1372640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac0d11a0 con 0x7f44ac15ef50 2024-09-21T07:10:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.534+0000 7f44b1372640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac0d1020 con 0x7f44ac0cef70 2024-09-21T07:10:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.534+0000 7f44b1372640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f44ac0d1320 con 0x7f44ac162a40 2024-09-21T07:10:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.534+0000 7f44aa7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44ac15ef50 0x7f44ac1f96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.534+0000 7f44aa7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44ac15ef50 0x7f44ac1f96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35018/0 (socket says 172.21.15.18:35018) 2024-09-21T07:10:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.534+0000 7f44aa7fc640 1 -- 172.21.15.18:0/3469792521 learned_addr learned my addr 172.21.15.18:0/3469792521 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.535+0000 7f44ab7fe640 1 --2- 172.21.15.18:0/3469792521 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f44ac162a40 0x7f44ac0abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.535+0000 7f44aaffd640 1 --2- 172.21.15.18:0/3469792521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44ac0cef70 0x7f44ac158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.535+0000 7f44aa7fc640 1 -- 172.21.15.18:0/3469792521 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f44ac162a40 msgr2=0x7f44ac0abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.535+0000 7f44aa7fc640 1 --2- 172.21.15.18:0/3469792521 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f44ac162a40 0x7f44ac0abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.535+0000 7f44aa7fc640 1 -- 172.21.15.18:0/3469792521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44ac0cef70 msgr2=0x7f44ac158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.535+0000 7f44aa7fc640 1 --2- 172.21.15.18:0/3469792521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44ac0cef70 0x7f44ac158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.535+0000 7f44aa7fc640 1 -- 172.21.15.18:0/3469792521 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44ac0cd670 con 0x7f44ac15ef50 2024-09-21T07:10:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.535+0000 7f44aa7fc640 1 --2- 172.21.15.18:0/3469792521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44ac15ef50 0x7f44ac1f96f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f449400c3c0 tx=0x7f449400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.535+0000 7f44a37fe640 1 -- 172.21.15.18:0/3469792521 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4494011790 con 0x7f44ac15ef50 2024-09-21T07:10:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.535+0000 7f44a37fe640 1 -- 172.21.15.18:0/3469792521 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4494017070 con 0x7f44ac15ef50 2024-09-21T07:10:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.535+0000 7f44b1372640 1 -- 172.21.15.18:0/3469792521 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44ac0b97d0 con 0x7f44ac15ef50 2024-09-21T07:10:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.535+0000 7f44a37fe640 1 -- 172.21.15.18:0/3469792521 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4494011d20 con 0x7f44ac15ef50 2024-09-21T07:10:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.535+0000 7f44b1372640 1 -- 172.21.15.18:0/3469792521 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44ac0b9ab0 con 0x7f44ac15ef50 2024-09-21T07:10:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.536+0000 7f44b1372640 1 -- 172.21.15.18:0/3469792521 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44ac0b9540 con 0x7f44ac15ef50 2024-09-21T07:10:41.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.537+0000 7f44a37fe640 1 -- 172.21.15.18:0/3469792521 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f449401c460 con 0x7f44ac15ef50 2024-09-21T07:10:41.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.538+0000 7f44a37fe640 1 --2- 172.21.15.18:0/3469792521 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f448c078bc0 0x7f448c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:41.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.538+0000 7f44a37fe640 1 -- 172.21.15.18:0/3469792521 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f449409a7e0 con 0x7f44ac15ef50 2024-09-21T07:10:41.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.538+0000 7f44aaffd640 1 --2- 172.21.15.18:0/3469792521 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f448c078bc0 0x7f448c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:41.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.538+0000 7f44aaffd640 1 --2- 172.21.15.18:0/3469792521 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f448c078bc0 0x7f448c07b0d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009ac0 tx=0x7f44a4005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:41.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.543+0000 7f44a37fe640 1 -- 172.21.15.18:0/3469792521 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4494062e90 con 0x7f44ac15ef50 2024-09-21T07:10:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:41.730+0000 7f44b1372640 1 -- 172.21.15.18:0/3469792521 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f44ac0d0de0 con 0x7f44ac15ef50 2024-09-21T07:10:42.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.384+0000 7f44a37fe640 1 -- 172.21.15.18:0/3469792521 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f44ac0d0de0 con 0x7f44ac15ef50 2024-09-21T07:10:42.386 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-21T07:10:42.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.388+0000 7f44b1372640 1 -- 172.21.15.18:0/3469792521 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f448c078bc0 msgr2=0x7f448c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:42.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.388+0000 7f44b1372640 1 --2- 172.21.15.18:0/3469792521 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f448c078bc0 0x7f448c07b0d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009ac0 tx=0x7f44a4005f90 comp rx=0 tx=0).stop 2024-09-21T07:10:42.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.388+0000 7f44b1372640 1 -- 172.21.15.18:0/3469792521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44ac15ef50 msgr2=0x7f44ac1f96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:42.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.388+0000 7f44b1372640 1 --2- 172.21.15.18:0/3469792521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44ac15ef50 0x7f44ac1f96f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f449400c3c0 tx=0x7f449400c880 comp rx=0 tx=0).stop 2024-09-21T07:10:42.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.388+0000 7f44b1372640 1 -- 172.21.15.18:0/3469792521 shutdown_connections 2024-09-21T07:10:42.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.388+0000 7f44b1372640 1 --2- 172.21.15.18:0/3469792521 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f448c078bc0 0x7f448c07b0d0 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009ac0 tx=0x7f44a4005f90 comp rx=0 tx=0).stop 2024-09-21T07:10:42.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.388+0000 7f44b1372640 1 --2- 172.21.15.18:0/3469792521 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f44ac162a40 0x7f44ac0abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:42.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.388+0000 7f44b1372640 1 --2- 172.21.15.18:0/3469792521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44ac15ef50 0x7f44ac1f96f0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f449400c3c0 tx=0x7f449400c880 comp rx=0 tx=0).stop 2024-09-21T07:10:42.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.388+0000 7f44b1372640 1 --2- 172.21.15.18:0/3469792521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44ac0cef70 0x7f44ac158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:42.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.388+0000 7f44b1372640 1 -- 172.21.15.18:0/3469792521 >> 172.21.15.18:0/3469792521 conn(0x7f44ac073f30 msgr2=0x7f44ac0d4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:42.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.389+0000 7f44b1372640 1 -- 172.21.15.18:0/3469792521 shutdown_connections 2024-09-21T07:10:42.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.389+0000 7f44b1372640 1 -- 172.21.15.18:0/3469792521 wait complete. 2024-09-21T07:10:42.419 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:10:42.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.597+0000 7f1d729ed640 1 -- 172.21.15.18:0/3601862583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d58003a30 msgr2=0x7f1d58003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:42.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.597+0000 7f1d729ed640 1 --2- 172.21.15.18:0/3601862583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d58003a30 0x7f1d58003ea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c006fd0 tx=0x7f1d58005830 comp rx=0 tx=0).stop 2024-09-21T07:10:42.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.597+0000 7f1d70f8a640 1 -- 172.21.15.18:0/3601862583 reap_dead start 2024-09-21T07:10:42.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.597+0000 7f1d729ed640 1 -- 172.21.15.18:0/3601862583 shutdown_connections 2024-09-21T07:10:42.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.597+0000 7f1d729ed640 1 -- 172.21.15.18:0/3601862583 >> 172.21.15.18:0/3601862583 conn(0x7f1d6c073f30 msgr2=0x7f1d6c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:42.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.598+0000 7f1d729ed640 1 -- 172.21.15.18:0/3601862583 shutdown_connections 2024-09-21T07:10:42.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.598+0000 7f1d729ed640 1 -- 172.21.15.18:0/3601862583 wait complete. 2024-09-21T07:10:42.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.599+0000 7f1d729ed640 1 Processor -- start 2024-09-21T07:10:42.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.599+0000 7f1d729ed640 1 -- start start 2024-09-21T07:10:42.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d729ed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d58003a30 0x7f1d6c0b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d729ed640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1d6c0ce690 0x7f1d6c161730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d729ed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d6c15be40 0x7f1d6c161c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d729ed640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6c162fd0 con 0x7f1d6c15be40 2024-09-21T07:10:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d729ed640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6c162e50 con 0x7f1d58003a30 2024-09-21T07:10:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d729ed640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f1d6c163150 con 0x7f1d6c0ce690 2024-09-21T07:10:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d70f8a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d6c15be40 0x7f1d6c161c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d70f8a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d6c15be40 0x7f1d6c161c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35036/0 (socket says 172.21.15.18:35036) 2024-09-21T07:10:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d70f8a640 1 -- 172.21.15.18:0/2918203220 learned_addr learned my addr 172.21.15.18:0/2918203220 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d63fff640 1 --2- 172.21.15.18:0/2918203220 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1d6c0ce690 0x7f1d6c161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d6bfff640 1 --2- 172.21.15.18:0/2918203220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d58003a30 0x7f1d6c0b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d70f8a640 1 -- 172.21.15.18:0/2918203220 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1d6c0ce690 msgr2=0x7f1d6c161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d70f8a640 1 --2- 172.21.15.18:0/2918203220 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1d6c0ce690 0x7f1d6c161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d70f8a640 1 -- 172.21.15.18:0/2918203220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d58003a30 msgr2=0x7f1d6c0b90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d70f8a640 1 --2- 172.21.15.18:0/2918203220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d58003a30 0x7f1d6c0b90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d70f8a640 1 -- 172.21.15.18:0/2918203220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6c1f8b70 con 0x7f1d6c15be40 2024-09-21T07:10:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d6bfff640 1 --2- 172.21.15.18:0/2918203220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d58003a30 0x7f1d6c0b90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:10:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d70f8a640 1 --2- 172.21.15.18:0/2918203220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d6c15be40 0x7f1d6c161c70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1d64005fd0 tx=0x7f1d64011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d697fa640 1 -- 172.21.15.18:0/2918203220 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6400fd70 con 0x7f1d6c15be40 2024-09-21T07:10:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d697fa640 1 -- 172.21.15.18:0/2918203220 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d64003970 con 0x7f1d6c15be40 2024-09-21T07:10:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d729ed640 1 -- 172.21.15.18:0/2918203220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6c1f8e50 con 0x7f1d6c15be40 2024-09-21T07:10:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.601+0000 7f1d697fa640 1 -- 172.21.15.18:0/2918203220 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d64003dc0 con 0x7f1d6c15be40 2024-09-21T07:10:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.602+0000 7f1d729ed640 1 -- 172.21.15.18:0/2918203220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d6c1f9410 con 0x7f1d6c15be40 2024-09-21T07:10:42.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.602+0000 7f1d729ed640 1 -- 172.21.15.18:0/2918203220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d6c0cdad0 con 0x7f1d6c15be40 2024-09-21T07:10:42.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.603+0000 7f1d697fa640 1 -- 172.21.15.18:0/2918203220 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1d64003f60 con 0x7f1d6c15be40 2024-09-21T07:10:42.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.604+0000 7f1d697fa640 1 --2- 172.21.15.18:0/2918203220 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1d4c078b90 0x7f1d4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:42.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.604+0000 7f1d697fa640 1 -- 172.21.15.18:0/2918203220 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f1d6409b6f0 con 0x7f1d6c15be40 2024-09-21T07:10:42.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.604+0000 7f1d6bfff640 1 --2- 172.21.15.18:0/2918203220 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1d4c078b90 0x7f1d4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:42.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.605+0000 7f1d6bfff640 1 --2- 172.21.15.18:0/2918203220 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1d4c078b90 0x7f1d4c07b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c033000 tx=0x7f1d6c162540 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:42.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.609+0000 7f1d697fa640 1 -- 172.21.15.18:0/2918203220 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1d640634a0 con 0x7f1d6c15be40 2024-09-21T07:10:42.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:42.832+0000 7f1d729ed640 1 -- 172.21.15.18:0/2918203220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1d6c1f88e0 con 0x7f1d6c15be40 2024-09-21T07:10:43.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.386+0000 7f1d697fa640 1 -- 172.21.15.18:0/2918203220 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f1d64067ed0 con 0x7f1d6c15be40 2024-09-21T07:10:43.388 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T07:10:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.390+0000 7f1d729ed640 1 -- 172.21.15.18:0/2918203220 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1d4c078b90 msgr2=0x7f1d4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.390+0000 7f1d729ed640 1 --2- 172.21.15.18:0/2918203220 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1d4c078b90 0x7f1d4c07b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c033000 tx=0x7f1d6c162540 comp rx=0 tx=0).stop 2024-09-21T07:10:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.390+0000 7f1d729ed640 1 -- 172.21.15.18:0/2918203220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d6c15be40 msgr2=0x7f1d6c161c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.390+0000 7f1d729ed640 1 --2- 172.21.15.18:0/2918203220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d6c15be40 0x7f1d6c161c70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1d64005fd0 tx=0x7f1d64011f90 comp rx=0 tx=0).stop 2024-09-21T07:10:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.391+0000 7f1d729ed640 1 -- 172.21.15.18:0/2918203220 shutdown_connections 2024-09-21T07:10:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.391+0000 7f1d729ed640 1 --2- 172.21.15.18:0/2918203220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d6c15be40 0x7f1d6c161c70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.391+0000 7f1d729ed640 1 --2- 172.21.15.18:0/2918203220 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1d4c078b90 0x7f1d4c07b0a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.391+0000 7f1d729ed640 1 --2- 172.21.15.18:0/2918203220 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1d6c0ce690 0x7f1d6c161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.391+0000 7f1d729ed640 1 --2- 172.21.15.18:0/2918203220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d58003a30 0x7f1d6c0b90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.391+0000 7f1d729ed640 1 -- 172.21.15.18:0/2918203220 >> 172.21.15.18:0/2918203220 conn(0x7f1d6c073f30 msgr2=0x7f1d6c0b6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:43.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.392+0000 7f1d729ed640 1 -- 172.21.15.18:0/2918203220 shutdown_connections 2024-09-21T07:10:43.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.392+0000 7f1d729ed640 1 -- 172.21.15.18:0/2918203220 wait complete. 2024-09-21T07:10:43.425 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:10:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.545+0000 7f78a9c07640 1 -- 172.21.15.18:0/2008939504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f788c004800 msgr2=0x7f788c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.545+0000 7f78a9c07640 1 --2- 172.21.15.18:0/2008939504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f788c004800 0x7f788c004c10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78a40afbe0 tx=0x7f788c005830 comp rx=0 tx=0).stop 2024-09-21T07:10:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.545+0000 7f78a3fff640 1 -- 172.21.15.18:0/2008939504 reap_dead start 2024-09-21T07:10:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.545+0000 7f78a9c07640 1 -- 172.21.15.18:0/2008939504 shutdown_connections 2024-09-21T07:10:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.545+0000 7f78a9c07640 1 -- 172.21.15.18:0/2008939504 >> 172.21.15.18:0/2008939504 conn(0x7f78a409ba60 msgr2=0x7f78a40b78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.545+0000 7f78a9c07640 1 -- 172.21.15.18:0/2008939504 shutdown_connections 2024-09-21T07:10:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.545+0000 7f78a9c07640 1 -- 172.21.15.18:0/2008939504 wait complete. 2024-09-21T07:10:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.547+0000 7f78a9c07640 1 Processor -- start 2024-09-21T07:10:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.547+0000 7f78a9c07640 1 -- start start 2024-09-21T07:10:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.548+0000 7f78a9c07640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f788c004800 0x7f78a40d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.548+0000 7f78a9c07640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78a40d2600 0x7f78a413bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.548+0000 7f78a9c07640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a413c1e0 0x7f78a409f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.548+0000 7f78a9c07640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f78a40705f0 con 0x7f78a40d2600 2024-09-21T07:10:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.548+0000 7f78a9c07640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f78a4070470 con 0x7f78a413c1e0 2024-09-21T07:10:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.548+0000 7f78a9c07640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f78a4070770 con 0x7f788c004800 2024-09-21T07:10:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.548+0000 7f78a2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78a40d2600 0x7f78a413bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.548+0000 7f78a2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78a40d2600 0x7f78a413bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35046/0 (socket says 172.21.15.18:35046) 2024-09-21T07:10:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.548+0000 7f78a2ffd640 1 -- 172.21.15.18:0/1458226438 learned_addr learned my addr 172.21.15.18:0/1458226438 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.548+0000 7f78a3fff640 1 --2- 172.21.15.18:0/1458226438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a413c1e0 0x7f78a409f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.548+0000 7f78a37fe640 1 --2- 172.21.15.18:0/1458226438 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f788c004800 0x7f78a40d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.549+0000 7f78a2ffd640 1 -- 172.21.15.18:0/1458226438 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f788c004800 msgr2=0x7f78a40d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.549+0000 7f78a2ffd640 1 --2- 172.21.15.18:0/1458226438 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f788c004800 0x7f78a40d20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.549+0000 7f78a2ffd640 1 -- 172.21.15.18:0/1458226438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a413c1e0 msgr2=0x7f78a409f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.549+0000 7f78a2ffd640 1 --2- 172.21.15.18:0/1458226438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a413c1e0 0x7f78a409f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.549+0000 7f78a2ffd640 1 -- 172.21.15.18:0/1458226438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a4159a00 con 0x7f78a40d2600 2024-09-21T07:10:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.549+0000 7f78a2ffd640 1 --2- 172.21.15.18:0/1458226438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78a40d2600 0x7f78a413bca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7898009a70 tx=0x7f7898033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.549+0000 7f788bfff640 1 -- 172.21.15.18:0/1458226438 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898038040 con 0x7f78a40d2600 2024-09-21T07:10:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.549+0000 7f788bfff640 1 -- 172.21.15.18:0/1458226438 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7898004020 con 0x7f78a40d2600 2024-09-21T07:10:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.549+0000 7f78a9c07640 1 -- 172.21.15.18:0/1458226438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a4159ce0 con 0x7f78a40d2600 2024-09-21T07:10:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.549+0000 7f788bfff640 1 -- 172.21.15.18:0/1458226438 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898004470 con 0x7f78a40d2600 2024-09-21T07:10:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.549+0000 7f78a9c07640 1 -- 172.21.15.18:0/1458226438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a415a2a0 con 0x7f78a40d2600 2024-09-21T07:10:43.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.550+0000 7f78a9c07640 1 -- 172.21.15.18:0/1458226438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a415da80 con 0x7f78a40d2600 2024-09-21T07:10:43.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.551+0000 7f788bfff640 1 -- 172.21.15.18:0/1458226438 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7898045020 con 0x7f78a40d2600 2024-09-21T07:10:43.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.551+0000 7f788bfff640 1 --2- 172.21.15.18:0/1458226438 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7890078b90 0x7f789007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:43.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.551+0000 7f788bfff640 1 -- 172.21.15.18:0/1458226438 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f78980bb640 con 0x7f78a40d2600 2024-09-21T07:10:43.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.552+0000 7f78a37fe640 1 --2- 172.21.15.18:0/1458226438 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7890078b90 0x7f789007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:43.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.552+0000 7f78a37fe640 1 --2- 172.21.15.18:0/1458226438 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7890078b90 0x7f789007b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7894001220 tx=0x7f7894006720 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:43.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.556+0000 7f788bfff640 1 -- 172.21.15.18:0/1458226438 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7898083390 con 0x7f78a40d2600 2024-09-21T07:10:43.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.743+0000 7f78a9c07640 1 -- 172.21.15.18:0/1458226438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78a40b7b10 con 0x7f78a40d2600 2024-09-21T07:10:43.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.745+0000 7f788bfff640 1 -- 172.21.15.18:0/1458226438 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16654 (secure 0 0 0) 0x7f7898087dc0 con 0x7f78a40d2600 2024-09-21T07:10:43.747 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:43.747 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":20,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:10:42.834000+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:40.463042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:41.734661+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:10:43.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.747+0000 7f78a9c07640 1 -- 172.21.15.18:0/1458226438 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7890078b90 msgr2=0x7f789007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:43.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.747+0000 7f78a9c07640 1 --2- 172.21.15.18:0/1458226438 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7890078b90 0x7f789007b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7894001220 tx=0x7f7894006720 comp rx=0 tx=0).stop 2024-09-21T07:10:43.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.747+0000 7f78a9c07640 1 -- 172.21.15.18:0/1458226438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78a40d2600 msgr2=0x7f78a413bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:43.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.747+0000 7f78a9c07640 1 --2- 172.21.15.18:0/1458226438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78a40d2600 0x7f78a413bca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7898009a70 tx=0x7f7898033670 comp rx=0 tx=0).stop 2024-09-21T07:10:43.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.747+0000 7f78a9c07640 1 -- 172.21.15.18:0/1458226438 shutdown_connections 2024-09-21T07:10:43.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.747+0000 7f78a9c07640 1 --2- 172.21.15.18:0/1458226438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a413c1e0 0x7f78a409f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:43.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.747+0000 7f78a9c07640 1 --2- 172.21.15.18:0/1458226438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78a40d2600 0x7f78a413bca0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:43.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.747+0000 7f78a9c07640 1 --2- 172.21.15.18:0/1458226438 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7890078b90 0x7f789007b0a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:43.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.747+0000 7f78a9c07640 1 --2- 172.21.15.18:0/1458226438 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f788c004800 0x7f78a40d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:43.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.747+0000 7f78a9c07640 1 -- 172.21.15.18:0/1458226438 >> 172.21.15.18:0/1458226438 conn(0x7f78a409ba60 msgr2=0x7f78a40b5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:43.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.747+0000 7f78a9c07640 1 -- 172.21.15.18:0/1458226438 shutdown_connections 2024-09-21T07:10:43.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.747+0000 7f78a9c07640 1 -- 172.21.15.18:0/1458226438 wait complete. 2024-09-21T07:10:43.760 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:10:43.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.874+0000 7f10f984a640 1 -- 172.21.15.18:0/243479340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f415ef50 msgr2=0x7f10f415c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:43.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.874+0000 7f10f984a640 1 --2- 172.21.15.18:0/243479340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f415ef50 0x7f10f415c520 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10f40d1fb0 tx=0x7f10e402a560 comp rx=0 tx=0).stop 2024-09-21T07:10:43.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.874+0000 7f10f984a640 1 -- 172.21.15.18:0/243479340 shutdown_connections 2024-09-21T07:10:43.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.874+0000 7f10f984a640 1 --2- 172.21.15.18:0/243479340 >> v2:172.21.15.49:3300/0 conn(0x7f10f40cef70 0x7f10f40d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:43.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.874+0000 7f10f984a640 1 --2- 172.21.15.18:0/243479340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f415ef50 0x7f10f415c520 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:43.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.874+0000 7f10f984a640 1 -- 172.21.15.18:0/243479340 >> 172.21.15.18:0/243479340 conn(0x7f10f4073f30 msgr2=0x7f10f40b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:43.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.874+0000 7f10f984a640 1 -- 172.21.15.18:0/243479340 shutdown_connections 2024-09-21T07:10:43.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.874+0000 7f10f984a640 1 -- 172.21.15.18:0/243479340 wait complete. 2024-09-21T07:10:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.876+0000 7f10f984a640 1 Processor -- start 2024-09-21T07:10:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.876+0000 7f10f984a640 1 -- start start 2024-09-21T07:10:43.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.877+0000 7f10f984a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40cef70 0x7f10f415ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:43.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.877+0000 7f10f984a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f40d3580 0x7f10f40abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:43.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.877+0000 7f10f984a640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f10f415ef50 0x7f10f4161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:43.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.877+0000 7f10f984a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10f40d1020 con 0x7f10f40d3580 2024-09-21T07:10:43.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.877+0000 7f10f984a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f10f4163360 con 0x7f10f40cef70 2024-09-21T07:10:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.877+0000 7f10f984a640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f10f40d11a0 con 0x7f10f415ef50 2024-09-21T07:10:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.877+0000 7f10f27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f40d3580 0x7f10f40abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.877+0000 7f10f27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f40d3580 0x7f10f40abd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35072/0 (socket says 172.21.15.18:35072) 2024-09-21T07:10:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.877+0000 7f10f27fc640 1 -- 172.21.15.18:0/747509303 learned_addr learned my addr 172.21.15.18:0/747509303 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.877+0000 7f10f37fe640 1 --2- 172.21.15.18:0/747509303 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f10f415ef50 0x7f10f4161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.877+0000 7f10f2ffd640 1 --2- 172.21.15.18:0/747509303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40cef70 0x7f10f415ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.878+0000 7f10f27fc640 1 -- 172.21.15.18:0/747509303 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f10f415ef50 msgr2=0x7f10f4161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.878+0000 7f10f27fc640 1 --2- 172.21.15.18:0/747509303 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f10f415ef50 0x7f10f4161020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.878+0000 7f10f27fc640 1 -- 172.21.15.18:0/747509303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40cef70 msgr2=0x7f10f415ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.878+0000 7f10f27fc640 1 --2- 172.21.15.18:0/747509303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40cef70 0x7f10f415ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.878+0000 7f10f27fc640 1 -- 172.21.15.18:0/747509303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f415b260 con 0x7f10f40d3580 2024-09-21T07:10:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.878+0000 7f10f27fc640 1 --2- 172.21.15.18:0/747509303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f40d3580 0x7f10f40abd40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f10e800d750 tx=0x7f10e800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.878+0000 7f10dbfff640 1 -- 172.21.15.18:0/747509303 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8017070 con 0x7f10f40d3580 2024-09-21T07:10:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.878+0000 7f10dbfff640 1 -- 172.21.15.18:0/747509303 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10e8009d40 con 0x7f10f40d3580 2024-09-21T07:10:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.878+0000 7f10dbfff640 1 -- 172.21.15.18:0/747509303 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e80106c0 con 0x7f10f40d3580 2024-09-21T07:10:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.878+0000 7f10f984a640 1 -- 172.21.15.18:0/747509303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f40cba10 con 0x7f10f40d3580 2024-09-21T07:10:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.878+0000 7f10f984a640 1 -- 172.21.15.18:0/747509303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f40cbfd0 con 0x7f10f40d3580 2024-09-21T07:10:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.879+0000 7f10f984a640 1 -- 172.21.15.18:0/747509303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f415c030 con 0x7f10f40d3580 2024-09-21T07:10:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.880+0000 7f10dbfff640 1 -- 172.21.15.18:0/747509303 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f10e801a070 con 0x7f10f40d3580 2024-09-21T07:10:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.880+0000 7f10dbfff640 1 --2- 172.21.15.18:0/747509303 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f10e0078b90 0x7f10e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.880+0000 7f10dbfff640 1 -- 172.21.15.18:0/747509303 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f10e809ae80 con 0x7f10f40d3580 2024-09-21T07:10:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.880+0000 7f10f2ffd640 1 --2- 172.21.15.18:0/747509303 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f10e0078b90 0x7f10e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.881+0000 7f10f2ffd640 1 --2- 172.21.15.18:0/747509303 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f10e0078b90 0x7f10e007b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f10e4033000 tx=0x7f10e4004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:43.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:43.885+0000 7f10dbfff640 1 -- 172.21.15.18:0/747509303 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f10e800de60 con 0x7f10f40d3580 2024-09-21T07:10:44.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.070+0000 7f10f984a640 1 -- 172.21.15.18:0/747509303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10f415bd50 con 0x7f10f40d3580 2024-09-21T07:10:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.072+0000 7f10dbfff640 1 -- 172.21.15.18:0/747509303 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16654 (secure 0 0 0) 0x7f10e8062c80 con 0x7f10f40d3580 2024-09-21T07:10:44.073 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:44.074 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":20,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:10:42.834000+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:40.463042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:41.734661+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:10:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.074+0000 7f10f984a640 1 -- 172.21.15.18:0/747509303 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f10e0078b90 msgr2=0x7f10e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.074+0000 7f10f984a640 1 --2- 172.21.15.18:0/747509303 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f10e0078b90 0x7f10e007b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f10e4033000 tx=0x7f10e4004730 comp rx=0 tx=0).stop 2024-09-21T07:10:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.074+0000 7f10f984a640 1 -- 172.21.15.18:0/747509303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f40d3580 msgr2=0x7f10f40abd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.074+0000 7f10f984a640 1 --2- 172.21.15.18:0/747509303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f40d3580 0x7f10f40abd40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f10e800d750 tx=0x7f10e800dc10 comp rx=0 tx=0).stop 2024-09-21T07:10:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.074+0000 7f10f984a640 1 -- 172.21.15.18:0/747509303 shutdown_connections 2024-09-21T07:10:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.074+0000 7f10f984a640 1 --2- 172.21.15.18:0/747509303 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f10e0078b90 0x7f10e007b0a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.074+0000 7f10f984a640 1 --2- 172.21.15.18:0/747509303 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f10f415ef50 0x7f10f4161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.074+0000 7f10f984a640 1 --2- 172.21.15.18:0/747509303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f40d3580 0x7f10f40abd40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.074+0000 7f10f984a640 1 --2- 172.21.15.18:0/747509303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f40cef70 0x7f10f415ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.074+0000 7f10f984a640 1 -- 172.21.15.18:0/747509303 >> 172.21.15.18:0/747509303 conn(0x7f10f4073f30 msgr2=0x7f10f415deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.074+0000 7f10f984a640 1 -- 172.21.15.18:0/747509303 shutdown_connections 2024-09-21T07:10:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.074+0000 7f10f984a640 1 -- 172.21.15.18:0/747509303 wait complete. 2024-09-21T07:10:44.087 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:10:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.205+0000 7f3eb237b640 1 -- 172.21.15.18:0/1038601042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3eac15ef50 msgr2=0x7f3eac15c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.205+0000 7f3eb237b640 1 --2- 172.21.15.18:0/1038601042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3eac15ef50 0x7f3eac15c520 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0d2570 tx=0x7f3e9c02a5f0 comp rx=0 tx=0).stop 2024-09-21T07:10:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.205+0000 7f3eb237b640 1 -- 172.21.15.18:0/1038601042 shutdown_connections 2024-09-21T07:10:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.205+0000 7f3eb237b640 1 --2- 172.21.15.18:0/1038601042 >> v2:172.21.15.49:3300/0 conn(0x7f3eac162a40 0x7f3eac162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.205+0000 7f3eb237b640 1 --2- 172.21.15.18:0/1038601042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3eac15ef50 0x7f3eac15c520 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.205+0000 7f3eb237b640 1 -- 172.21.15.18:0/1038601042 >> 172.21.15.18:0/1038601042 conn(0x7f3eac073f30 msgr2=0x7f3eac0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.205+0000 7f3eb237b640 1 -- 172.21.15.18:0/1038601042 shutdown_connections 2024-09-21T07:10:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.205+0000 7f3eb237b640 1 -- 172.21.15.18:0/1038601042 wait complete. 2024-09-21T07:10:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.207+0000 7f3eb237b640 1 Processor -- start 2024-09-21T07:10:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.207+0000 7f3eb237b640 1 -- start start 2024-09-21T07:10:44.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.208+0000 7f3eb237b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eac0cef70 0x7f3eac1f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:44.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.208+0000 7f3eb237b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f3eac15ef50 0x7f3eac14dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.208+0000 7f3eb237b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3eac162a40 0x7f3eac1f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.208+0000 7f3eb237b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3eac0d11a0 con 0x7f3eac162a40 2024-09-21T07:10:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.208+0000 7f3eb237b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3eac0d1020 con 0x7f3eac0cef70 2024-09-21T07:10:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.208+0000 7f3eb237b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f3eac0d1320 con 0x7f3eac15ef50 2024-09-21T07:10:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.208+0000 7f3eb0918640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3eac162a40 0x7f3eac1f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.208+0000 7f3eb0918640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3eac162a40 0x7f3eac1f9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35088/0 (socket says 172.21.15.18:35088) 2024-09-21T07:10:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.208+0000 7f3eb0918640 1 -- 172.21.15.18:0/942477552 learned_addr learned my addr 172.21.15.18:0/942477552 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.209+0000 7f3eabfff640 1 --2- 172.21.15.18:0/942477552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eac0cef70 0x7f3eac1f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.209+0000 7f3eab7fe640 1 --2- 172.21.15.18:0/942477552 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f3eac15ef50 0x7f3eac14dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.209+0000 7f3eb0918640 1 -- 172.21.15.18:0/942477552 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f3eac15ef50 msgr2=0x7f3eac14dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.209+0000 7f3eb0918640 1 --2- 172.21.15.18:0/942477552 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f3eac15ef50 0x7f3eac14dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.209+0000 7f3eb0918640 1 -- 172.21.15.18:0/942477552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eac0cef70 msgr2=0x7f3eac1f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.209+0000 7f3eb0918640 1 --2- 172.21.15.18:0/942477552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eac0cef70 0x7f3eac1f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.209+0000 7f3eb0918640 1 -- 172.21.15.18:0/942477552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eac14e180 con 0x7f3eac162a40 2024-09-21T07:10:44.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.209+0000 7f3eab7fe640 1 --2- 172.21.15.18:0/942477552 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f3eac15ef50 0x7f3eac14dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:10:44.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.209+0000 7f3eb0918640 1 --2- 172.21.15.18:0/942477552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3eac162a40 0x7f3eac1f9840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400cab0 tx=0x7f3ea400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:44.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.209+0000 7f3ea8ff9640 1 -- 172.21.15.18:0/942477552 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4007d30 con 0x7f3eac162a40 2024-09-21T07:10:44.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.209+0000 7f3ea8ff9640 1 -- 172.21.15.18:0/942477552 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ea400f450 con 0x7f3eac162a40 2024-09-21T07:10:44.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.209+0000 7f3eb237b640 1 -- 172.21.15.18:0/942477552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eac1f6890 con 0x7f3eac162a40 2024-09-21T07:10:44.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.209+0000 7f3ea8ff9640 1 -- 172.21.15.18:0/942477552 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400f8a0 con 0x7f3eac162a40 2024-09-21T07:10:44.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.209+0000 7f3eb237b640 1 -- 172.21.15.18:0/942477552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eac1f65b0 con 0x7f3eac162a40 2024-09-21T07:10:44.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.210+0000 7f3eb237b640 1 -- 172.21.15.18:0/942477552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eac1f6040 con 0x7f3eac162a40 2024-09-21T07:10:44.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.211+0000 7f3ea8ff9640 1 -- 172.21.15.18:0/942477552 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ea400fa40 con 0x7f3eac162a40 2024-09-21T07:10:44.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.211+0000 7f3ea8ff9640 1 --2- 172.21.15.18:0/942477552 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3e98078b90 0x7f3e9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:44.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.212+0000 7f3ea8ff9640 1 -- 172.21.15.18:0/942477552 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3ea409b690 con 0x7f3eac162a40 2024-09-21T07:10:44.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.212+0000 7f3eabfff640 1 --2- 172.21.15.18:0/942477552 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3e98078b90 0x7f3e9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:44.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.212+0000 7f3eabfff640 1 --2- 172.21.15.18:0/942477552 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3e98078b90 0x7f3e9807b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c033000 tx=0x7f3e9c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:44.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.216+0000 7f3ea8ff9640 1 -- 172.21.15.18:0/942477552 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3ea4014070 con 0x7f3eac162a40 2024-09-21T07:10:44.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:44.447+0000 7f3eb237b640 1 -- 172.21.15.18:0/942477552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3eac0d17d0 con 0x7f3eac162a40 2024-09-21T07:10:45.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.408+0000 7f3ea8ff9640 1 -- 172.21.15.18:0/942477552 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f3ea4063510 con 0x7f3eac162a40 2024-09-21T07:10:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.411+0000 7f3eb237b640 1 -- 172.21.15.18:0/942477552 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3e98078b90 msgr2=0x7f3e9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.411+0000 7f3eb237b640 1 --2- 172.21.15.18:0/942477552 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3e98078b90 0x7f3e9807b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c033000 tx=0x7f3e9c004730 comp rx=0 tx=0).stop 2024-09-21T07:10:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.411+0000 7f3eb237b640 1 -- 172.21.15.18:0/942477552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3eac162a40 msgr2=0x7f3eac1f9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.411+0000 7f3eb237b640 1 --2- 172.21.15.18:0/942477552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3eac162a40 0x7f3eac1f9840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400cab0 tx=0x7f3ea400cf70 comp rx=0 tx=0).stop 2024-09-21T07:10:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.411+0000 7f3eb237b640 1 -- 172.21.15.18:0/942477552 shutdown_connections 2024-09-21T07:10:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.411+0000 7f3eb237b640 1 --2- 172.21.15.18:0/942477552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3eac162a40 0x7f3eac1f9840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.411+0000 7f3eb237b640 1 --2- 172.21.15.18:0/942477552 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3e98078b90 0x7f3e9807b0a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.411+0000 7f3eb237b640 1 --2- 172.21.15.18:0/942477552 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f3eac15ef50 0x7f3eac14dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.411+0000 7f3eb237b640 1 --2- 172.21.15.18:0/942477552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eac0cef70 0x7f3eac1f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.411+0000 7f3eb237b640 1 -- 172.21.15.18:0/942477552 >> 172.21.15.18:0/942477552 conn(0x7f3eac073f30 msgr2=0x7f3eac0d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:45.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.411+0000 7f3eb237b640 1 -- 172.21.15.18:0/942477552 shutdown_connections 2024-09-21T07:10:45.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.411+0000 7f3eb237b640 1 -- 172.21.15.18:0/942477552 wait complete. 2024-09-21T07:10:45.426 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:10:45.426 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:10:45.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.550+0000 7f8d9fc9b640 1 -- 172.21.15.18:0/2365126986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d98068d40 msgr2=0x7f8d980d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.550+0000 7f8d9fc9b640 1 --2- 172.21.15.18:0/2365126986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d98068d40 0x7f8d980d0780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8d980699b0 tx=0x7f8d8802a560 comp rx=0 tx=0).stop 2024-09-21T07:10:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.550+0000 7f8d9fc9b640 1 -- 172.21.15.18:0/2365126986 shutdown_connections 2024-09-21T07:10:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.550+0000 7f8d9fc9b640 1 --2- 172.21.15.18:0/2365126986 >> v2:172.21.15.49:3300/0 conn(0x7f8d98069150 0x7f8d980d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.550+0000 7f8d9fc9b640 1 --2- 172.21.15.18:0/2365126986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d98068d40 0x7f8d980d0780 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.550+0000 7f8d9fc9b640 1 --2- 172.21.15.18:0/2365126986 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8d98145c00 0x7f8d981454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.550+0000 7f8d9fc9b640 1 -- 172.21.15.18:0/2365126986 >> 172.21.15.18:0/2365126986 conn(0x7f8d98074360 msgr2=0x7f8d9806cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.550+0000 7f8d9fc9b640 1 -- 172.21.15.18:0/2365126986 shutdown_connections 2024-09-21T07:10:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.550+0000 7f8d9fc9b640 1 -- 172.21.15.18:0/2365126986 wait complete. 2024-09-21T07:10:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.552+0000 7f8d9fc9b640 1 Processor -- start 2024-09-21T07:10:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.552+0000 7f8d9fc9b640 1 -- start start 2024-09-21T07:10:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.553+0000 7f8d9fc9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d98068d40 0x7f8d981f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9fc9b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8d98069150 0x7f8d980aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9fc9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d98145c00 0x7f8d9813ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9fc9b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8d98160ac0 con 0x7f8d98068d40 2024-09-21T07:10:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9fc9b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8d98160940 con 0x7f8d98145c00 2024-09-21T07:10:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9fc9b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f8d98160c40 con 0x7f8d98069150 2024-09-21T07:10:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9da37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d98068d40 0x7f8d981f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9da37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d98068d40 0x7f8d981f6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35098/0 (socket says 172.21.15.18:35098) 2024-09-21T07:10:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9da37640 1 -- 172.21.15.18:0/3720825988 learned_addr learned my addr 172.21.15.18:0/3720825988 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9e238640 1 --2- 172.21.15.18:0/3720825988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d98145c00 0x7f8d9813ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9d236640 1 --2- 172.21.15.18:0/3720825988 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8d98069150 0x7f8d980aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9da37640 1 -- 172.21.15.18:0/3720825988 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8d98069150 msgr2=0x7f8d980aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9da37640 1 --2- 172.21.15.18:0/3720825988 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8d98069150 0x7f8d980aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9da37640 1 -- 172.21.15.18:0/3720825988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d98145c00 msgr2=0x7f8d9813ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9da37640 1 --2- 172.21.15.18:0/3720825988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d98145c00 0x7f8d9813ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9da37640 1 -- 172.21.15.18:0/3720825988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d981f7150 con 0x7f8d98068d40 2024-09-21T07:10:45.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9da37640 1 --2- 172.21.15.18:0/3720825988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d98068d40 0x7f8d981f6900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400d700 tx=0x7f8d9400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:45.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d8e7fc640 1 -- 172.21.15.18:0/3720825988 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d94017070 con 0x7f8d98068d40 2024-09-21T07:10:45.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d8e7fc640 1 -- 172.21.15.18:0/3720825988 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d94005310 con 0x7f8d98068d40 2024-09-21T07:10:45.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9fc9b640 1 -- 172.21.15.18:0/3720825988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d981f7430 con 0x7f8d98068d40 2024-09-21T07:10:45.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d8e7fc640 1 -- 172.21.15.18:0/3720825988 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d940097c0 con 0x7f8d98068d40 2024-09-21T07:10:45.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.554+0000 7f8d9fc9b640 1 -- 172.21.15.18:0/3720825988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d981f3310 con 0x7f8d98068d40 2024-09-21T07:10:45.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.556+0000 7f8d9fc9b640 1 -- 172.21.15.18:0/3720825988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d98161160 con 0x7f8d98068d40 2024-09-21T07:10:45.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.556+0000 7f8d8e7fc640 1 -- 172.21.15.18:0/3720825988 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d94009960 con 0x7f8d98068d40 2024-09-21T07:10:45.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.557+0000 7f8d8e7fc640 1 --2- 172.21.15.18:0/3720825988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8d7c078b90 0x7f8d7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:45.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.557+0000 7f8d8e7fc640 1 -- 172.21.15.18:0/3720825988 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8d9409ae00 con 0x7f8d98068d40 2024-09-21T07:10:45.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.557+0000 7f8d9d236640 1 --2- 172.21.15.18:0/3720825988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8d7c078b90 0x7f8d7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:45.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.557+0000 7f8d9d236640 1 --2- 172.21.15.18:0/3720825988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8d7c078b90 0x7f8d7c07b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8d88033000 tx=0x7f8d88004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:45.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.561+0000 7f8d8e7fc640 1 -- 172.21.15.18:0/3720825988 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8d94062b50 con 0x7f8d98068d40 2024-09-21T07:10:45.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:45.792+0000 7f8d9fc9b640 1 -- 172.21.15.18:0/3720825988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8d9806aed0 con 0x7f8d98068d40 2024-09-21T07:10:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.413+0000 7f8d8e7fc640 1 -- 172.21.15.18:0/3720825988 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f8d94067580 con 0x7f8d98068d40 2024-09-21T07:10:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.416+0000 7f8d9fc9b640 1 -- 172.21.15.18:0/3720825988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8d7c078b90 msgr2=0x7f8d7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.416+0000 7f8d9fc9b640 1 --2- 172.21.15.18:0/3720825988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8d7c078b90 0x7f8d7c07b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8d88033000 tx=0x7f8d88004730 comp rx=0 tx=0).stop 2024-09-21T07:10:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.416+0000 7f8d9fc9b640 1 -- 172.21.15.18:0/3720825988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d98068d40 msgr2=0x7f8d981f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.416+0000 7f8d9fc9b640 1 --2- 172.21.15.18:0/3720825988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d98068d40 0x7f8d981f6900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400d700 tx=0x7f8d9400dbc0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.416+0000 7f8d9fc9b640 1 -- 172.21.15.18:0/3720825988 shutdown_connections 2024-09-21T07:10:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.416+0000 7f8d9fc9b640 1 --2- 172.21.15.18:0/3720825988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d98145c00 0x7f8d9813ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.416+0000 7f8d9fc9b640 1 --2- 172.21.15.18:0/3720825988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8d7c078b90 0x7f8d7c07b0a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.416+0000 7f8d9fc9b640 1 --2- 172.21.15.18:0/3720825988 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8d98069150 0x7f8d980aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.416+0000 7f8d9fc9b640 1 --2- 172.21.15.18:0/3720825988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d98068d40 0x7f8d981f6900 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.416+0000 7f8d9fc9b640 1 -- 172.21.15.18:0/3720825988 >> 172.21.15.18:0/3720825988 conn(0x7f8d98074360 msgr2=0x7f8d9806dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:46.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.416+0000 7f8d9fc9b640 1 -- 172.21.15.18:0/3720825988 shutdown_connections 2024-09-21T07:10:46.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.416+0000 7f8d9fc9b640 1 -- 172.21.15.18:0/3720825988 wait complete. 2024-09-21T07:10:46.431 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:10:46.431 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:10:46.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.554+0000 7fb39e0b6640 1 -- 172.21.15.18:0/3431953137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb380004800 msgr2=0x7fb380004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:46.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.554+0000 7fb39e0b6640 1 --2- 172.21.15.18:0/3431953137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb380004800 0x7fb380004c10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb3980b3fa0 tx=0x7fb380005830 comp rx=0 tx=0).stop 2024-09-21T07:10:46.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.554+0000 7fb397fff640 1 -- 172.21.15.18:0/3431953137 reap_dead start 2024-09-21T07:10:46.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.554+0000 7fb39e0b6640 1 -- 172.21.15.18:0/3431953137 shutdown_connections 2024-09-21T07:10:46.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.554+0000 7fb39e0b6640 1 -- 172.21.15.18:0/3431953137 >> 172.21.15.18:0/3431953137 conn(0x7fb398073f30 msgr2=0x7fb3980b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:46.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.554+0000 7fb39e0b6640 1 -- 172.21.15.18:0/3431953137 shutdown_connections 2024-09-21T07:10:46.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.554+0000 7fb39e0b6640 1 -- 172.21.15.18:0/3431953137 wait complete. 2024-09-21T07:10:46.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.556+0000 7fb39e0b6640 1 Processor -- start 2024-09-21T07:10:46.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.556+0000 7fb39e0b6640 1 -- start start 2024-09-21T07:10:46.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.557+0000 7fb39e0b6640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb380004800 0x7fb3981f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:46.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.557+0000 7fb39e0b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3980cdcc0 0x7fb3980b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:46.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.557+0000 7fb39e0b6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3980b59b0 0x7fb3980cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:46.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.557+0000 7fb39e0b6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb39815c6a0 con 0x7fb3980b59b0 2024-09-21T07:10:46.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.557+0000 7fb39e0b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb39815c520 con 0x7fb3980cdcc0 2024-09-21T07:10:46.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.557+0000 7fb39e0b6640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fb39815c820 con 0x7fb380004800 2024-09-21T07:10:46.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.557+0000 7fb397fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3980b59b0 0x7fb3980cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:46.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.557+0000 7fb397fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3980b59b0 0x7fb3980cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49918/0 (socket says 172.21.15.18:49918) 2024-09-21T07:10:46.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.557+0000 7fb397fff640 1 -- 172.21.15.18:0/999395988 learned_addr learned my addr 172.21.15.18:0/999395988 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:46.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.557+0000 7fb3977fe640 1 --2- 172.21.15.18:0/999395988 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb380004800 0x7fb3981f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:46.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.557+0000 7fb396ffd640 1 --2- 172.21.15.18:0/999395988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3980cdcc0 0x7fb3980b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:46.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.558+0000 7fb397fff640 1 -- 172.21.15.18:0/999395988 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb380004800 msgr2=0x7fb3981f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:46.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.558+0000 7fb397fff640 1 --2- 172.21.15.18:0/999395988 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb380004800 0x7fb3981f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.558+0000 7fb397fff640 1 -- 172.21.15.18:0/999395988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3980cdcc0 msgr2=0x7fb3980b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:46.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.558+0000 7fb397fff640 1 --2- 172.21.15.18:0/999395988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3980cdcc0 0x7fb3980b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.558+0000 7fb397fff640 1 -- 172.21.15.18:0/999395988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3980ab1c0 con 0x7fb3980b59b0 2024-09-21T07:10:46.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.558+0000 7fb3977fe640 1 --2- 172.21.15.18:0/999395988 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb380004800 0x7fb3981f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:46.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.558+0000 7fb397fff640 1 --2- 172.21.15.18:0/999395988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3980b59b0 0x7fb3980cb7c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb3980b4140 tx=0x7fb39000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:46.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.558+0000 7fb37ffff640 1 -- 172.21.15.18:0/999395988 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390003d80 con 0x7fb3980b59b0 2024-09-21T07:10:46.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.558+0000 7fb37ffff640 1 -- 172.21.15.18:0/999395988 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb390004b20 con 0x7fb3980b59b0 2024-09-21T07:10:46.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.558+0000 7fb39e0b6640 1 -- 172.21.15.18:0/999395988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3980b5dc0 con 0x7fb3980b59b0 2024-09-21T07:10:46.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.558+0000 7fb37ffff640 1 -- 172.21.15.18:0/999395988 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390004030 con 0x7fb3980b59b0 2024-09-21T07:10:46.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.558+0000 7fb39e0b6640 1 -- 172.21.15.18:0/999395988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3981f9260 con 0x7fb3980b59b0 2024-09-21T07:10:46.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.559+0000 7fb39e0b6640 1 -- 172.21.15.18:0/999395988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3981f8cf0 con 0x7fb3980b59b0 2024-09-21T07:10:46.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.560+0000 7fb37ffff640 1 -- 172.21.15.18:0/999395988 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb3900041d0 con 0x7fb3980b59b0 2024-09-21T07:10:46.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.560+0000 7fb37ffff640 1 --2- 172.21.15.18:0/999395988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb384078b90 0x7fb38407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:46.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.561+0000 7fb37ffff640 1 -- 172.21.15.18:0/999395988 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb39009bb20 con 0x7fb3980b59b0 2024-09-21T07:10:46.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.561+0000 7fb3977fe640 1 --2- 172.21.15.18:0/999395988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb384078b90 0x7fb38407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:46.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.561+0000 7fb3977fe640 1 --2- 172.21.15.18:0/999395988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb384078b90 0x7fb38407b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb388005e00 tx=0x7fb388005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:46.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.565+0000 7fb37ffff640 1 -- 172.21.15.18:0/999395988 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb3980b5dc0 con 0x7fb3980b59b0 2024-09-21T07:10:46.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.788+0000 7fb39e0b6640 1 -- 172.21.15.18:0/999395988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3980b3ae0 con 0x7fb3980b59b0 2024-09-21T07:10:46.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.788+0000 7fb37ffff640 1 -- 172.21.15.18:0/999395988 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5214 (secure 0 0 0) 0x7fb390063910 con 0x7fb3980b59b0 2024-09-21T07:10:46.790 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:46.790 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"btime":"2024-09-21T07:10:46:409212+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/760501489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":760501489},{"type":"v1","addr":"172.21.15.49:6835","nonce":760501489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2249656343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2249656343},{"type":"v1","addr":"172.21.15.49:6837","nonce":2249656343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2651218421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2651218421},{"type":"v1","addr":"172.21.15.18:6834","nonce":2651218421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:10:42.833958+0000","modified":"2024-09-21T07:10:45.793498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2785506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2785506081},{"type":"v1","addr":"172.21.15.18:6835","nonce":2785506081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":1}]} 2024-09-21T07:10:46.790 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2024-09-21T07:10:46.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.791+0000 7fb39e0b6640 1 -- 172.21.15.18:0/999395988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb384078b90 msgr2=0x7fb38407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:46.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.791+0000 7fb39e0b6640 1 --2- 172.21.15.18:0/999395988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb384078b90 0x7fb38407b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb388005e00 tx=0x7fb388005f90 comp rx=0 tx=0).stop 2024-09-21T07:10:46.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.791+0000 7fb39e0b6640 1 -- 172.21.15.18:0/999395988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3980b59b0 msgr2=0x7fb3980cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:46.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.791+0000 7fb39e0b6640 1 --2- 172.21.15.18:0/999395988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3980b59b0 0x7fb3980cb7c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb3980b4140 tx=0x7fb39000f790 comp rx=0 tx=0).stop 2024-09-21T07:10:46.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.791+0000 7fb39e0b6640 1 -- 172.21.15.18:0/999395988 shutdown_connections 2024-09-21T07:10:46.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.791+0000 7fb39e0b6640 1 --2- 172.21.15.18:0/999395988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3980b59b0 0x7fb3980cb7c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.791+0000 7fb39e0b6640 1 --2- 172.21.15.18:0/999395988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3980cdcc0 0x7fb3980b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.791+0000 7fb39e0b6640 1 --2- 172.21.15.18:0/999395988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb384078b90 0x7fb38407b0a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.791+0000 7fb39e0b6640 1 --2- 172.21.15.18:0/999395988 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb380004800 0x7fb3981f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.791+0000 7fb39e0b6640 1 -- 172.21.15.18:0/999395988 >> 172.21.15.18:0/999395988 conn(0x7fb398073f30 msgr2=0x7fb39815d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:46.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.791+0000 7fb39e0b6640 1 -- 172.21.15.18:0/999395988 shutdown_connections 2024-09-21T07:10:46.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.791+0000 7fb39e0b6640 1 -- 172.21.15.18:0/999395988 wait complete. 2024-09-21T07:10:46.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:10:46.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.918+0000 7f4c5df5f640 1 -- 172.21.15.18:0/1659360654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c5815ef50 msgr2=0x7f4c5815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:46.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.918+0000 7f4c5df5f640 1 --2- 172.21.15.18:0/1659360654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c5815ef50 0x7f4c5815c520 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4c48005fd0 tx=0x7f4c4802a5d0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.918+0000 7f4c5df5f640 1 -- 172.21.15.18:0/1659360654 shutdown_connections 2024-09-21T07:10:46.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.918+0000 7f4c5df5f640 1 --2- 172.21.15.18:0/1659360654 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4c580cef70 0x7f4c580d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.918+0000 7f4c5df5f640 1 --2- 172.21.15.18:0/1659360654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c5815ef50 0x7f4c5815c520 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.918+0000 7f4c5df5f640 1 -- 172.21.15.18:0/1659360654 >> 172.21.15.18:0/1659360654 conn(0x7f4c58073f30 msgr2=0x7f4c580b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:46.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.918+0000 7f4c5df5f640 1 -- 172.21.15.18:0/1659360654 shutdown_connections 2024-09-21T07:10:46.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.918+0000 7f4c5df5f640 1 -- 172.21.15.18:0/1659360654 wait complete. 2024-09-21T07:10:46.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.920+0000 7f4c5df5f640 1 Processor -- start 2024-09-21T07:10:46.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.920+0000 7f4c5df5f640 1 -- start start 2024-09-21T07:10:46.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.921+0000 7f4c5df5f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580cef70 0x7f4c5815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:46.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.921+0000 7f4c5df5f640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4c580d3580 0x7f4c58151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:46.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.921+0000 7f4c5df5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c5815ef50 0x7f4c580ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:46.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.921+0000 7f4c5df5f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4c580d11a0 con 0x7f4c5815ef50 2024-09-21T07:10:46.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.921+0000 7f4c5df5f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4c580d1020 con 0x7f4c580cef70 2024-09-21T07:10:46.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.921+0000 7f4c5df5f640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f4c580d1320 con 0x7f4c580d3580 2024-09-21T07:10:46.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c57fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c5815ef50 0x7f4c580ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:46.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c57fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c5815ef50 0x7f4c580ce0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49928/0 (socket says 172.21.15.18:49928) 2024-09-21T07:10:46.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c57fff640 1 -- 172.21.15.18:0/626576694 learned_addr learned my addr 172.21.15.18:0/626576694 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:46.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c577fe640 1 --2- 172.21.15.18:0/626576694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580cef70 0x7f4c5815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:46.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c56ffd640 1 --2- 172.21.15.18:0/626576694 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4c580d3580 0x7f4c58151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:46.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c57fff640 1 -- 172.21.15.18:0/626576694 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4c580d3580 msgr2=0x7f4c58151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:46.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c57fff640 1 --2- 172.21.15.18:0/626576694 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4c580d3580 0x7f4c58151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c57fff640 1 -- 172.21.15.18:0/626576694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580cef70 msgr2=0x7f4c5815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:46.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c57fff640 1 --2- 172.21.15.18:0/626576694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580cef70 0x7f4c5815aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:46.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c57fff640 1 -- 172.21.15.18:0/626576694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c580cd310 con 0x7f4c5815ef50 2024-09-21T07:10:46.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c577fe640 1 --2- 172.21.15.18:0/626576694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580cef70 0x7f4c5815aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:10:46.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c57fff640 1 --2- 172.21.15.18:0/626576694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c5815ef50 0x7f4c580ce0d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000c6e0 tx=0x7f4c5000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:46.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c3ffff640 1 -- 172.21.15.18:0/626576694 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c50003b70 con 0x7f4c5815ef50 2024-09-21T07:10:46.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c3ffff640 1 -- 172.21.15.18:0/626576694 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c50003d10 con 0x7f4c5815ef50 2024-09-21T07:10:46.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c5df5f640 1 -- 172.21.15.18:0/626576694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c580cd5f0 con 0x7f4c5815ef50 2024-09-21T07:10:46.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c3ffff640 1 -- 172.21.15.18:0/626576694 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c50005330 con 0x7f4c5815ef50 2024-09-21T07:10:46.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.922+0000 7f4c5df5f640 1 -- 172.21.15.18:0/626576694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c580abf30 con 0x7f4c5815ef50 2024-09-21T07:10:46.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.923+0000 7f4c5df5f640 1 -- 172.21.15.18:0/626576694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c580abca0 con 0x7f4c5815ef50 2024-09-21T07:10:46.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.924+0000 7f4c3ffff640 1 -- 172.21.15.18:0/626576694 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c500054d0 con 0x7f4c5815ef50 2024-09-21T07:10:46.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.925+0000 7f4c3ffff640 1 --2- 172.21.15.18:0/626576694 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4c44078bc0 0x7f4c4407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:46.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.925+0000 7f4c3ffff640 1 -- 172.21.15.18:0/626576694 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4c5009a940 con 0x7f4c5815ef50 2024-09-21T07:10:46.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.925+0000 7f4c577fe640 1 --2- 172.21.15.18:0/626576694 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4c44078bc0 0x7f4c4407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:46.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.926+0000 7f4c577fe640 1 --2- 172.21.15.18:0/626576694 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4c44078bc0 0x7f4c4407b0d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c48033000 tx=0x7f4c48004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:46.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:46.930+0000 7f4c3ffff640 1 -- 172.21.15.18:0/626576694 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4c50062e20 con 0x7f4c5815ef50 2024-09-21T07:10:47.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.120+0000 7f4c5df5f640 1 -- 172.21.15.18:0/626576694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c580d17d0 con 0x7f4c5815ef50 2024-09-21T07:10:47.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.122+0000 7f4c3ffff640 1 -- 172.21.15.18:0/626576694 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f4c50062720 con 0x7f4c5815ef50 2024-09-21T07:10:47.123 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:47.124 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:10:44.397635+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:40.463042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:41.734661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:10:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.124+0000 7f4c5df5f640 1 -- 172.21.15.18:0/626576694 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4c44078bc0 msgr2=0x7f4c4407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.124+0000 7f4c5df5f640 1 --2- 172.21.15.18:0/626576694 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4c44078bc0 0x7f4c4407b0d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c48033000 tx=0x7f4c48004730 comp rx=0 tx=0).stop 2024-09-21T07:10:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.124+0000 7f4c5df5f640 1 -- 172.21.15.18:0/626576694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c5815ef50 msgr2=0x7f4c580ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.124+0000 7f4c5df5f640 1 --2- 172.21.15.18:0/626576694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c5815ef50 0x7f4c580ce0d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000c6e0 tx=0x7f4c5000cba0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.124+0000 7f4c5df5f640 1 -- 172.21.15.18:0/626576694 shutdown_connections 2024-09-21T07:10:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.124+0000 7f4c5df5f640 1 --2- 172.21.15.18:0/626576694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c5815ef50 0x7f4c580ce0d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.124+0000 7f4c5df5f640 1 --2- 172.21.15.18:0/626576694 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4c44078bc0 0x7f4c4407b0d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.124+0000 7f4c5df5f640 1 --2- 172.21.15.18:0/626576694 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4c580d3580 0x7f4c58151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.124+0000 7f4c5df5f640 1 --2- 172.21.15.18:0/626576694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580cef70 0x7f4c5815aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.124+0000 7f4c5df5f640 1 -- 172.21.15.18:0/626576694 >> 172.21.15.18:0/626576694 conn(0x7f4c58073f30 msgr2=0x7f4c5815cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:47.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.124+0000 7f4c5df5f640 1 -- 172.21.15.18:0/626576694 shutdown_connections 2024-09-21T07:10:47.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.124+0000 7f4c5df5f640 1 -- 172.21.15.18:0/626576694 wait complete. 2024-09-21T07:10:47.138 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:10:47.138 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:10:47.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.252+0000 7f4f8c47e640 1 -- 172.21.15.18:0/3961033479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f840709b0 msgr2=0x7f4f8415d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:47.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.252+0000 7f4f8c47e640 1 --2- 172.21.15.18:0/3961033479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f840709b0 0x7f4f8415d0f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f84074520 tx=0x7f4f7c02a560 comp rx=0 tx=0).stop 2024-09-21T07:10:47.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.252+0000 7f4f8c47e640 1 -- 172.21.15.18:0/3961033479 shutdown_connections 2024-09-21T07:10:47.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.252+0000 7f4f8c47e640 1 --2- 172.21.15.18:0/3961033479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f840709b0 0x7f4f8415d0f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.252+0000 7f4f8c47e640 1 --2- 172.21.15.18:0/3961033479 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4f840afe70 0x7f4f84070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.252+0000 7f4f8c47e640 1 --2- 172.21.15.18:0/3961033479 >> v2:172.21.15.49:3300/0 conn(0x7f4f840b6a00 0x7f4f840b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.252+0000 7f4f8c47e640 1 -- 172.21.15.18:0/3961033479 >> 172.21.15.18:0/3961033479 conn(0x7f4f8409ba60 msgr2=0x7f4f840b78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:47.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.252+0000 7f4f8c47e640 1 -- 172.21.15.18:0/3961033479 shutdown_connections 2024-09-21T07:10:47.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.252+0000 7f4f8c47e640 1 -- 172.21.15.18:0/3961033479 wait complete. 2024-09-21T07:10:47.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.254+0000 7f4f8c47e640 1 Processor -- start 2024-09-21T07:10:47.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.254+0000 7f4f8c47e640 1 -- start start 2024-09-21T07:10:47.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8c47e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f840709b0 0x7f4f8413dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:47.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8c47e640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4f840afe70 0x7f4f8409dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:47.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8c47e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f840b6a00 0x7f4f8415f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8c47e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8415d630 con 0x7f4f840709b0 2024-09-21T07:10:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8c47e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4f84070fd0 con 0x7f4f840b6a00 2024-09-21T07:10:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8c47e640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f4f8415d7b0 con 0x7f4f840afe70 2024-09-21T07:10:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8a21a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f840709b0 0x7f4f8413dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8a21a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f840709b0 0x7f4f8413dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49946/0 (socket says 172.21.15.18:49946) 2024-09-21T07:10:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8a21a640 1 -- 172.21.15.18:0/3846204531 learned_addr learned my addr 172.21.15.18:0/3846204531 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8a21a640 1 -- 172.21.15.18:0/3846204531 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4f840afe70 msgr2=0x7f4f8409dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8a21a640 1 --2- 172.21.15.18:0/3846204531 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4f840afe70 0x7f4f8409dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8a21a640 1 -- 172.21.15.18:0/3846204531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f840b6a00 msgr2=0x7f4f8415f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8a21a640 1 --2- 172.21.15.18:0/3846204531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f840b6a00 0x7f4f8415f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8a21a640 1 -- 172.21.15.18:0/3846204531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f8406cde0 con 0x7f4f840709b0 2024-09-21T07:10:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8a21a640 1 --2- 172.21.15.18:0/3846204531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f840709b0 0x7f4f8413dfe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400eb60 tx=0x7f4f7400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f82ffd640 1 -- 172.21.15.18:0/3846204531 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f74010630 con 0x7f4f840709b0 2024-09-21T07:10:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f82ffd640 1 -- 172.21.15.18:0/3846204531 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f740108c0 con 0x7f4f840709b0 2024-09-21T07:10:47.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f82ffd640 1 -- 172.21.15.18:0/3846204531 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f74010d10 con 0x7f4f840709b0 2024-09-21T07:10:47.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8c47e640 1 -- 172.21.15.18:0/3846204531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f8409e690 con 0x7f4f840709b0 2024-09-21T07:10:47.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.256+0000 7f4f8c47e640 1 -- 172.21.15.18:0/3846204531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f8406d3a0 con 0x7f4f840709b0 2024-09-21T07:10:47.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.257+0000 7f4f8c47e640 1 -- 172.21.15.18:0/3846204531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f8415dc60 con 0x7f4f840709b0 2024-09-21T07:10:47.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.258+0000 7f4f82ffd640 1 -- 172.21.15.18:0/3846204531 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4f74018420 con 0x7f4f840709b0 2024-09-21T07:10:47.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.259+0000 7f4f82ffd640 1 --2- 172.21.15.18:0/3846204531 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4f70078b90 0x7f4f7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:47.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.259+0000 7f4f82ffd640 1 -- 172.21.15.18:0/3846204531 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4f7409bb90 con 0x7f4f840709b0 2024-09-21T07:10:47.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.259+0000 7f4f89a19640 1 --2- 172.21.15.18:0/3846204531 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4f70078b90 0x7f4f7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:47.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.259+0000 7f4f89a19640 1 --2- 172.21.15.18:0/3846204531 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4f70078b90 0x7f4f7007b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f8409f930 tx=0x7f4f780094f0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.263+0000 7f4f82ffd640 1 -- 172.21.15.18:0/3846204531 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4f7400ee60 con 0x7f4f840709b0 2024-09-21T07:10:47.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.450+0000 7f4f8c47e640 1 -- 172.21.15.18:0/3846204531 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4f8406b490 con 0x7f4f70078b90 2024-09-21T07:10:47.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.455+0000 7f4f82ffd640 1 -- 172.21.15.18:0/3846204531 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242899 (secure 0 0 0) 0x7f4f78009680 con 0x7f4f70078b90 2024-09-21T07:10:47.460 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:47.461 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-21T07:10:47.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.458+0000 7f4f8c47e640 1 -- 172.21.15.18:0/3846204531 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4f70078b90 msgr2=0x7f4f7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:47.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.458+0000 7f4f8c47e640 1 --2- 172.21.15.18:0/3846204531 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4f70078b90 0x7f4f7007b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f8409f930 tx=0x7f4f780094f0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.458+0000 7f4f8c47e640 1 -- 172.21.15.18:0/3846204531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f840709b0 msgr2=0x7f4f8413dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:47.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.458+0000 7f4f8c47e640 1 --2- 172.21.15.18:0/3846204531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f840709b0 0x7f4f8413dfe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400eb60 tx=0x7f4f7400c6a0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.458+0000 7f4f8c47e640 1 -- 172.21.15.18:0/3846204531 shutdown_connections 2024-09-21T07:10:47.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.458+0000 7f4f8c47e640 1 --2- 172.21.15.18:0/3846204531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f840b6a00 0x7f4f8415f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.458+0000 7f4f8c47e640 1 --2- 172.21.15.18:0/3846204531 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4f70078b90 0x7f4f7007b0a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.458+0000 7f4f8c47e640 1 --2- 172.21.15.18:0/3846204531 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4f840afe70 0x7f4f8409dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.458+0000 7f4f8c47e640 1 --2- 172.21.15.18:0/3846204531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f840709b0 0x7f4f8413dfe0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.458+0000 7f4f8c47e640 1 -- 172.21.15.18:0/3846204531 >> 172.21.15.18:0/3846204531 conn(0x7f4f8409ba60 msgr2=0x7f4f840b78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:47.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.458+0000 7f4f8c47e640 1 -- 172.21.15.18:0/3846204531 shutdown_connections 2024-09-21T07:10:47.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.458+0000 7f4f8c47e640 1 -- 172.21.15.18:0/3846204531 wait complete. 2024-09-21T07:10:47.471 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-21T07:10:46.314435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":268976,"kb_used_data":2560,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754705744,"statfs":{"total":773094113280,"available":772818681856,"internally_reserved":0,"allocated":2621440,"data_stored":1629663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.933813"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404706+0000","last_change":"2024-09-21T07:10:43.425911+0000","last_active":"2024-09-21T07:10:44.404706+0000","last_peered":"2024-09-21T07:10:44.404706+0000","last_clean":"2024-09-21T07:10:44.404706+0000","last_became_active":"2024-09-21T07:10:43.424831+0000","last_became_peered":"2024-09-21T07:10:43.424831+0000","last_unstale":"2024-09-21T07:10:44.404706+0000","last_undegraded":"2024-09-21T07:10:44.404706+0000","last_fullsized":"2024-09-21T07:10:44.404706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:52.852007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.405662+0000","last_change":"2024-09-21T07:10:43.402987+0000","last_active":"2024-09-21T07:10:43.405662+0000","last_peered":"2024-09-21T07:10:43.405662+0000","last_clean":"2024-09-21T07:10:43.405662+0000","last_became_active":"2024-09-21T07:10:43.402600+0000","last_became_peered":"2024-09-21T07:10:43.402600+0000","last_unstale":"2024-09-21T07:10:43.405662+0000","last_undegraded":"2024-09-21T07:10:43.405662+0000","last_fullsized":"2024-09-21T07:10:43.405662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:51.667187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419329+0000","last_change":"2024-09-21T07:10:43.412128+0000","last_active":"2024-09-21T07:10:43.419329+0000","last_peered":"2024-09-21T07:10:43.419329+0000","last_clean":"2024-09-21T07:10:43.419329+0000","last_became_active":"2024-09-21T07:10:43.410969+0000","last_became_peered":"2024-09-21T07:10:43.410969+0000","last_unstale":"2024-09-21T07:10:43.419329+0000","last_undegraded":"2024-09-21T07:10:43.419329+0000","last_fullsized":"2024-09-21T07:10:43.419329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:16.951261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419387+0000","last_change":"2024-09-21T07:10:43.412277+0000","last_active":"2024-09-21T07:10:43.419387+0000","last_peered":"2024-09-21T07:10:43.419387+0000","last_clean":"2024-09-21T07:10:43.419387+0000","last_became_active":"2024-09-21T07:10:43.411507+0000","last_became_peered":"2024-09-21T07:10:43.411507+0000","last_unstale":"2024-09-21T07:10:43.419387+0000","last_undegraded":"2024-09-21T07:10:43.419387+0000","last_fullsized":"2024-09-21T07:10:43.419387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:02.068200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422843+0000","last_change":"2024-09-21T07:10:43.418752+0000","last_active":"2024-09-21T07:10:43.422843+0000","last_peered":"2024-09-21T07:10:43.422843+0000","last_clean":"2024-09-21T07:10:43.422843+0000","last_became_active":"2024-09-21T07:10:43.418424+0000","last_became_peered":"2024-09-21T07:10:43.418424+0000","last_unstale":"2024-09-21T07:10:43.422843+0000","last_undegraded":"2024-09-21T07:10:43.422843+0000","last_fullsized":"2024-09-21T07:10:43.422843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:55.912212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404284+0000","last_change":"2024-09-21T07:10:43.415461+0000","last_active":"2024-09-21T07:10:44.404284+0000","last_peered":"2024-09-21T07:10:44.404284+0000","last_clean":"2024-09-21T07:10:44.404284+0000","last_became_active":"2024-09-21T07:10:43.410697+0000","last_became_peered":"2024-09-21T07:10:43.410697+0000","last_unstale":"2024-09-21T07:10:44.404284+0000","last_undegraded":"2024-09-21T07:10:44.404284+0000","last_fullsized":"2024-09-21T07:10:44.404284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:14.665635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423386+0000","last_change":"2024-09-21T07:10:43.414479+0000","last_active":"2024-09-21T07:10:43.423386+0000","last_peered":"2024-09-21T07:10:43.423386+0000","last_clean":"2024-09-21T07:10:43.423386+0000","last_became_active":"2024-09-21T07:10:43.414121+0000","last_became_peered":"2024-09-21T07:10:43.414121+0000","last_unstale":"2024-09-21T07:10:43.423386+0000","last_undegraded":"2024-09-21T07:10:43.423386+0000","last_fullsized":"2024-09-21T07:10:43.423386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:11.463765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422706+0000","last_change":"2024-09-21T07:10:43.416414+0000","last_active":"2024-09-21T07:10:43.422706+0000","last_peered":"2024-09-21T07:10:43.422706+0000","last_clean":"2024-09-21T07:10:43.422706+0000","last_became_active":"2024-09-21T07:10:43.415380+0000","last_became_peered":"2024-09-21T07:10:43.415380+0000","last_unstale":"2024-09-21T07:10:43.422706+0000","last_undegraded":"2024-09-21T07:10:43.422706+0000","last_fullsized":"2024-09-21T07:10:43.422706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:42.770919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422667+0000","last_change":"2024-09-21T07:10:43.415169+0000","last_active":"2024-09-21T07:10:43.422667+0000","last_peered":"2024-09-21T07:10:43.422667+0000","last_clean":"2024-09-21T07:10:43.422667+0000","last_became_active":"2024-09-21T07:10:43.414845+0000","last_became_peered":"2024-09-21T07:10:43.414845+0000","last_unstale":"2024-09-21T07:10:43.422667+0000","last_undegraded":"2024-09-21T07:10:43.422667+0000","last_fullsized":"2024-09-21T07:10:43.422667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:48.180670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404615+0000","last_change":"2024-09-21T07:10:43.425050+0000","last_active":"2024-09-21T07:10:44.404615+0000","last_peered":"2024-09-21T07:10:44.404615+0000","last_clean":"2024-09-21T07:10:44.404615+0000","last_became_active":"2024-09-21T07:10:43.424686+0000","last_became_peered":"2024-09-21T07:10:43.424686+0000","last_unstale":"2024-09-21T07:10:44.404615+0000","last_undegraded":"2024-09-21T07:10:44.404615+0000","last_fullsized":"2024-09-21T07:10:44.404615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:11.009112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.425732+0000","last_change":"2024-09-21T07:10:43.415955+0000","last_active":"2024-09-21T07:10:43.425732+0000","last_peered":"2024-09-21T07:10:43.425732+0000","last_clean":"2024-09-21T07:10:43.425732+0000","last_became_active":"2024-09-21T07:10:43.415633+0000","last_became_peered":"2024-09-21T07:10:43.415633+0000","last_unstale":"2024-09-21T07:10:43.425732+0000","last_undegraded":"2024-09-21T07:10:43.425732+0000","last_fullsized":"2024-09-21T07:10:43.425732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:53.391760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423437+0000","last_change":"2024-09-21T07:10:43.417820+0000","last_active":"2024-09-21T07:10:43.423437+0000","last_peered":"2024-09-21T07:10:43.423437+0000","last_clean":"2024-09-21T07:10:43.423437+0000","last_became_active":"2024-09-21T07:10:43.417482+0000","last_became_peered":"2024-09-21T07:10:43.417482+0000","last_unstale":"2024-09-21T07:10:43.423437+0000","last_undegraded":"2024-09-21T07:10:43.423437+0000","last_fullsized":"2024-09-21T07:10:43.423437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:32.997642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.427477+0000","last_change":"2024-09-21T07:10:42.407850+0000","last_active":"2024-09-21T07:10:43.427477+0000","last_peered":"2024-09-21T07:10:43.427477+0000","last_clean":"2024-09-21T07:10:43.427477+0000","last_became_active":"2024-09-21T07:10:42.407497+0000","last_became_peered":"2024-09-21T07:10:42.407497+0000","last_unstale":"2024-09-21T07:10:43.427477+0000","last_undegraded":"2024-09-21T07:10:43.427477+0000","last_fullsized":"2024-09-21T07:10:43.427477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:34.583545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.402886+0000","last_change":"2024-09-21T07:10:43.398164+0000","last_active":"2024-09-21T07:10:43.402886+0000","last_peered":"2024-09-21T07:10:43.402886+0000","last_clean":"2024-09-21T07:10:43.402886+0000","last_became_active":"2024-09-21T07:10:43.397191+0000","last_became_peered":"2024-09-21T07:10:43.397191+0000","last_unstale":"2024-09-21T07:10:43.402886+0000","last_undegraded":"2024-09-21T07:10:43.402886+0000","last_fullsized":"2024-09-21T07:10:43.402886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:09.942947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.400692+0000","last_change":"2024-09-21T07:10:42.405878+0000","last_active":"2024-09-21T07:10:43.400692+0000","last_peered":"2024-09-21T07:10:43.400692+0000","last_clean":"2024-09-21T07:10:43.400692+0000","last_became_active":"2024-09-21T07:10:42.404760+0000","last_became_peered":"2024-09-21T07:10:42.404760+0000","last_unstale":"2024-09-21T07:10:43.400692+0000","last_undegraded":"2024-09-21T07:10:43.400692+0000","last_fullsized":"2024-09-21T07:10:43.400692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:24.910811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.427097+0000","last_change":"2024-09-21T07:10:43.421622+0000","last_active":"2024-09-21T07:10:43.427097+0000","last_peered":"2024-09-21T07:10:43.427097+0000","last_clean":"2024-09-21T07:10:43.427097+0000","last_became_active":"2024-09-21T07:10:43.421299+0000","last_became_peered":"2024-09-21T07:10:43.421299+0000","last_unstale":"2024-09-21T07:10:43.427097+0000","last_undegraded":"2024-09-21T07:10:43.427097+0000","last_fullsized":"2024-09-21T07:10:43.427097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:59.444256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404237+0000","last_change":"2024-09-21T07:10:43.424849+0000","last_active":"2024-09-21T07:10:44.404237+0000","last_peered":"2024-09-21T07:10:44.404237+0000","last_clean":"2024-09-21T07:10:44.404237+0000","last_became_active":"2024-09-21T07:10:43.424491+0000","last_became_peered":"2024-09-21T07:10:43.424491+0000","last_unstale":"2024-09-21T07:10:44.404237+0000","last_undegraded":"2024-09-21T07:10:44.404237+0000","last_fullsized":"2024-09-21T07:10:44.404237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:15.151519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.420700+0000","last_change":"2024-09-21T07:10:43.408995+0000","last_active":"2024-09-21T07:10:43.420700+0000","last_peered":"2024-09-21T07:10:43.420700+0000","last_clean":"2024-09-21T07:10:43.420700+0000","last_became_active":"2024-09-21T07:10:43.408670+0000","last_became_peered":"2024-09-21T07:10:43.408670+0000","last_unstale":"2024-09-21T07:10:43.420700+0000","last_undegraded":"2024-09-21T07:10:43.420700+0000","last_fullsized":"2024-09-21T07:10:43.420700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:39.823395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404702+0000","last_change":"2024-09-21T07:10:42.412327+0000","last_active":"2024-09-21T07:10:44.404702+0000","last_peered":"2024-09-21T07:10:44.404702+0000","last_clean":"2024-09-21T07:10:44.404702+0000","last_became_active":"2024-09-21T07:10:42.411992+0000","last_became_peered":"2024-09-21T07:10:42.411992+0000","last_unstale":"2024-09-21T07:10:44.404702+0000","last_undegraded":"2024-09-21T07:10:44.404702+0000","last_fullsized":"2024-09-21T07:10:44.404702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:12.534169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422070+0000","last_change":"2024-09-21T07:10:42.402240+0000","last_active":"2024-09-21T07:10:43.422070+0000","last_peered":"2024-09-21T07:10:43.422070+0000","last_clean":"2024-09-21T07:10:43.422070+0000","last_became_active":"2024-09-21T07:10:42.401874+0000","last_became_peered":"2024-09-21T07:10:42.401874+0000","last_unstale":"2024-09-21T07:10:43.422070+0000","last_undegraded":"2024-09-21T07:10:43.422070+0000","last_fullsized":"2024-09-21T07:10:43.422070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:57.539687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.421567+0000","last_change":"2024-09-21T07:10:43.411598+0000","last_active":"2024-09-21T07:10:43.421567+0000","last_peered":"2024-09-21T07:10:43.421567+0000","last_clean":"2024-09-21T07:10:43.421567+0000","last_became_active":"2024-09-21T07:10:43.411274+0000","last_became_peered":"2024-09-21T07:10:43.411274+0000","last_unstale":"2024-09-21T07:10:43.421567+0000","last_undegraded":"2024-09-21T07:10:43.421567+0000","last_fullsized":"2024-09-21T07:10:43.421567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:13.540221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404730+0000","last_change":"2024-09-21T07:10:42.410464+0000","last_active":"2024-09-21T07:10:44.404730+0000","last_peered":"2024-09-21T07:10:44.404730+0000","last_clean":"2024-09-21T07:10:44.404730+0000","last_became_active":"2024-09-21T07:10:42.410107+0000","last_became_peered":"2024-09-21T07:10:42.410107+0000","last_unstale":"2024-09-21T07:10:44.404730+0000","last_undegraded":"2024-09-21T07:10:44.404730+0000","last_fullsized":"2024-09-21T07:10:44.404730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:31.991591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":103,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T07:10:33.773629+0000","last_change":"2024-09-21T07:10:32.034091+0000","last_active":"2024-09-21T07:10:33.773629+0000","last_peered":"2024-09-21T07:10:33.773629+0000","last_clean":"2024-09-21T07:10:33.773629+0000","last_became_active":"2024-09-21T07:10:32.033005+0000","last_became_peered":"2024-09-21T07:10:32.033005+0000","last_unstale":"2024-09-21T07:10:33.773629+0000","last_undegraded":"2024-09-21T07:10:33.773629+0000","last_fullsized":"2024-09-21T07:10:33.773629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_clean_scrub_stamp":"2024-09-21T07:10:31.011167+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:10.064019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422484+0000","last_change":"2024-09-21T07:10:43.414223+0000","last_active":"2024-09-21T07:10:43.422484+0000","last_peered":"2024-09-21T07:10:43.422484+0000","last_clean":"2024-09-21T07:10:43.422484+0000","last_became_active":"2024-09-21T07:10:43.413923+0000","last_became_peered":"2024-09-21T07:10:43.413923+0000","last_unstale":"2024-09-21T07:10:43.422484+0000","last_undegraded":"2024-09-21T07:10:43.422484+0000","last_fullsized":"2024-09-21T07:10:43.422484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:47.584490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.400889+0000","last_change":"2024-09-21T07:10:43.396425+0000","last_active":"2024-09-21T07:10:43.400889+0000","last_peered":"2024-09-21T07:10:43.400889+0000","last_clean":"2024-09-21T07:10:43.400889+0000","last_became_active":"2024-09-21T07:10:43.396080+0000","last_became_peered":"2024-09-21T07:10:43.396080+0000","last_unstale":"2024-09-21T07:10:43.400889+0000","last_undegraded":"2024-09-21T07:10:43.400889+0000","last_fullsized":"2024-09-21T07:10:43.400889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:28.816031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404277+0000","last_change":"2024-09-21T07:10:43.419811+0000","last_active":"2024-09-21T07:10:44.404277+0000","last_peered":"2024-09-21T07:10:44.404277+0000","last_clean":"2024-09-21T07:10:44.404277+0000","last_became_active":"2024-09-21T07:10:43.419490+0000","last_became_peered":"2024-09-21T07:10:43.419490+0000","last_unstale":"2024-09-21T07:10:44.404277+0000","last_undegraded":"2024-09-21T07:10:44.404277+0000","last_fullsized":"2024-09-21T07:10:44.404277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:08.183794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404434+0000","last_change":"2024-09-21T07:10:42.407164+0000","last_active":"2024-09-21T07:10:44.404434+0000","last_peered":"2024-09-21T07:10:44.404434+0000","last_clean":"2024-09-21T07:10:44.404434+0000","last_became_active":"2024-09-21T07:10:42.406833+0000","last_became_peered":"2024-09-21T07:10:42.406833+0000","last_unstale":"2024-09-21T07:10:44.404434+0000","last_undegraded":"2024-09-21T07:10:44.404434+0000","last_fullsized":"2024-09-21T07:10:44.404434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:50.661135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404296+0000","last_change":"2024-09-21T07:10:43.416948+0000","last_active":"2024-09-21T07:10:44.404296+0000","last_peered":"2024-09-21T07:10:44.404296+0000","last_clean":"2024-09-21T07:10:44.404296+0000","last_became_active":"2024-09-21T07:10:43.416515+0000","last_became_peered":"2024-09-21T07:10:43.416515+0000","last_unstale":"2024-09-21T07:10:44.404296+0000","last_undegraded":"2024-09-21T07:10:44.404296+0000","last_fullsized":"2024-09-21T07:10:44.404296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:23.952801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404606+0000","last_change":"2024-09-21T07:10:42.408894+0000","last_active":"2024-09-21T07:10:44.404606+0000","last_peered":"2024-09-21T07:10:44.404606+0000","last_clean":"2024-09-21T07:10:44.404606+0000","last_became_active":"2024-09-21T07:10:42.408392+0000","last_became_peered":"2024-09-21T07:10:42.408392+0000","last_unstale":"2024-09-21T07:10:44.404606+0000","last_undegraded":"2024-09-21T07:10:44.404606+0000","last_fullsized":"2024-09-21T07:10:44.404606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:22.386244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422637+0000","last_change":"2024-09-21T07:10:43.413469+0000","last_active":"2024-09-21T07:10:43.422637+0000","last_peered":"2024-09-21T07:10:43.422637+0000","last_clean":"2024-09-21T07:10:43.422637+0000","last_became_active":"2024-09-21T07:10:43.413144+0000","last_became_peered":"2024-09-21T07:10:43.413144+0000","last_unstale":"2024-09-21T07:10:43.422637+0000","last_undegraded":"2024-09-21T07:10:43.422637+0000","last_fullsized":"2024-09-21T07:10:43.422637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:26.991092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423115+0000","last_change":"2024-09-21T07:10:43.419670+0000","last_active":"2024-09-21T07:10:43.423115+0000","last_peered":"2024-09-21T07:10:43.423115+0000","last_clean":"2024-09-21T07:10:43.423115+0000","last_became_active":"2024-09-21T07:10:43.419363+0000","last_became_peered":"2024-09-21T07:10:43.419363+0000","last_unstale":"2024-09-21T07:10:43.423115+0000","last_undegraded":"2024-09-21T07:10:43.423115+0000","last_fullsized":"2024-09-21T07:10:43.423115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:16.496407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404360+0000","last_change":"2024-09-21T07:10:42.412473+0000","last_active":"2024-09-21T07:10:44.404360+0000","last_peered":"2024-09-21T07:10:44.404360+0000","last_clean":"2024-09-21T07:10:44.404360+0000","last_became_active":"2024-09-21T07:10:42.412072+0000","last_became_peered":"2024-09-21T07:10:42.412072+0000","last_unstale":"2024-09-21T07:10:44.404360+0000","last_undegraded":"2024-09-21T07:10:44.404360+0000","last_fullsized":"2024-09-21T07:10:44.404360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:38.817344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423320+0000","last_change":"2024-09-21T07:10:43.413781+0000","last_active":"2024-09-21T07:10:43.423320+0000","last_peered":"2024-09-21T07:10:43.423320+0000","last_clean":"2024-09-21T07:10:43.423320+0000","last_became_active":"2024-09-21T07:10:43.413312+0000","last_became_peered":"2024-09-21T07:10:43.413312+0000","last_unstale":"2024-09-21T07:10:43.423320+0000","last_undegraded":"2024-09-21T07:10:43.423320+0000","last_fullsized":"2024-09-21T07:10:43.423320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:56.052704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404554+0000","last_change":"2024-09-21T07:10:42.409241+0000","last_active":"2024-09-21T07:10:44.404554+0000","last_peered":"2024-09-21T07:10:44.404554+0000","last_clean":"2024-09-21T07:10:44.404554+0000","last_became_active":"2024-09-21T07:10:42.408948+0000","last_became_peered":"2024-09-21T07:10:42.408948+0000","last_unstale":"2024-09-21T07:10:44.404554+0000","last_undegraded":"2024-09-21T07:10:44.404554+0000","last_fullsized":"2024-09-21T07:10:44.404554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:10.457714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419343+0000","last_change":"2024-09-21T07:10:43.410463+0000","last_active":"2024-09-21T07:10:43.419343+0000","last_peered":"2024-09-21T07:10:43.419343+0000","last_clean":"2024-09-21T07:10:43.419343+0000","last_became_active":"2024-09-21T07:10:43.410089+0000","last_became_peered":"2024-09-21T07:10:43.410089+0000","last_unstale":"2024-09-21T07:10:43.419343+0000","last_undegraded":"2024-09-21T07:10:43.419343+0000","last_fullsized":"2024-09-21T07:10:43.419343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:16.668262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.420400+0000","last_change":"2024-09-21T07:10:43.408059+0000","last_active":"2024-09-21T07:10:43.420400+0000","last_peered":"2024-09-21T07:10:43.420400+0000","last_clean":"2024-09-21T07:10:43.420400+0000","last_became_active":"2024-09-21T07:10:43.407707+0000","last_became_peered":"2024-09-21T07:10:43.407707+0000","last_unstale":"2024-09-21T07:10:43.420400+0000","last_undegraded":"2024-09-21T07:10:43.420400+0000","last_fullsized":"2024-09-21T07:10:43.420400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:23.392296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.427614+0000","last_change":"2024-09-21T07:10:42.403998+0000","last_active":"2024-09-21T07:10:43.427614+0000","last_peered":"2024-09-21T07:10:43.427614+0000","last_clean":"2024-09-21T07:10:43.427614+0000","last_became_active":"2024-09-21T07:10:42.403552+0000","last_became_peered":"2024-09-21T07:10:42.403552+0000","last_unstale":"2024-09-21T07:10:43.427614+0000","last_undegraded":"2024-09-21T07:10:43.427614+0000","last_fullsized":"2024-09-21T07:10:43.427614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:33.377412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419407+0000","last_change":"2024-09-21T07:10:43.411885+0000","last_active":"2024-09-21T07:10:43.419407+0000","last_peered":"2024-09-21T07:10:43.419407+0000","last_clean":"2024-09-21T07:10:43.419407+0000","last_became_active":"2024-09-21T07:10:43.410907+0000","last_became_peered":"2024-09-21T07:10:43.410907+0000","last_unstale":"2024-09-21T07:10:43.419407+0000","last_undegraded":"2024-09-21T07:10:43.419407+0000","last_fullsized":"2024-09-21T07:10:43.419407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:54.216907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.424450+0000","last_change":"2024-09-21T07:10:42.408992+0000","last_active":"2024-09-21T07:10:43.424450+0000","last_peered":"2024-09-21T07:10:43.424450+0000","last_clean":"2024-09-21T07:10:43.424450+0000","last_became_active":"2024-09-21T07:10:42.408041+0000","last_became_peered":"2024-09-21T07:10:42.408041+0000","last_unstale":"2024-09-21T07:10:43.424450+0000","last_undegraded":"2024-09-21T07:10:43.424450+0000","last_fullsized":"2024-09-21T07:10:43.424450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:36.986751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":22,"acting":22,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":753664,"data_stored":638320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":159744,"data_stored":47952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31348,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":159744,"data_stored":47952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":159744,"data_stored":47952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35508,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336332,"statfs":{"total":96636764160,"available":96600403968,"internally_reserved":0,"allocated":159744,"data_stored":47952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":68431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":217088,"data_stored":73279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":802816,"data_stored":657825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:10:47.474 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:10:47.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.625+0000 7fafd4add640 1 -- 172.21.15.18:0/1484212602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd00ce960 msgr2=0x7fafd006f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:47.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.625+0000 7fafd4add640 1 --2- 172.21.15.18:0/1484212602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd00ce960 0x7fafd006f970 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009830 tx=0x7fafb802a530 comp rx=0 tx=0).stop 2024-09-21T07:10:47.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.625+0000 7fafd4add640 1 -- 172.21.15.18:0/1484212602 shutdown_connections 2024-09-21T07:10:47.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.625+0000 7fafd4add640 1 --2- 172.21.15.18:0/1484212602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd00ce960 0x7fafd006f970 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.625+0000 7fafd4add640 1 -- 172.21.15.18:0/1484212602 >> 172.21.15.18:0/1484212602 conn(0x7fafd00b1fe0 msgr2=0x7fafd00b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:47.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.625+0000 7fafd4add640 1 -- 172.21.15.18:0/1484212602 shutdown_connections 2024-09-21T07:10:47.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.625+0000 7fafd4add640 1 -- 172.21.15.18:0/1484212602 wait complete. 2024-09-21T07:10:47.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.627+0000 7fafd4add640 1 Processor -- start 2024-09-21T07:10:47.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.627+0000 7fafd4add640 1 -- start start 2024-09-21T07:10:47.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafd4add640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fafd00d0d60 0x7fafd0155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:47.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafd4add640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd015bc30 0x7fafd01f59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:47.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafd4add640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd0154650 0x7fafd01f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:47.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafd4add640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fafd00b3a80 con 0x7fafd0154650 2024-09-21T07:10:47.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafd4add640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fafd00b3900 con 0x7fafd015bc30 2024-09-21T07:10:47.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafd4add640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fafd00b3c00 con 0x7fafd00d0d60 2024-09-21T07:10:47.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafced9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd0154650 0x7fafd01f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:47.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafced9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd0154650 0x7fafd01f5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49954/0 (socket says 172.21.15.18:49954) 2024-09-21T07:10:47.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafced9d640 1 -- 172.21.15.18:0/3668672731 learned_addr learned my addr 172.21.15.18:0/3668672731 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:47.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafcdd9b640 1 --2- 172.21.15.18:0/3668672731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd015bc30 0x7fafd01f59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:47.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafce59c640 1 --2- 172.21.15.18:0/3668672731 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fafd00d0d60 0x7fafd0155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:47.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafced9d640 1 -- 172.21.15.18:0/3668672731 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fafd00d0d60 msgr2=0x7fafd0155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:47.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafced9d640 1 --2- 172.21.15.18:0/3668672731 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fafd00d0d60 0x7fafd0155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafced9d640 1 -- 172.21.15.18:0/3668672731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd015bc30 msgr2=0x7fafd01f59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:47.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafced9d640 1 --2- 172.21.15.18:0/3668672731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd015bc30 0x7fafd01f59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafced9d640 1 -- 172.21.15.18:0/3668672731 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd0155ae0 con 0x7fafd0154650 2024-09-21T07:10:47.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafced9d640 1 --2- 172.21.15.18:0/3668672731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd0154650 0x7fafd01f5ee0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fafc800c310 tx=0x7fafc800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:47.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafc6ffd640 1 -- 172.21.15.18:0/3668672731 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc8011790 con 0x7fafd0154650 2024-09-21T07:10:47.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafc6ffd640 1 -- 172.21.15.18:0/3668672731 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafc8017070 con 0x7fafd0154650 2024-09-21T07:10:47.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafc6ffd640 1 -- 172.21.15.18:0/3668672731 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc8011d00 con 0x7fafd0154650 2024-09-21T07:10:47.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafd4add640 1 -- 172.21.15.18:0/3668672731 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd0153b70 con 0x7fafd0154650 2024-09-21T07:10:47.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.629+0000 7fafd4add640 1 -- 172.21.15.18:0/3668672731 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd0154130 con 0x7fafd0154650 2024-09-21T07:10:47.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.630+0000 7fafd4add640 1 -- 172.21.15.18:0/3668672731 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd0155850 con 0x7fafd0154650 2024-09-21T07:10:47.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.631+0000 7fafc6ffd640 1 -- 172.21.15.18:0/3668672731 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fafc801c460 con 0x7fafd0154650 2024-09-21T07:10:47.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.632+0000 7fafc6ffd640 1 --2- 172.21.15.18:0/3668672731 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fafb0078b90 0x7fafb007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:47.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.632+0000 7fafc6ffd640 1 -- 172.21.15.18:0/3668672731 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fafc809aab0 con 0x7fafd0154650 2024-09-21T07:10:47.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.632+0000 7fafce59c640 1 --2- 172.21.15.18:0/3668672731 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fafb0078b90 0x7fafb007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:47.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.633+0000 7fafce59c640 1 --2- 172.21.15.18:0/3668672731 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fafb0078b90 0x7fafb007b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fafc0007fd0 tx=0x7fafc0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:47.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.637+0000 7fafc6ffd640 1 -- 172.21.15.18:0/3668672731 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fafc8062ef0 con 0x7fafd0154650 2024-09-21T07:10:47.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.821+0000 7fafd4add640 1 -- 172.21.15.18:0/3668672731 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fafd006b490 con 0x7fafb0078b90 2024-09-21T07:10:47.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.826+0000 7fafc6ffd640 1 -- 172.21.15.18:0/3668672731 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242899 (secure 0 0 0) 0x7fafc0003970 con 0x7fafb0078b90 2024-09-21T07:10:47.829 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:47.830 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-21T07:10:47.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.829+0000 7fafd4add640 1 -- 172.21.15.18:0/3668672731 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fafb0078b90 msgr2=0x7fafb007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:47.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.829+0000 7fafd4add640 1 --2- 172.21.15.18:0/3668672731 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fafb0078b90 0x7fafb007b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fafc0007fd0 tx=0x7fafc0009040 comp rx=0 tx=0).stop 2024-09-21T07:10:47.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.829+0000 7fafd4add640 1 -- 172.21.15.18:0/3668672731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd0154650 msgr2=0x7fafd01f5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:47.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.829+0000 7fafd4add640 1 --2- 172.21.15.18:0/3668672731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd0154650 0x7fafd01f5ee0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fafc800c310 tx=0x7fafc800c7d0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.829+0000 7fafd4add640 1 -- 172.21.15.18:0/3668672731 shutdown_connections 2024-09-21T07:10:47.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.829+0000 7fafd4add640 1 --2- 172.21.15.18:0/3668672731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd0154650 0x7fafd01f5ee0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.829+0000 7fafd4add640 1 --2- 172.21.15.18:0/3668672731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd015bc30 0x7fafd01f59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.829+0000 7fafd4add640 1 --2- 172.21.15.18:0/3668672731 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fafb0078b90 0x7fafb007b0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.829+0000 7fafd4add640 1 --2- 172.21.15.18:0/3668672731 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fafd00d0d60 0x7fafd0155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.829+0000 7fafd4add640 1 -- 172.21.15.18:0/3668672731 >> 172.21.15.18:0/3668672731 conn(0x7fafd00b1fe0 msgr2=0x7fafd00b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:47.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.829+0000 7fafd4add640 1 -- 172.21.15.18:0/3668672731 shutdown_connections 2024-09-21T07:10:47.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.829+0000 7fafd4add640 1 -- 172.21.15.18:0/3668672731 wait complete. 2024-09-21T07:10:47.841 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-21T07:10:46.314435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":268976,"kb_used_data":2560,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754705744,"statfs":{"total":773094113280,"available":772818681856,"internally_reserved":0,"allocated":2621440,"data_stored":1629663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.933813"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404706+0000","last_change":"2024-09-21T07:10:43.425911+0000","last_active":"2024-09-21T07:10:44.404706+0000","last_peered":"2024-09-21T07:10:44.404706+0000","last_clean":"2024-09-21T07:10:44.404706+0000","last_became_active":"2024-09-21T07:10:43.424831+0000","last_became_peered":"2024-09-21T07:10:43.424831+0000","last_unstale":"2024-09-21T07:10:44.404706+0000","last_undegraded":"2024-09-21T07:10:44.404706+0000","last_fullsized":"2024-09-21T07:10:44.404706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:52.852007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.405662+0000","last_change":"2024-09-21T07:10:43.402987+0000","last_active":"2024-09-21T07:10:43.405662+0000","last_peered":"2024-09-21T07:10:43.405662+0000","last_clean":"2024-09-21T07:10:43.405662+0000","last_became_active":"2024-09-21T07:10:43.402600+0000","last_became_peered":"2024-09-21T07:10:43.402600+0000","last_unstale":"2024-09-21T07:10:43.405662+0000","last_undegraded":"2024-09-21T07:10:43.405662+0000","last_fullsized":"2024-09-21T07:10:43.405662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:51.667187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419329+0000","last_change":"2024-09-21T07:10:43.412128+0000","last_active":"2024-09-21T07:10:43.419329+0000","last_peered":"2024-09-21T07:10:43.419329+0000","last_clean":"2024-09-21T07:10:43.419329+0000","last_became_active":"2024-09-21T07:10:43.410969+0000","last_became_peered":"2024-09-21T07:10:43.410969+0000","last_unstale":"2024-09-21T07:10:43.419329+0000","last_undegraded":"2024-09-21T07:10:43.419329+0000","last_fullsized":"2024-09-21T07:10:43.419329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:16.951261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419387+0000","last_change":"2024-09-21T07:10:43.412277+0000","last_active":"2024-09-21T07:10:43.419387+0000","last_peered":"2024-09-21T07:10:43.419387+0000","last_clean":"2024-09-21T07:10:43.419387+0000","last_became_active":"2024-09-21T07:10:43.411507+0000","last_became_peered":"2024-09-21T07:10:43.411507+0000","last_unstale":"2024-09-21T07:10:43.419387+0000","last_undegraded":"2024-09-21T07:10:43.419387+0000","last_fullsized":"2024-09-21T07:10:43.419387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:02.068200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422843+0000","last_change":"2024-09-21T07:10:43.418752+0000","last_active":"2024-09-21T07:10:43.422843+0000","last_peered":"2024-09-21T07:10:43.422843+0000","last_clean":"2024-09-21T07:10:43.422843+0000","last_became_active":"2024-09-21T07:10:43.418424+0000","last_became_peered":"2024-09-21T07:10:43.418424+0000","last_unstale":"2024-09-21T07:10:43.422843+0000","last_undegraded":"2024-09-21T07:10:43.422843+0000","last_fullsized":"2024-09-21T07:10:43.422843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:55.912212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404284+0000","last_change":"2024-09-21T07:10:43.415461+0000","last_active":"2024-09-21T07:10:44.404284+0000","last_peered":"2024-09-21T07:10:44.404284+0000","last_clean":"2024-09-21T07:10:44.404284+0000","last_became_active":"2024-09-21T07:10:43.410697+0000","last_became_peered":"2024-09-21T07:10:43.410697+0000","last_unstale":"2024-09-21T07:10:44.404284+0000","last_undegraded":"2024-09-21T07:10:44.404284+0000","last_fullsized":"2024-09-21T07:10:44.404284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:14.665635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423386+0000","last_change":"2024-09-21T07:10:43.414479+0000","last_active":"2024-09-21T07:10:43.423386+0000","last_peered":"2024-09-21T07:10:43.423386+0000","last_clean":"2024-09-21T07:10:43.423386+0000","last_became_active":"2024-09-21T07:10:43.414121+0000","last_became_peered":"2024-09-21T07:10:43.414121+0000","last_unstale":"2024-09-21T07:10:43.423386+0000","last_undegraded":"2024-09-21T07:10:43.423386+0000","last_fullsized":"2024-09-21T07:10:43.423386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:11.463765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422706+0000","last_change":"2024-09-21T07:10:43.416414+0000","last_active":"2024-09-21T07:10:43.422706+0000","last_peered":"2024-09-21T07:10:43.422706+0000","last_clean":"2024-09-21T07:10:43.422706+0000","last_became_active":"2024-09-21T07:10:43.415380+0000","last_became_peered":"2024-09-21T07:10:43.415380+0000","last_unstale":"2024-09-21T07:10:43.422706+0000","last_undegraded":"2024-09-21T07:10:43.422706+0000","last_fullsized":"2024-09-21T07:10:43.422706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:42.770919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422667+0000","last_change":"2024-09-21T07:10:43.415169+0000","last_active":"2024-09-21T07:10:43.422667+0000","last_peered":"2024-09-21T07:10:43.422667+0000","last_clean":"2024-09-21T07:10:43.422667+0000","last_became_active":"2024-09-21T07:10:43.414845+0000","last_became_peered":"2024-09-21T07:10:43.414845+0000","last_unstale":"2024-09-21T07:10:43.422667+0000","last_undegraded":"2024-09-21T07:10:43.422667+0000","last_fullsized":"2024-09-21T07:10:43.422667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:48.180670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404615+0000","last_change":"2024-09-21T07:10:43.425050+0000","last_active":"2024-09-21T07:10:44.404615+0000","last_peered":"2024-09-21T07:10:44.404615+0000","last_clean":"2024-09-21T07:10:44.404615+0000","last_became_active":"2024-09-21T07:10:43.424686+0000","last_became_peered":"2024-09-21T07:10:43.424686+0000","last_unstale":"2024-09-21T07:10:44.404615+0000","last_undegraded":"2024-09-21T07:10:44.404615+0000","last_fullsized":"2024-09-21T07:10:44.404615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:11.009112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.425732+0000","last_change":"2024-09-21T07:10:43.415955+0000","last_active":"2024-09-21T07:10:43.425732+0000","last_peered":"2024-09-21T07:10:43.425732+0000","last_clean":"2024-09-21T07:10:43.425732+0000","last_became_active":"2024-09-21T07:10:43.415633+0000","last_became_peered":"2024-09-21T07:10:43.415633+0000","last_unstale":"2024-09-21T07:10:43.425732+0000","last_undegraded":"2024-09-21T07:10:43.425732+0000","last_fullsized":"2024-09-21T07:10:43.425732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:53.391760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423437+0000","last_change":"2024-09-21T07:10:43.417820+0000","last_active":"2024-09-21T07:10:43.423437+0000","last_peered":"2024-09-21T07:10:43.423437+0000","last_clean":"2024-09-21T07:10:43.423437+0000","last_became_active":"2024-09-21T07:10:43.417482+0000","last_became_peered":"2024-09-21T07:10:43.417482+0000","last_unstale":"2024-09-21T07:10:43.423437+0000","last_undegraded":"2024-09-21T07:10:43.423437+0000","last_fullsized":"2024-09-21T07:10:43.423437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:32.997642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.427477+0000","last_change":"2024-09-21T07:10:42.407850+0000","last_active":"2024-09-21T07:10:43.427477+0000","last_peered":"2024-09-21T07:10:43.427477+0000","last_clean":"2024-09-21T07:10:43.427477+0000","last_became_active":"2024-09-21T07:10:42.407497+0000","last_became_peered":"2024-09-21T07:10:42.407497+0000","last_unstale":"2024-09-21T07:10:43.427477+0000","last_undegraded":"2024-09-21T07:10:43.427477+0000","last_fullsized":"2024-09-21T07:10:43.427477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:34.583545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.402886+0000","last_change":"2024-09-21T07:10:43.398164+0000","last_active":"2024-09-21T07:10:43.402886+0000","last_peered":"2024-09-21T07:10:43.402886+0000","last_clean":"2024-09-21T07:10:43.402886+0000","last_became_active":"2024-09-21T07:10:43.397191+0000","last_became_peered":"2024-09-21T07:10:43.397191+0000","last_unstale":"2024-09-21T07:10:43.402886+0000","last_undegraded":"2024-09-21T07:10:43.402886+0000","last_fullsized":"2024-09-21T07:10:43.402886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:09.942947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.400692+0000","last_change":"2024-09-21T07:10:42.405878+0000","last_active":"2024-09-21T07:10:43.400692+0000","last_peered":"2024-09-21T07:10:43.400692+0000","last_clean":"2024-09-21T07:10:43.400692+0000","last_became_active":"2024-09-21T07:10:42.404760+0000","last_became_peered":"2024-09-21T07:10:42.404760+0000","last_unstale":"2024-09-21T07:10:43.400692+0000","last_undegraded":"2024-09-21T07:10:43.400692+0000","last_fullsized":"2024-09-21T07:10:43.400692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:24.910811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.427097+0000","last_change":"2024-09-21T07:10:43.421622+0000","last_active":"2024-09-21T07:10:43.427097+0000","last_peered":"2024-09-21T07:10:43.427097+0000","last_clean":"2024-09-21T07:10:43.427097+0000","last_became_active":"2024-09-21T07:10:43.421299+0000","last_became_peered":"2024-09-21T07:10:43.421299+0000","last_unstale":"2024-09-21T07:10:43.427097+0000","last_undegraded":"2024-09-21T07:10:43.427097+0000","last_fullsized":"2024-09-21T07:10:43.427097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:59.444256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404237+0000","last_change":"2024-09-21T07:10:43.424849+0000","last_active":"2024-09-21T07:10:44.404237+0000","last_peered":"2024-09-21T07:10:44.404237+0000","last_clean":"2024-09-21T07:10:44.404237+0000","last_became_active":"2024-09-21T07:10:43.424491+0000","last_became_peered":"2024-09-21T07:10:43.424491+0000","last_unstale":"2024-09-21T07:10:44.404237+0000","last_undegraded":"2024-09-21T07:10:44.404237+0000","last_fullsized":"2024-09-21T07:10:44.404237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:15.151519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.420700+0000","last_change":"2024-09-21T07:10:43.408995+0000","last_active":"2024-09-21T07:10:43.420700+0000","last_peered":"2024-09-21T07:10:43.420700+0000","last_clean":"2024-09-21T07:10:43.420700+0000","last_became_active":"2024-09-21T07:10:43.408670+0000","last_became_peered":"2024-09-21T07:10:43.408670+0000","last_unstale":"2024-09-21T07:10:43.420700+0000","last_undegraded":"2024-09-21T07:10:43.420700+0000","last_fullsized":"2024-09-21T07:10:43.420700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:39.823395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404702+0000","last_change":"2024-09-21T07:10:42.412327+0000","last_active":"2024-09-21T07:10:44.404702+0000","last_peered":"2024-09-21T07:10:44.404702+0000","last_clean":"2024-09-21T07:10:44.404702+0000","last_became_active":"2024-09-21T07:10:42.411992+0000","last_became_peered":"2024-09-21T07:10:42.411992+0000","last_unstale":"2024-09-21T07:10:44.404702+0000","last_undegraded":"2024-09-21T07:10:44.404702+0000","last_fullsized":"2024-09-21T07:10:44.404702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:12.534169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422070+0000","last_change":"2024-09-21T07:10:42.402240+0000","last_active":"2024-09-21T07:10:43.422070+0000","last_peered":"2024-09-21T07:10:43.422070+0000","last_clean":"2024-09-21T07:10:43.422070+0000","last_became_active":"2024-09-21T07:10:42.401874+0000","last_became_peered":"2024-09-21T07:10:42.401874+0000","last_unstale":"2024-09-21T07:10:43.422070+0000","last_undegraded":"2024-09-21T07:10:43.422070+0000","last_fullsized":"2024-09-21T07:10:43.422070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:57.539687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.421567+0000","last_change":"2024-09-21T07:10:43.411598+0000","last_active":"2024-09-21T07:10:43.421567+0000","last_peered":"2024-09-21T07:10:43.421567+0000","last_clean":"2024-09-21T07:10:43.421567+0000","last_became_active":"2024-09-21T07:10:43.411274+0000","last_became_peered":"2024-09-21T07:10:43.411274+0000","last_unstale":"2024-09-21T07:10:43.421567+0000","last_undegraded":"2024-09-21T07:10:43.421567+0000","last_fullsized":"2024-09-21T07:10:43.421567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:13.540221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404730+0000","last_change":"2024-09-21T07:10:42.410464+0000","last_active":"2024-09-21T07:10:44.404730+0000","last_peered":"2024-09-21T07:10:44.404730+0000","last_clean":"2024-09-21T07:10:44.404730+0000","last_became_active":"2024-09-21T07:10:42.410107+0000","last_became_peered":"2024-09-21T07:10:42.410107+0000","last_unstale":"2024-09-21T07:10:44.404730+0000","last_undegraded":"2024-09-21T07:10:44.404730+0000","last_fullsized":"2024-09-21T07:10:44.404730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:31.991591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":103,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T07:10:33.773629+0000","last_change":"2024-09-21T07:10:32.034091+0000","last_active":"2024-09-21T07:10:33.773629+0000","last_peered":"2024-09-21T07:10:33.773629+0000","last_clean":"2024-09-21T07:10:33.773629+0000","last_became_active":"2024-09-21T07:10:32.033005+0000","last_became_peered":"2024-09-21T07:10:32.033005+0000","last_unstale":"2024-09-21T07:10:33.773629+0000","last_undegraded":"2024-09-21T07:10:33.773629+0000","last_fullsized":"2024-09-21T07:10:33.773629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_clean_scrub_stamp":"2024-09-21T07:10:31.011167+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:10.064019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422484+0000","last_change":"2024-09-21T07:10:43.414223+0000","last_active":"2024-09-21T07:10:43.422484+0000","last_peered":"2024-09-21T07:10:43.422484+0000","last_clean":"2024-09-21T07:10:43.422484+0000","last_became_active":"2024-09-21T07:10:43.413923+0000","last_became_peered":"2024-09-21T07:10:43.413923+0000","last_unstale":"2024-09-21T07:10:43.422484+0000","last_undegraded":"2024-09-21T07:10:43.422484+0000","last_fullsized":"2024-09-21T07:10:43.422484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:47.584490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.400889+0000","last_change":"2024-09-21T07:10:43.396425+0000","last_active":"2024-09-21T07:10:43.400889+0000","last_peered":"2024-09-21T07:10:43.400889+0000","last_clean":"2024-09-21T07:10:43.400889+0000","last_became_active":"2024-09-21T07:10:43.396080+0000","last_became_peered":"2024-09-21T07:10:43.396080+0000","last_unstale":"2024-09-21T07:10:43.400889+0000","last_undegraded":"2024-09-21T07:10:43.400889+0000","last_fullsized":"2024-09-21T07:10:43.400889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:28.816031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404277+0000","last_change":"2024-09-21T07:10:43.419811+0000","last_active":"2024-09-21T07:10:44.404277+0000","last_peered":"2024-09-21T07:10:44.404277+0000","last_clean":"2024-09-21T07:10:44.404277+0000","last_became_active":"2024-09-21T07:10:43.419490+0000","last_became_peered":"2024-09-21T07:10:43.419490+0000","last_unstale":"2024-09-21T07:10:44.404277+0000","last_undegraded":"2024-09-21T07:10:44.404277+0000","last_fullsized":"2024-09-21T07:10:44.404277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:08.183794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404434+0000","last_change":"2024-09-21T07:10:42.407164+0000","last_active":"2024-09-21T07:10:44.404434+0000","last_peered":"2024-09-21T07:10:44.404434+0000","last_clean":"2024-09-21T07:10:44.404434+0000","last_became_active":"2024-09-21T07:10:42.406833+0000","last_became_peered":"2024-09-21T07:10:42.406833+0000","last_unstale":"2024-09-21T07:10:44.404434+0000","last_undegraded":"2024-09-21T07:10:44.404434+0000","last_fullsized":"2024-09-21T07:10:44.404434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:50.661135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404296+0000","last_change":"2024-09-21T07:10:43.416948+0000","last_active":"2024-09-21T07:10:44.404296+0000","last_peered":"2024-09-21T07:10:44.404296+0000","last_clean":"2024-09-21T07:10:44.404296+0000","last_became_active":"2024-09-21T07:10:43.416515+0000","last_became_peered":"2024-09-21T07:10:43.416515+0000","last_unstale":"2024-09-21T07:10:44.404296+0000","last_undegraded":"2024-09-21T07:10:44.404296+0000","last_fullsized":"2024-09-21T07:10:44.404296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:23.952801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404606+0000","last_change":"2024-09-21T07:10:42.408894+0000","last_active":"2024-09-21T07:10:44.404606+0000","last_peered":"2024-09-21T07:10:44.404606+0000","last_clean":"2024-09-21T07:10:44.404606+0000","last_became_active":"2024-09-21T07:10:42.408392+0000","last_became_peered":"2024-09-21T07:10:42.408392+0000","last_unstale":"2024-09-21T07:10:44.404606+0000","last_undegraded":"2024-09-21T07:10:44.404606+0000","last_fullsized":"2024-09-21T07:10:44.404606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:22.386244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422637+0000","last_change":"2024-09-21T07:10:43.413469+0000","last_active":"2024-09-21T07:10:43.422637+0000","last_peered":"2024-09-21T07:10:43.422637+0000","last_clean":"2024-09-21T07:10:43.422637+0000","last_became_active":"2024-09-21T07:10:43.413144+0000","last_became_peered":"2024-09-21T07:10:43.413144+0000","last_unstale":"2024-09-21T07:10:43.422637+0000","last_undegraded":"2024-09-21T07:10:43.422637+0000","last_fullsized":"2024-09-21T07:10:43.422637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:26.991092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423115+0000","last_change":"2024-09-21T07:10:43.419670+0000","last_active":"2024-09-21T07:10:43.423115+0000","last_peered":"2024-09-21T07:10:43.423115+0000","last_clean":"2024-09-21T07:10:43.423115+0000","last_became_active":"2024-09-21T07:10:43.419363+0000","last_became_peered":"2024-09-21T07:10:43.419363+0000","last_unstale":"2024-09-21T07:10:43.423115+0000","last_undegraded":"2024-09-21T07:10:43.423115+0000","last_fullsized":"2024-09-21T07:10:43.423115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:16.496407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404360+0000","last_change":"2024-09-21T07:10:42.412473+0000","last_active":"2024-09-21T07:10:44.404360+0000","last_peered":"2024-09-21T07:10:44.404360+0000","last_clean":"2024-09-21T07:10:44.404360+0000","last_became_active":"2024-09-21T07:10:42.412072+0000","last_became_peered":"2024-09-21T07:10:42.412072+0000","last_unstale":"2024-09-21T07:10:44.404360+0000","last_undegraded":"2024-09-21T07:10:44.404360+0000","last_fullsized":"2024-09-21T07:10:44.404360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:38.817344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423320+0000","last_change":"2024-09-21T07:10:43.413781+0000","last_active":"2024-09-21T07:10:43.423320+0000","last_peered":"2024-09-21T07:10:43.423320+0000","last_clean":"2024-09-21T07:10:43.423320+0000","last_became_active":"2024-09-21T07:10:43.413312+0000","last_became_peered":"2024-09-21T07:10:43.413312+0000","last_unstale":"2024-09-21T07:10:43.423320+0000","last_undegraded":"2024-09-21T07:10:43.423320+0000","last_fullsized":"2024-09-21T07:10:43.423320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:56.052704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404554+0000","last_change":"2024-09-21T07:10:42.409241+0000","last_active":"2024-09-21T07:10:44.404554+0000","last_peered":"2024-09-21T07:10:44.404554+0000","last_clean":"2024-09-21T07:10:44.404554+0000","last_became_active":"2024-09-21T07:10:42.408948+0000","last_became_peered":"2024-09-21T07:10:42.408948+0000","last_unstale":"2024-09-21T07:10:44.404554+0000","last_undegraded":"2024-09-21T07:10:44.404554+0000","last_fullsized":"2024-09-21T07:10:44.404554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:10.457714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419343+0000","last_change":"2024-09-21T07:10:43.410463+0000","last_active":"2024-09-21T07:10:43.419343+0000","last_peered":"2024-09-21T07:10:43.419343+0000","last_clean":"2024-09-21T07:10:43.419343+0000","last_became_active":"2024-09-21T07:10:43.410089+0000","last_became_peered":"2024-09-21T07:10:43.410089+0000","last_unstale":"2024-09-21T07:10:43.419343+0000","last_undegraded":"2024-09-21T07:10:43.419343+0000","last_fullsized":"2024-09-21T07:10:43.419343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:16.668262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.420400+0000","last_change":"2024-09-21T07:10:43.408059+0000","last_active":"2024-09-21T07:10:43.420400+0000","last_peered":"2024-09-21T07:10:43.420400+0000","last_clean":"2024-09-21T07:10:43.420400+0000","last_became_active":"2024-09-21T07:10:43.407707+0000","last_became_peered":"2024-09-21T07:10:43.407707+0000","last_unstale":"2024-09-21T07:10:43.420400+0000","last_undegraded":"2024-09-21T07:10:43.420400+0000","last_fullsized":"2024-09-21T07:10:43.420400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:23.392296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.427614+0000","last_change":"2024-09-21T07:10:42.403998+0000","last_active":"2024-09-21T07:10:43.427614+0000","last_peered":"2024-09-21T07:10:43.427614+0000","last_clean":"2024-09-21T07:10:43.427614+0000","last_became_active":"2024-09-21T07:10:42.403552+0000","last_became_peered":"2024-09-21T07:10:42.403552+0000","last_unstale":"2024-09-21T07:10:43.427614+0000","last_undegraded":"2024-09-21T07:10:43.427614+0000","last_fullsized":"2024-09-21T07:10:43.427614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:33.377412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419407+0000","last_change":"2024-09-21T07:10:43.411885+0000","last_active":"2024-09-21T07:10:43.419407+0000","last_peered":"2024-09-21T07:10:43.419407+0000","last_clean":"2024-09-21T07:10:43.419407+0000","last_became_active":"2024-09-21T07:10:43.410907+0000","last_became_peered":"2024-09-21T07:10:43.410907+0000","last_unstale":"2024-09-21T07:10:43.419407+0000","last_undegraded":"2024-09-21T07:10:43.419407+0000","last_fullsized":"2024-09-21T07:10:43.419407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:54.216907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.424450+0000","last_change":"2024-09-21T07:10:42.408992+0000","last_active":"2024-09-21T07:10:43.424450+0000","last_peered":"2024-09-21T07:10:43.424450+0000","last_clean":"2024-09-21T07:10:43.424450+0000","last_became_active":"2024-09-21T07:10:42.408041+0000","last_became_peered":"2024-09-21T07:10:42.408041+0000","last_unstale":"2024-09-21T07:10:43.424450+0000","last_undegraded":"2024-09-21T07:10:43.424450+0000","last_fullsized":"2024-09-21T07:10:43.424450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:36.986751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":22,"acting":22,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":753664,"data_stored":638320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":159744,"data_stored":47952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31348,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":159744,"data_stored":47952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":159744,"data_stored":47952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35508,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336332,"statfs":{"total":96636764160,"available":96600403968,"internally_reserved":0,"allocated":159744,"data_stored":47952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":68431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":217088,"data_stored":73279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":802816,"data_stored":657825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:10:47.845 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:10:47.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.996+0000 7f5fe5b82640 1 -- 172.21.15.18:0/4195736782 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5fe015ef50 msgr2=0x7f5fe015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:47.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.996+0000 7f5fe5b82640 1 --2- 172.21.15.18:0/4195736782 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5fe015ef50 0x7f5fe015c520 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009860 tx=0x7f5fd002a530 comp rx=0 tx=0).stop 2024-09-21T07:10:47.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.996+0000 7f5fe5b82640 1 -- 172.21.15.18:0/4195736782 shutdown_connections 2024-09-21T07:10:47.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.996+0000 7f5fe5b82640 1 --2- 172.21.15.18:0/4195736782 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5fe015ef50 0x7f5fe015c520 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:47.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.996+0000 7f5fe5b82640 1 -- 172.21.15.18:0/4195736782 >> 172.21.15.18:0/4195736782 conn(0x7f5fe0073f30 msgr2=0x7f5fe00b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:47.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.996+0000 7f5fe5b82640 1 -- 172.21.15.18:0/4195736782 shutdown_connections 2024-09-21T07:10:47.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.996+0000 7f5fe5b82640 1 -- 172.21.15.18:0/4195736782 wait complete. 2024-09-21T07:10:48.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.998+0000 7f5fe5b82640 1 Processor -- start 2024-09-21T07:10:48.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:47.998+0000 7f5fe5b82640 1 -- start start 2024-09-21T07:10:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fe5b82640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5fe00cef70 0x7f5fe01f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fe5b82640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe015ef50 0x7f5fe01f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fe5b82640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fe0162a40 0x7f5fe00b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fe5b82640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe00d13b0 con 0x7f5fe015ef50 2024-09-21T07:10:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fe5b82640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe00d1230 con 0x7f5fe0162a40 2024-09-21T07:10:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fe5b82640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe00d1530 con 0x7f5fe00cef70 2024-09-21T07:10:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fdeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe015ef50 0x7f5fe01f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fdeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe015ef50 0x7f5fe01f8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49962/0 (socket says 172.21.15.18:49962) 2024-09-21T07:10:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fdeffd640 1 -- 172.21.15.18:0/2117935564 learned_addr learned my addr 172.21.15.18:0/2117935564 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fdf7fe640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5fe00cef70 0x7f5fe01f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fdffff640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fe0162a40 0x7f5fe00b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fdeffd640 1 -- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5fe00cef70 msgr2=0x7f5fe01f6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fdeffd640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5fe00cef70 0x7f5fe01f6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fdeffd640 1 -- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fe0162a40 msgr2=0x7f5fe00b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fdeffd640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fe0162a40 0x7f5fe00b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fdeffd640 1 -- 172.21.15.18:0/2117935564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe01f9610 con 0x7f5fe015ef50 2024-09-21T07:10:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fdf7fe640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5fe00cef70 0x7f5fe01f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fdffff640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fe0162a40 0x7f5fe00b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fdeffd640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe015ef50 0x7f5fe01f8c30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5fd400c440 tx=0x7f5fd400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.000+0000 7f5fc7fff640 1 -- 172.21.15.18:0/2117935564 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4016020 con 0x7f5fe015ef50 2024-09-21T07:10:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.001+0000 7f5fc7fff640 1 -- 172.21.15.18:0/2117935564 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fd4012920 con 0x7f5fe015ef50 2024-09-21T07:10:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.001+0000 7f5fe5b82640 1 -- 172.21.15.18:0/2117935564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe01f98f0 con 0x7f5fe015ef50 2024-09-21T07:10:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.001+0000 7f5fc7fff640 1 -- 172.21.15.18:0/2117935564 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4012d70 con 0x7f5fe015ef50 2024-09-21T07:10:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.001+0000 7f5fe5b82640 1 -- 172.21.15.18:0/2117935564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe01f5b10 con 0x7f5fe015ef50 2024-09-21T07:10:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.001+0000 7f5fe5b82640 1 -- 172.21.15.18:0/2117935564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe01f9380 con 0x7f5fe015ef50 2024-09-21T07:10:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.002+0000 7f5fc7fff640 1 -- 172.21.15.18:0/2117935564 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5fd4019020 con 0x7f5fe015ef50 2024-09-21T07:10:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.003+0000 7f5fc7fff640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5fcc078b90 0x7f5fcc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.003+0000 7f5fc7fff640 1 -- 172.21.15.18:0/2117935564 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5fd409adc0 con 0x7f5fe015ef50 2024-09-21T07:10:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.003+0000 7f5fdf7fe640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5fcc078b90 0x7f5fcc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.004+0000 7f5fdf7fe640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5fcc078b90 0x7f5fcc07b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0034000 tx=0x7f5fd0004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:48.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.008+0000 7f5fc7fff640 1 -- 172.21.15.18:0/2117935564 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5fd4020020 con 0x7f5fe015ef50 2024-09-21T07:10:48.150 INFO:tasks.ceph.mds.a.smithi018.stderr:2024-09-21T07:10:48.148+0000 7fe16b95a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:10:48.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.190+0000 7f5fe5b82640 1 -- 172.21.15.18:0/2117935564 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5fe006b490 con 0x7f5fcc078b90 2024-09-21T07:10:48.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.195+0000 7f5fc7fff640 1 -- 172.21.15.18:0/2117935564 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242899 (secure 0 0 0) 0x7f5fd0004270 con 0x7f5fcc078b90 2024-09-21T07:10:48.199 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:48.200 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-21T07:10:48.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.198+0000 7f5fe5b82640 1 -- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5fcc078b90 msgr2=0x7f5fcc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.198+0000 7f5fe5b82640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5fcc078b90 0x7f5fcc07b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0034000 tx=0x7f5fd0004730 comp rx=0 tx=0).stop 2024-09-21T07:10:48.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.198+0000 7f5fe5b82640 1 -- 172.21.15.18:0/2117935564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe015ef50 msgr2=0x7f5fe01f8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.198+0000 7f5fe5b82640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe015ef50 0x7f5fe01f8c30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5fd400c440 tx=0x7f5fd400c900 comp rx=0 tx=0).stop 2024-09-21T07:10:48.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.198+0000 7f5fe5b82640 1 -- 172.21.15.18:0/2117935564 shutdown_connections 2024-09-21T07:10:48.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.198+0000 7f5fe5b82640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fe0162a40 0x7f5fe00b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.198+0000 7f5fe5b82640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe015ef50 0x7f5fe01f8c30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.198+0000 7f5fe5b82640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5fcc078b90 0x7f5fcc07b0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.198+0000 7f5fe5b82640 1 --2- 172.21.15.18:0/2117935564 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5fe00cef70 0x7f5fe01f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.198+0000 7f5fe5b82640 1 -- 172.21.15.18:0/2117935564 >> 172.21.15.18:0/2117935564 conn(0x7f5fe0073f30 msgr2=0x7f5fe015d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:48.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.198+0000 7f5fe5b82640 1 -- 172.21.15.18:0/2117935564 shutdown_connections 2024-09-21T07:10:48.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.198+0000 7f5fe5b82640 1 -- 172.21.15.18:0/2117935564 wait complete. 2024-09-21T07:10:48.211 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-21T07:10:46.314435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":268976,"kb_used_data":2560,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754705744,"statfs":{"total":773094113280,"available":772818681856,"internally_reserved":0,"allocated":2621440,"data_stored":1629663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.933813"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404706+0000","last_change":"2024-09-21T07:10:43.425911+0000","last_active":"2024-09-21T07:10:44.404706+0000","last_peered":"2024-09-21T07:10:44.404706+0000","last_clean":"2024-09-21T07:10:44.404706+0000","last_became_active":"2024-09-21T07:10:43.424831+0000","last_became_peered":"2024-09-21T07:10:43.424831+0000","last_unstale":"2024-09-21T07:10:44.404706+0000","last_undegraded":"2024-09-21T07:10:44.404706+0000","last_fullsized":"2024-09-21T07:10:44.404706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:52.852007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.405662+0000","last_change":"2024-09-21T07:10:43.402987+0000","last_active":"2024-09-21T07:10:43.405662+0000","last_peered":"2024-09-21T07:10:43.405662+0000","last_clean":"2024-09-21T07:10:43.405662+0000","last_became_active":"2024-09-21T07:10:43.402600+0000","last_became_peered":"2024-09-21T07:10:43.402600+0000","last_unstale":"2024-09-21T07:10:43.405662+0000","last_undegraded":"2024-09-21T07:10:43.405662+0000","last_fullsized":"2024-09-21T07:10:43.405662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:51.667187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419329+0000","last_change":"2024-09-21T07:10:43.412128+0000","last_active":"2024-09-21T07:10:43.419329+0000","last_peered":"2024-09-21T07:10:43.419329+0000","last_clean":"2024-09-21T07:10:43.419329+0000","last_became_active":"2024-09-21T07:10:43.410969+0000","last_became_peered":"2024-09-21T07:10:43.410969+0000","last_unstale":"2024-09-21T07:10:43.419329+0000","last_undegraded":"2024-09-21T07:10:43.419329+0000","last_fullsized":"2024-09-21T07:10:43.419329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:16.951261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419387+0000","last_change":"2024-09-21T07:10:43.412277+0000","last_active":"2024-09-21T07:10:43.419387+0000","last_peered":"2024-09-21T07:10:43.419387+0000","last_clean":"2024-09-21T07:10:43.419387+0000","last_became_active":"2024-09-21T07:10:43.411507+0000","last_became_peered":"2024-09-21T07:10:43.411507+0000","last_unstale":"2024-09-21T07:10:43.419387+0000","last_undegraded":"2024-09-21T07:10:43.419387+0000","last_fullsized":"2024-09-21T07:10:43.419387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:02.068200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422843+0000","last_change":"2024-09-21T07:10:43.418752+0000","last_active":"2024-09-21T07:10:43.422843+0000","last_peered":"2024-09-21T07:10:43.422843+0000","last_clean":"2024-09-21T07:10:43.422843+0000","last_became_active":"2024-09-21T07:10:43.418424+0000","last_became_peered":"2024-09-21T07:10:43.418424+0000","last_unstale":"2024-09-21T07:10:43.422843+0000","last_undegraded":"2024-09-21T07:10:43.422843+0000","last_fullsized":"2024-09-21T07:10:43.422843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:55.912212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404284+0000","last_change":"2024-09-21T07:10:43.415461+0000","last_active":"2024-09-21T07:10:44.404284+0000","last_peered":"2024-09-21T07:10:44.404284+0000","last_clean":"2024-09-21T07:10:44.404284+0000","last_became_active":"2024-09-21T07:10:43.410697+0000","last_became_peered":"2024-09-21T07:10:43.410697+0000","last_unstale":"2024-09-21T07:10:44.404284+0000","last_undegraded":"2024-09-21T07:10:44.404284+0000","last_fullsized":"2024-09-21T07:10:44.404284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:14.665635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423386+0000","last_change":"2024-09-21T07:10:43.414479+0000","last_active":"2024-09-21T07:10:43.423386+0000","last_peered":"2024-09-21T07:10:43.423386+0000","last_clean":"2024-09-21T07:10:43.423386+0000","last_became_active":"2024-09-21T07:10:43.414121+0000","last_became_peered":"2024-09-21T07:10:43.414121+0000","last_unstale":"2024-09-21T07:10:43.423386+0000","last_undegraded":"2024-09-21T07:10:43.423386+0000","last_fullsized":"2024-09-21T07:10:43.423386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:11.463765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422706+0000","last_change":"2024-09-21T07:10:43.416414+0000","last_active":"2024-09-21T07:10:43.422706+0000","last_peered":"2024-09-21T07:10:43.422706+0000","last_clean":"2024-09-21T07:10:43.422706+0000","last_became_active":"2024-09-21T07:10:43.415380+0000","last_became_peered":"2024-09-21T07:10:43.415380+0000","last_unstale":"2024-09-21T07:10:43.422706+0000","last_undegraded":"2024-09-21T07:10:43.422706+0000","last_fullsized":"2024-09-21T07:10:43.422706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:42.770919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422667+0000","last_change":"2024-09-21T07:10:43.415169+0000","last_active":"2024-09-21T07:10:43.422667+0000","last_peered":"2024-09-21T07:10:43.422667+0000","last_clean":"2024-09-21T07:10:43.422667+0000","last_became_active":"2024-09-21T07:10:43.414845+0000","last_became_peered":"2024-09-21T07:10:43.414845+0000","last_unstale":"2024-09-21T07:10:43.422667+0000","last_undegraded":"2024-09-21T07:10:43.422667+0000","last_fullsized":"2024-09-21T07:10:43.422667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:48.180670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404615+0000","last_change":"2024-09-21T07:10:43.425050+0000","last_active":"2024-09-21T07:10:44.404615+0000","last_peered":"2024-09-21T07:10:44.404615+0000","last_clean":"2024-09-21T07:10:44.404615+0000","last_became_active":"2024-09-21T07:10:43.424686+0000","last_became_peered":"2024-09-21T07:10:43.424686+0000","last_unstale":"2024-09-21T07:10:44.404615+0000","last_undegraded":"2024-09-21T07:10:44.404615+0000","last_fullsized":"2024-09-21T07:10:44.404615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:11.009112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.425732+0000","last_change":"2024-09-21T07:10:43.415955+0000","last_active":"2024-09-21T07:10:43.425732+0000","last_peered":"2024-09-21T07:10:43.425732+0000","last_clean":"2024-09-21T07:10:43.425732+0000","last_became_active":"2024-09-21T07:10:43.415633+0000","last_became_peered":"2024-09-21T07:10:43.415633+0000","last_unstale":"2024-09-21T07:10:43.425732+0000","last_undegraded":"2024-09-21T07:10:43.425732+0000","last_fullsized":"2024-09-21T07:10:43.425732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:53.391760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423437+0000","last_change":"2024-09-21T07:10:43.417820+0000","last_active":"2024-09-21T07:10:43.423437+0000","last_peered":"2024-09-21T07:10:43.423437+0000","last_clean":"2024-09-21T07:10:43.423437+0000","last_became_active":"2024-09-21T07:10:43.417482+0000","last_became_peered":"2024-09-21T07:10:43.417482+0000","last_unstale":"2024-09-21T07:10:43.423437+0000","last_undegraded":"2024-09-21T07:10:43.423437+0000","last_fullsized":"2024-09-21T07:10:43.423437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:32.997642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.427477+0000","last_change":"2024-09-21T07:10:42.407850+0000","last_active":"2024-09-21T07:10:43.427477+0000","last_peered":"2024-09-21T07:10:43.427477+0000","last_clean":"2024-09-21T07:10:43.427477+0000","last_became_active":"2024-09-21T07:10:42.407497+0000","last_became_peered":"2024-09-21T07:10:42.407497+0000","last_unstale":"2024-09-21T07:10:43.427477+0000","last_undegraded":"2024-09-21T07:10:43.427477+0000","last_fullsized":"2024-09-21T07:10:43.427477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:34.583545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.402886+0000","last_change":"2024-09-21T07:10:43.398164+0000","last_active":"2024-09-21T07:10:43.402886+0000","last_peered":"2024-09-21T07:10:43.402886+0000","last_clean":"2024-09-21T07:10:43.402886+0000","last_became_active":"2024-09-21T07:10:43.397191+0000","last_became_peered":"2024-09-21T07:10:43.397191+0000","last_unstale":"2024-09-21T07:10:43.402886+0000","last_undegraded":"2024-09-21T07:10:43.402886+0000","last_fullsized":"2024-09-21T07:10:43.402886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:09.942947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.400692+0000","last_change":"2024-09-21T07:10:42.405878+0000","last_active":"2024-09-21T07:10:43.400692+0000","last_peered":"2024-09-21T07:10:43.400692+0000","last_clean":"2024-09-21T07:10:43.400692+0000","last_became_active":"2024-09-21T07:10:42.404760+0000","last_became_peered":"2024-09-21T07:10:42.404760+0000","last_unstale":"2024-09-21T07:10:43.400692+0000","last_undegraded":"2024-09-21T07:10:43.400692+0000","last_fullsized":"2024-09-21T07:10:43.400692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:24.910811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.427097+0000","last_change":"2024-09-21T07:10:43.421622+0000","last_active":"2024-09-21T07:10:43.427097+0000","last_peered":"2024-09-21T07:10:43.427097+0000","last_clean":"2024-09-21T07:10:43.427097+0000","last_became_active":"2024-09-21T07:10:43.421299+0000","last_became_peered":"2024-09-21T07:10:43.421299+0000","last_unstale":"2024-09-21T07:10:43.427097+0000","last_undegraded":"2024-09-21T07:10:43.427097+0000","last_fullsized":"2024-09-21T07:10:43.427097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:59.444256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404237+0000","last_change":"2024-09-21T07:10:43.424849+0000","last_active":"2024-09-21T07:10:44.404237+0000","last_peered":"2024-09-21T07:10:44.404237+0000","last_clean":"2024-09-21T07:10:44.404237+0000","last_became_active":"2024-09-21T07:10:43.424491+0000","last_became_peered":"2024-09-21T07:10:43.424491+0000","last_unstale":"2024-09-21T07:10:44.404237+0000","last_undegraded":"2024-09-21T07:10:44.404237+0000","last_fullsized":"2024-09-21T07:10:44.404237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:15.151519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.420700+0000","last_change":"2024-09-21T07:10:43.408995+0000","last_active":"2024-09-21T07:10:43.420700+0000","last_peered":"2024-09-21T07:10:43.420700+0000","last_clean":"2024-09-21T07:10:43.420700+0000","last_became_active":"2024-09-21T07:10:43.408670+0000","last_became_peered":"2024-09-21T07:10:43.408670+0000","last_unstale":"2024-09-21T07:10:43.420700+0000","last_undegraded":"2024-09-21T07:10:43.420700+0000","last_fullsized":"2024-09-21T07:10:43.420700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:39.823395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404702+0000","last_change":"2024-09-21T07:10:42.412327+0000","last_active":"2024-09-21T07:10:44.404702+0000","last_peered":"2024-09-21T07:10:44.404702+0000","last_clean":"2024-09-21T07:10:44.404702+0000","last_became_active":"2024-09-21T07:10:42.411992+0000","last_became_peered":"2024-09-21T07:10:42.411992+0000","last_unstale":"2024-09-21T07:10:44.404702+0000","last_undegraded":"2024-09-21T07:10:44.404702+0000","last_fullsized":"2024-09-21T07:10:44.404702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:12.534169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422070+0000","last_change":"2024-09-21T07:10:42.402240+0000","last_active":"2024-09-21T07:10:43.422070+0000","last_peered":"2024-09-21T07:10:43.422070+0000","last_clean":"2024-09-21T07:10:43.422070+0000","last_became_active":"2024-09-21T07:10:42.401874+0000","last_became_peered":"2024-09-21T07:10:42.401874+0000","last_unstale":"2024-09-21T07:10:43.422070+0000","last_undegraded":"2024-09-21T07:10:43.422070+0000","last_fullsized":"2024-09-21T07:10:43.422070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:57.539687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.421567+0000","last_change":"2024-09-21T07:10:43.411598+0000","last_active":"2024-09-21T07:10:43.421567+0000","last_peered":"2024-09-21T07:10:43.421567+0000","last_clean":"2024-09-21T07:10:43.421567+0000","last_became_active":"2024-09-21T07:10:43.411274+0000","last_became_peered":"2024-09-21T07:10:43.411274+0000","last_unstale":"2024-09-21T07:10:43.421567+0000","last_undegraded":"2024-09-21T07:10:43.421567+0000","last_fullsized":"2024-09-21T07:10:43.421567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:13.540221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404730+0000","last_change":"2024-09-21T07:10:42.410464+0000","last_active":"2024-09-21T07:10:44.404730+0000","last_peered":"2024-09-21T07:10:44.404730+0000","last_clean":"2024-09-21T07:10:44.404730+0000","last_became_active":"2024-09-21T07:10:42.410107+0000","last_became_peered":"2024-09-21T07:10:42.410107+0000","last_unstale":"2024-09-21T07:10:44.404730+0000","last_undegraded":"2024-09-21T07:10:44.404730+0000","last_fullsized":"2024-09-21T07:10:44.404730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:31.991591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":103,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T07:10:33.773629+0000","last_change":"2024-09-21T07:10:32.034091+0000","last_active":"2024-09-21T07:10:33.773629+0000","last_peered":"2024-09-21T07:10:33.773629+0000","last_clean":"2024-09-21T07:10:33.773629+0000","last_became_active":"2024-09-21T07:10:32.033005+0000","last_became_peered":"2024-09-21T07:10:32.033005+0000","last_unstale":"2024-09-21T07:10:33.773629+0000","last_undegraded":"2024-09-21T07:10:33.773629+0000","last_fullsized":"2024-09-21T07:10:33.773629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_clean_scrub_stamp":"2024-09-21T07:10:31.011167+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:10.064019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422484+0000","last_change":"2024-09-21T07:10:43.414223+0000","last_active":"2024-09-21T07:10:43.422484+0000","last_peered":"2024-09-21T07:10:43.422484+0000","last_clean":"2024-09-21T07:10:43.422484+0000","last_became_active":"2024-09-21T07:10:43.413923+0000","last_became_peered":"2024-09-21T07:10:43.413923+0000","last_unstale":"2024-09-21T07:10:43.422484+0000","last_undegraded":"2024-09-21T07:10:43.422484+0000","last_fullsized":"2024-09-21T07:10:43.422484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:47.584490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.400889+0000","last_change":"2024-09-21T07:10:43.396425+0000","last_active":"2024-09-21T07:10:43.400889+0000","last_peered":"2024-09-21T07:10:43.400889+0000","last_clean":"2024-09-21T07:10:43.400889+0000","last_became_active":"2024-09-21T07:10:43.396080+0000","last_became_peered":"2024-09-21T07:10:43.396080+0000","last_unstale":"2024-09-21T07:10:43.400889+0000","last_undegraded":"2024-09-21T07:10:43.400889+0000","last_fullsized":"2024-09-21T07:10:43.400889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:28.816031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404277+0000","last_change":"2024-09-21T07:10:43.419811+0000","last_active":"2024-09-21T07:10:44.404277+0000","last_peered":"2024-09-21T07:10:44.404277+0000","last_clean":"2024-09-21T07:10:44.404277+0000","last_became_active":"2024-09-21T07:10:43.419490+0000","last_became_peered":"2024-09-21T07:10:43.419490+0000","last_unstale":"2024-09-21T07:10:44.404277+0000","last_undegraded":"2024-09-21T07:10:44.404277+0000","last_fullsized":"2024-09-21T07:10:44.404277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:08.183794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404434+0000","last_change":"2024-09-21T07:10:42.407164+0000","last_active":"2024-09-21T07:10:44.404434+0000","last_peered":"2024-09-21T07:10:44.404434+0000","last_clean":"2024-09-21T07:10:44.404434+0000","last_became_active":"2024-09-21T07:10:42.406833+0000","last_became_peered":"2024-09-21T07:10:42.406833+0000","last_unstale":"2024-09-21T07:10:44.404434+0000","last_undegraded":"2024-09-21T07:10:44.404434+0000","last_fullsized":"2024-09-21T07:10:44.404434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:50.661135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404296+0000","last_change":"2024-09-21T07:10:43.416948+0000","last_active":"2024-09-21T07:10:44.404296+0000","last_peered":"2024-09-21T07:10:44.404296+0000","last_clean":"2024-09-21T07:10:44.404296+0000","last_became_active":"2024-09-21T07:10:43.416515+0000","last_became_peered":"2024-09-21T07:10:43.416515+0000","last_unstale":"2024-09-21T07:10:44.404296+0000","last_undegraded":"2024-09-21T07:10:44.404296+0000","last_fullsized":"2024-09-21T07:10:44.404296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:23.952801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404606+0000","last_change":"2024-09-21T07:10:42.408894+0000","last_active":"2024-09-21T07:10:44.404606+0000","last_peered":"2024-09-21T07:10:44.404606+0000","last_clean":"2024-09-21T07:10:44.404606+0000","last_became_active":"2024-09-21T07:10:42.408392+0000","last_became_peered":"2024-09-21T07:10:42.408392+0000","last_unstale":"2024-09-21T07:10:44.404606+0000","last_undegraded":"2024-09-21T07:10:44.404606+0000","last_fullsized":"2024-09-21T07:10:44.404606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:22.386244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422637+0000","last_change":"2024-09-21T07:10:43.413469+0000","last_active":"2024-09-21T07:10:43.422637+0000","last_peered":"2024-09-21T07:10:43.422637+0000","last_clean":"2024-09-21T07:10:43.422637+0000","last_became_active":"2024-09-21T07:10:43.413144+0000","last_became_peered":"2024-09-21T07:10:43.413144+0000","last_unstale":"2024-09-21T07:10:43.422637+0000","last_undegraded":"2024-09-21T07:10:43.422637+0000","last_fullsized":"2024-09-21T07:10:43.422637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:26.991092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423115+0000","last_change":"2024-09-21T07:10:43.419670+0000","last_active":"2024-09-21T07:10:43.423115+0000","last_peered":"2024-09-21T07:10:43.423115+0000","last_clean":"2024-09-21T07:10:43.423115+0000","last_became_active":"2024-09-21T07:10:43.419363+0000","last_became_peered":"2024-09-21T07:10:43.419363+0000","last_unstale":"2024-09-21T07:10:43.423115+0000","last_undegraded":"2024-09-21T07:10:43.423115+0000","last_fullsized":"2024-09-21T07:10:43.423115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:16.496407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404360+0000","last_change":"2024-09-21T07:10:42.412473+0000","last_active":"2024-09-21T07:10:44.404360+0000","last_peered":"2024-09-21T07:10:44.404360+0000","last_clean":"2024-09-21T07:10:44.404360+0000","last_became_active":"2024-09-21T07:10:42.412072+0000","last_became_peered":"2024-09-21T07:10:42.412072+0000","last_unstale":"2024-09-21T07:10:44.404360+0000","last_undegraded":"2024-09-21T07:10:44.404360+0000","last_fullsized":"2024-09-21T07:10:44.404360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:38.817344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423320+0000","last_change":"2024-09-21T07:10:43.413781+0000","last_active":"2024-09-21T07:10:43.423320+0000","last_peered":"2024-09-21T07:10:43.423320+0000","last_clean":"2024-09-21T07:10:43.423320+0000","last_became_active":"2024-09-21T07:10:43.413312+0000","last_became_peered":"2024-09-21T07:10:43.413312+0000","last_unstale":"2024-09-21T07:10:43.423320+0000","last_undegraded":"2024-09-21T07:10:43.423320+0000","last_fullsized":"2024-09-21T07:10:43.423320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:56.052704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404554+0000","last_change":"2024-09-21T07:10:42.409241+0000","last_active":"2024-09-21T07:10:44.404554+0000","last_peered":"2024-09-21T07:10:44.404554+0000","last_clean":"2024-09-21T07:10:44.404554+0000","last_became_active":"2024-09-21T07:10:42.408948+0000","last_became_peered":"2024-09-21T07:10:42.408948+0000","last_unstale":"2024-09-21T07:10:44.404554+0000","last_undegraded":"2024-09-21T07:10:44.404554+0000","last_fullsized":"2024-09-21T07:10:44.404554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:10.457714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419343+0000","last_change":"2024-09-21T07:10:43.410463+0000","last_active":"2024-09-21T07:10:43.419343+0000","last_peered":"2024-09-21T07:10:43.419343+0000","last_clean":"2024-09-21T07:10:43.419343+0000","last_became_active":"2024-09-21T07:10:43.410089+0000","last_became_peered":"2024-09-21T07:10:43.410089+0000","last_unstale":"2024-09-21T07:10:43.419343+0000","last_undegraded":"2024-09-21T07:10:43.419343+0000","last_fullsized":"2024-09-21T07:10:43.419343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:16.668262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:42.380021+0000","last_change":"2024-09-21T07:10:42.380021+0000","last_active":"2024-09-21T07:10:42.380021+0000","last_peered":"2024-09-21T07:10:42.380021+0000","last_clean":"2024-09-21T07:10:42.380021+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:42.380021+0000","last_undegraded":"2024-09-21T07:10:42.380021+0000","last_fullsized":"2024-09-21T07:10:42.380021+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:10:41.373970+0000","last_change":"2024-09-21T07:10:41.373970+0000","last_active":"2024-09-21T07:10:41.373970+0000","last_peered":"2024-09-21T07:10:41.373970+0000","last_clean":"2024-09-21T07:10:41.373970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:10:41.373970+0000","last_undegraded":"2024-09-21T07:10:41.373970+0000","last_fullsized":"2024-09-21T07:10:41.373970+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.420400+0000","last_change":"2024-09-21T07:10:43.408059+0000","last_active":"2024-09-21T07:10:43.420400+0000","last_peered":"2024-09-21T07:10:43.420400+0000","last_clean":"2024-09-21T07:10:43.420400+0000","last_became_active":"2024-09-21T07:10:43.407707+0000","last_became_peered":"2024-09-21T07:10:43.407707+0000","last_unstale":"2024-09-21T07:10:43.420400+0000","last_undegraded":"2024-09-21T07:10:43.420400+0000","last_fullsized":"2024-09-21T07:10:43.420400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:23.392296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.427614+0000","last_change":"2024-09-21T07:10:42.403998+0000","last_active":"2024-09-21T07:10:43.427614+0000","last_peered":"2024-09-21T07:10:43.427614+0000","last_clean":"2024-09-21T07:10:43.427614+0000","last_became_active":"2024-09-21T07:10:42.403552+0000","last_became_peered":"2024-09-21T07:10:42.403552+0000","last_unstale":"2024-09-21T07:10:43.427614+0000","last_undegraded":"2024-09-21T07:10:43.427614+0000","last_fullsized":"2024-09-21T07:10:43.427614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:33.377412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419407+0000","last_change":"2024-09-21T07:10:43.411885+0000","last_active":"2024-09-21T07:10:43.419407+0000","last_peered":"2024-09-21T07:10:43.419407+0000","last_clean":"2024-09-21T07:10:43.419407+0000","last_became_active":"2024-09-21T07:10:43.410907+0000","last_became_peered":"2024-09-21T07:10:43.410907+0000","last_unstale":"2024-09-21T07:10:43.419407+0000","last_undegraded":"2024-09-21T07:10:43.419407+0000","last_fullsized":"2024-09-21T07:10:43.419407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:54.216907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.424450+0000","last_change":"2024-09-21T07:10:42.408992+0000","last_active":"2024-09-21T07:10:43.424450+0000","last_peered":"2024-09-21T07:10:43.424450+0000","last_clean":"2024-09-21T07:10:43.424450+0000","last_became_active":"2024-09-21T07:10:42.408041+0000","last_became_peered":"2024-09-21T07:10:42.408041+0000","last_unstale":"2024-09-21T07:10:43.424450+0000","last_undegraded":"2024-09-21T07:10:43.424450+0000","last_fullsized":"2024-09-21T07:10:43.424450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:36.986751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":22,"acting":22,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":753664,"data_stored":638320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":159744,"data_stored":47952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31348,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":159744,"data_stored":47952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":159744,"data_stored":47952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35508,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336332,"statfs":{"total":96636764160,"available":96600403968,"internally_reserved":0,"allocated":159744,"data_stored":47952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":68431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":217088,"data_stored":73279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":802816,"data_stored":657825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:10:48.214 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-21T07:10:48.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.215 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-21T07:10:48.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.215 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-21T07:10:48.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.215 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-21T07:10:48.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.215 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-21T07:10:48.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.215 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-21T07:10:48.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.216 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-21T07:10:48.216 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.216 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-21T07:10:48.216 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.216 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-21T07:10:48.216 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.216 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-21T07:10:48.216 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.216 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-21T07:10:48.216 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.216 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-21T07:10:48.216 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.217 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-21T07:10:48.217 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.217 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-21T07:10:48.217 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.217 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-21T07:10:48.217 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.217 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-21T07:10:48.217 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.218 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-21T07:10:48.218 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.218 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-21T07:10:48.218 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.218 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-21T07:10:48.218 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.218 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-21T07:10:48.218 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.218 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-21T07:10:48.218 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.219 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1a is not active+clean 2024-09-21T07:10:48.219 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.219 INFO:tasks.ceph.ceph_manager.ceph:PG 2.18 is not active+clean 2024-09-21T07:10:48.219 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.219 INFO:tasks.ceph.ceph_manager.ceph:PG 2.17 is not active+clean 2024-09-21T07:10:48.219 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.219 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-21T07:10:48.219 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.219 INFO:tasks.ceph.ceph_manager.ceph:PG 2.16 is not active+clean 2024-09-21T07:10:48.219 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.220 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-21T07:10:48.220 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.220 INFO:tasks.ceph.ceph_manager.ceph:PG 2.14 is not active+clean 2024-09-21T07:10:48.220 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.220 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-21T07:10:48.220 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.220 INFO:tasks.ceph.ceph_manager.ceph:PG 2.12 is not active+clean 2024-09-21T07:10:48.220 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.220 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-21T07:10:48.220 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.220 INFO:tasks.ceph.ceph_manager.ceph:PG 2.11 is not active+clean 2024-09-21T07:10:48.220 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.221 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-21T07:10:48.221 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.221 INFO:tasks.ceph.ceph_manager.ceph:PG 2.10 is not active+clean 2024-09-21T07:10:48.221 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.221 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-21T07:10:48.221 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.221 INFO:tasks.ceph.ceph_manager.ceph:PG 2.f is not active+clean 2024-09-21T07:10:48.221 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.221 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-21T07:10:48.222 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.222 INFO:tasks.ceph.ceph_manager.ceph:PG 2.e is not active+clean 2024-09-21T07:10:48.222 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.222 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-21T07:10:48.222 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.222 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-21T07:10:48.222 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.222 INFO:tasks.ceph.ceph_manager.ceph:PG 2.c is not active+clean 2024-09-21T07:10:48.222 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.222 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-21T07:10:48.222 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.223 INFO:tasks.ceph.ceph_manager.ceph:PG 2.3 is not active+clean 2024-09-21T07:10:48.223 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.223 INFO:tasks.ceph.ceph_manager.ceph:PG 2.0 is not active+clean 2024-09-21T07:10:48.223 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.223 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1 is not active+clean 2024-09-21T07:10:48.223 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.223 INFO:tasks.ceph.ceph_manager.ceph:PG 2.2 is not active+clean 2024-09-21T07:10:48.223 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.223 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-21T07:10:48.223 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.223 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-21T07:10:48.223 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.224 INFO:tasks.ceph.ceph_manager.ceph:PG 2.5 is not active+clean 2024-09-21T07:10:48.224 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.224 INFO:tasks.ceph.ceph_manager.ceph:PG 2.7 is not active+clean 2024-09-21T07:10:48.224 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.224 INFO:tasks.ceph.ceph_manager.ceph:PG 2.8 is not active+clean 2024-09-21T07:10:48.224 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.224 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-21T07:10:48.224 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.224 INFO:tasks.ceph.ceph_manager.ceph:PG 2.b is not active+clean 2024-09-21T07:10:48.225 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.225 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-21T07:10:48.225 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.225 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-21T07:10:48.225 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.225 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1c is not active+clean 2024-09-21T07:10:48.225 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.225 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-21T07:10:48.225 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:42.380021+0000', 'last_change': '2024-09-21T07:10:42.380021+0000', 'last_active': '2024-09-21T07:10:42.380021+0000', 'last_peered': '2024-09-21T07:10:42.380021+0000', 'last_clean': '2024-09-21T07:10:42.380021+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:42.380021+0000', 'last_undegraded': '2024-09-21T07:10:42.380021+0000', 'last_fullsized': '2024-09-21T07:10:42.380021+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:42.380021+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.225 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1d is not active+clean 2024-09-21T07:10:48.225 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:10:41.373970+0000', 'last_change': '2024-09-21T07:10:41.373970+0000', 'last_active': '2024-09-21T07:10:41.373970+0000', 'last_peered': '2024-09-21T07:10:41.373970+0000', 'last_clean': '2024-09-21T07:10:41.373970+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:10:41.373970+0000', 'last_undegraded': '2024-09-21T07:10:41.373970+0000', 'last_fullsized': '2024-09-21T07:10:41.373970+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'last_clean_scrub_stamp': '2024-09-21T07:10:41.373970+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:10:48.226 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:10:48.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.365+0000 7fc1ba150640 1 -- 172.21.15.18:0/1922352651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1b415c520 msgr2=0x7fc1b40d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.365+0000 7fc1ba150640 1 --2- 172.21.15.18:0/1922352651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1b415c520 0x7fc1b40d3040 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009820 tx=0x7fc1a802a540 comp rx=0 tx=0).stop 2024-09-21T07:10:48.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.366+0000 7fc1ba150640 1 -- 172.21.15.18:0/1922352651 shutdown_connections 2024-09-21T07:10:48.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.366+0000 7fc1ba150640 1 --2- 172.21.15.18:0/1922352651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1b415c520 0x7fc1b40d3040 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.366+0000 7fc1ba150640 1 -- 172.21.15.18:0/1922352651 >> 172.21.15.18:0/1922352651 conn(0x7fc1b4073f30 msgr2=0x7fc1b40b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:48.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.366+0000 7fc1ba150640 1 -- 172.21.15.18:0/1922352651 shutdown_connections 2024-09-21T07:10:48.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.366+0000 7fc1ba150640 1 -- 172.21.15.18:0/1922352651 wait complete. 2024-09-21T07:10:48.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.367+0000 7fc1ba150640 1 Processor -- start 2024-09-21T07:10:48.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.368+0000 7fc1ba150640 1 -- start start 2024-09-21T07:10:48.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1ba150640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc1b40d3580 0x7fc1b40ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1ba150640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1b415c520 0x7fc1b415b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1ba150640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1b415ef50 0x7fc1b40d4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1ba150640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b40d13b0 con 0x7fc1b415c520 2024-09-21T07:10:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1ba150640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b40d1230 con 0x7fc1b415ef50 2024-09-21T07:10:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1ba150640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b40d1530 con 0x7fc1b40d3580 2024-09-21T07:10:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1b2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1b415c520 0x7fc1b415b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1b2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1b415c520 0x7fc1b415b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49974/0 (socket says 172.21.15.18:49974) 2024-09-21T07:10:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1b2ffd640 1 -- 172.21.15.18:0/1926832777 learned_addr learned my addr 172.21.15.18:0/1926832777 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1b37fe640 1 --2- 172.21.15.18:0/1926832777 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc1b40d3580 0x7fc1b40ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1b3fff640 1 --2- 172.21.15.18:0/1926832777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1b415ef50 0x7fc1b40d4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1b2ffd640 1 -- 172.21.15.18:0/1926832777 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc1b40d3580 msgr2=0x7fc1b40ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1b2ffd640 1 --2- 172.21.15.18:0/1926832777 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc1b40d3580 0x7fc1b40ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1b2ffd640 1 -- 172.21.15.18:0/1926832777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1b415ef50 msgr2=0x7fc1b40d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1b2ffd640 1 --2- 172.21.15.18:0/1926832777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1b415ef50 0x7fc1b40d4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1b2ffd640 1 -- 172.21.15.18:0/1926832777 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b40cb090 con 0x7fc1b415c520 2024-09-21T07:10:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.369+0000 7fc1b2ffd640 1 --2- 172.21.15.18:0/1926832777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1b415c520 0x7fc1b415b140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009910 tx=0x7fc1a8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.370+0000 7fc19bfff640 1 -- 172.21.15.18:0/1926832777 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a803f070 con 0x7fc1b415c520 2024-09-21T07:10:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.370+0000 7fc19bfff640 1 -- 172.21.15.18:0/1926832777 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1a8004ca0 con 0x7fc1b415c520 2024-09-21T07:10:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.370+0000 7fc1ba150640 1 -- 172.21.15.18:0/1926832777 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b41f8e90 con 0x7fc1b415c520 2024-09-21T07:10:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.370+0000 7fc19bfff640 1 -- 172.21.15.18:0/1926832777 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8005c30 con 0x7fc1b415c520 2024-09-21T07:10:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.370+0000 7fc1ba150640 1 -- 172.21.15.18:0/1926832777 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b41f9450 con 0x7fc1b415c520 2024-09-21T07:10:48.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.371+0000 7fc1ba150640 1 -- 172.21.15.18:0/1926832777 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b40cade0 con 0x7fc1b415c520 2024-09-21T07:10:48.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.372+0000 7fc19bfff640 1 -- 172.21.15.18:0/1926832777 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc1a8042070 con 0x7fc1b415c520 2024-09-21T07:10:48.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.372+0000 7fc19bfff640 1 --2- 172.21.15.18:0/1926832777 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc1a0078bc0 0x7fc1a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.372+0000 7fc19bfff640 1 -- 172.21.15.18:0/1926832777 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc1a80bbb70 con 0x7fc1b415c520 2024-09-21T07:10:48.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.372+0000 7fc1b37fe640 1 --2- 172.21.15.18:0/1926832777 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc1a0078bc0 0x7fc1a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.373+0000 7fc1b37fe640 1 --2- 172.21.15.18:0/1926832777 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc1a0078bc0 0x7fc1a007b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4001860 tx=0x7fc1a4001690 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:48.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.377+0000 7fc19bfff640 1 -- 172.21.15.18:0/1926832777 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc1a8083960 con 0x7fc1b415c520 2024-09-21T07:10:48.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.638+0000 7fc1ba150640 1 -- 172.21.15.18:0/1926832777 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc1b40d19e0 con 0x7fc1b415c520 2024-09-21T07:10:48.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.639+0000 7fc19bfff640 1 -- 172.21.15.18:0/1926832777 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1053 (secure 0 0 0) 0x7fc1a8088390 con 0x7fc1b415c520 2024-09-21T07:10:48.641 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:48.641 INFO:teuthology.orchestra.run.smithi018.stdout:{"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":30,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1726902631,"num_in_osds":8,"osd_in_since":1726902621,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":275443712,"bytes_avail":772818669568,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"btime":"2024-09-21T07:10:46:409212+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4395}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-21T07:10:17.748212+0000","services":{}},"progress_events":{}} 2024-09-21T07:10:48.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.641+0000 7fc1ba150640 1 -- 172.21.15.18:0/1926832777 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc1a0078bc0 msgr2=0x7fc1a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.641+0000 7fc1ba150640 1 --2- 172.21.15.18:0/1926832777 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc1a0078bc0 0x7fc1a007b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4001860 tx=0x7fc1a4001690 comp rx=0 tx=0).stop 2024-09-21T07:10:48.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.641+0000 7fc1ba150640 1 -- 172.21.15.18:0/1926832777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1b415c520 msgr2=0x7fc1b415b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.641+0000 7fc1ba150640 1 --2- 172.21.15.18:0/1926832777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1b415c520 0x7fc1b415b140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009910 tx=0x7fc1a8003c10 comp rx=0 tx=0).stop 2024-09-21T07:10:48.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.641+0000 7fc1ba150640 1 -- 172.21.15.18:0/1926832777 shutdown_connections 2024-09-21T07:10:48.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.641+0000 7fc1ba150640 1 --2- 172.21.15.18:0/1926832777 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1b415ef50 0x7fc1b40d4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.641+0000 7fc1ba150640 1 --2- 172.21.15.18:0/1926832777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1b415c520 0x7fc1b415b140 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.641+0000 7fc1ba150640 1 --2- 172.21.15.18:0/1926832777 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc1a0078bc0 0x7fc1a007b0d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.641+0000 7fc1ba150640 1 --2- 172.21.15.18:0/1926832777 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc1b40d3580 0x7fc1b40ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.641+0000 7fc1ba150640 1 -- 172.21.15.18:0/1926832777 >> 172.21.15.18:0/1926832777 conn(0x7fc1b4073f30 msgr2=0x7fc1b40cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:48.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.641+0000 7fc1ba150640 1 -- 172.21.15.18:0/1926832777 shutdown_connections 2024-09-21T07:10:48.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.641+0000 7fc1ba150640 1 -- 172.21.15.18:0/1926832777 wait complete. 2024-09-21T07:10:48.654 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:10:48.654 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:10:48.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.768+0000 7f5763598640 1 -- 172.21.15.18:0/1716811894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c1525f0 msgr2=0x7f575c0b5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.768+0000 7f5763598640 1 --2- 172.21.15.18:0/1716811894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c1525f0 0x7f575c0b5cc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f57580098e0 tx=0x7f575802a410 comp rx=0 tx=0).stop 2024-09-21T07:10:48.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.768+0000 7f5763598640 1 -- 172.21.15.18:0/1716811894 shutdown_connections 2024-09-21T07:10:48.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.768+0000 7f5763598640 1 --2- 172.21.15.18:0/1716811894 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f575c06e460 0x7f575c15bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.768+0000 7f5763598640 1 --2- 172.21.15.18:0/1716811894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c1525f0 0x7f575c0b5cc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.768+0000 7f5763598640 1 -- 172.21.15.18:0/1716811894 >> 172.21.15.18:0/1716811894 conn(0x7f575c073340 msgr2=0x7f575c073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:48.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.768+0000 7f5763598640 1 -- 172.21.15.18:0/1716811894 shutdown_connections 2024-09-21T07:10:48.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.768+0000 7f5763598640 1 -- 172.21.15.18:0/1716811894 wait complete. 2024-09-21T07:10:48.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.770+0000 7f5763598640 1 Processor -- start 2024-09-21T07:10:48.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.770+0000 7f5763598640 1 -- start start 2024-09-21T07:10:48.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5763598640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c0b6200 0x7f575c146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5763598640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f575c1525f0 0x7f575c1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5763598640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f575c151e30 0x7f575c1f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5763598640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f575c15c580 con 0x7f575c0b6200 2024-09-21T07:10:48.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5763598640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f575c15c400 con 0x7f575c151e30 2024-09-21T07:10:48.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5763598640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f575c15c700 con 0x7f575c1525f0 2024-09-21T07:10:48.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5761334640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c0b6200 0x7f575c146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5761334640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c0b6200 0x7f575c146530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50000/0 (socket says 172.21.15.18:50000) 2024-09-21T07:10:48.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5761334640 1 -- 172.21.15.18:0/3871751079 learned_addr learned my addr 172.21.15.18:0/3871751079 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:48.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5761b35640 1 --2- 172.21.15.18:0/3871751079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f575c151e30 0x7f575c1f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5760b33640 1 --2- 172.21.15.18:0/3871751079 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f575c1525f0 0x7f575c1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5761334640 1 -- 172.21.15.18:0/3871751079 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f575c1525f0 msgr2=0x7f575c1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5761334640 1 --2- 172.21.15.18:0/3871751079 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f575c1525f0 0x7f575c1518f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5761334640 1 -- 172.21.15.18:0/3871751079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f575c151e30 msgr2=0x7f575c1f8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5761334640 1 --2- 172.21.15.18:0/3871751079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f575c151e30 0x7f575c1f8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5761334640 1 -- 172.21.15.18:0/3871751079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c14d2a0 con 0x7f575c0b6200 2024-09-21T07:10:48.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5761334640 1 --2- 172.21.15.18:0/3871751079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c0b6200 0x7f575c146530 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f575802aa00 tx=0x7f57580052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:48.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.772+0000 7f5751ffb640 1 -- 172.21.15.18:0/3871751079 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575803f070 con 0x7f575c0b6200 2024-09-21T07:10:48.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.773+0000 7f5751ffb640 1 -- 172.21.15.18:0/3871751079 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5758004340 con 0x7f575c0b6200 2024-09-21T07:10:48.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.773+0000 7f5763598640 1 -- 172.21.15.18:0/3871751079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575c0af9b0 con 0x7f575c0b6200 2024-09-21T07:10:48.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.773+0000 7f5751ffb640 1 -- 172.21.15.18:0/3871751079 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758005cf0 con 0x7f575c0b6200 2024-09-21T07:10:48.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.773+0000 7f5763598640 1 -- 172.21.15.18:0/3871751079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575c0aff70 con 0x7f575c0b6200 2024-09-21T07:10:48.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.774+0000 7f5763598640 1 -- 172.21.15.18:0/3871751079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575c0766f0 con 0x7f575c0b6200 2024-09-21T07:10:48.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.775+0000 7f5751ffb640 1 -- 172.21.15.18:0/3871751079 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5758042070 con 0x7f575c0b6200 2024-09-21T07:10:48.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.775+0000 7f5751ffb640 1 --2- 172.21.15.18:0/3871751079 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5740078bc0 0x7f574007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:48.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.775+0000 7f5751ffb640 1 -- 172.21.15.18:0/3871751079 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f57580bbb80 con 0x7f575c0b6200 2024-09-21T07:10:48.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.775+0000 7f5760b33640 1 --2- 172.21.15.18:0/3871751079 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5740078bc0 0x7f574007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:48.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.776+0000 7f5760b33640 1 --2- 172.21.15.18:0/3871751079 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5740078bc0 0x7f574007b0d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f574c006fd0 tx=0x7f574c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:48.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.780+0000 7f5751ffb640 1 -- 172.21.15.18:0/3871751079 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5758031770 con 0x7f575c0b6200 2024-09-21T07:10:48.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.967+0000 7f5763598640 1 -- 172.21.15.18:0/3871751079 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f575c06b490 con 0x7f5740078bc0 2024-09-21T07:10:48.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.972+0000 7f5751ffb640 1 -- 172.21.15.18:0/3871751079 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251935 (secure 0 0 0) 0x7f574c00c4f0 con 0x7f5740078bc0 2024-09-21T07:10:48.976 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:48.978 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-21T07:10:48.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.975+0000 7f5763598640 1 -- 172.21.15.18:0/3871751079 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5740078bc0 msgr2=0x7f574007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.975+0000 7f5763598640 1 --2- 172.21.15.18:0/3871751079 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5740078bc0 0x7f574007b0d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f574c006fd0 tx=0x7f574c008040 comp rx=0 tx=0).stop 2024-09-21T07:10:48.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.975+0000 7f5763598640 1 -- 172.21.15.18:0/3871751079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c0b6200 msgr2=0x7f575c146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:48.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.975+0000 7f5763598640 1 --2- 172.21.15.18:0/3871751079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c0b6200 0x7f575c146530 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f575802aa00 tx=0x7f57580052f0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.975+0000 7f5763598640 1 -- 172.21.15.18:0/3871751079 shutdown_connections 2024-09-21T07:10:48.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.975+0000 7f5763598640 1 --2- 172.21.15.18:0/3871751079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f575c151e30 0x7f575c1f8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.975+0000 7f5763598640 1 --2- 172.21.15.18:0/3871751079 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5740078bc0 0x7f574007b0d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.975+0000 7f5763598640 1 --2- 172.21.15.18:0/3871751079 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f575c1525f0 0x7f575c1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.975+0000 7f5763598640 1 --2- 172.21.15.18:0/3871751079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c0b6200 0x7f575c146530 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:48.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.975+0000 7f5763598640 1 -- 172.21.15.18:0/3871751079 >> 172.21.15.18:0/3871751079 conn(0x7f575c073340 msgr2=0x7f575c15d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:48.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.975+0000 7f5763598640 1 -- 172.21.15.18:0/3871751079 shutdown_connections 2024-09-21T07:10:48.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:48.975+0000 7f5763598640 1 -- 172.21.15.18:0/3871751079 wait complete. 2024-09-21T07:10:48.988 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-21T07:10:48.314943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":268988,"kb_used_data":2808,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754705732,"statfs":{"total":773094113280,"available":772818669568,"internally_reserved":0,"allocated":2875392,"data_stored":1745308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001446"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.421563+0000","last_change":"2024-09-21T07:10:43.418758+0000","last_active":"2024-09-21T07:10:43.421563+0000","last_peered":"2024-09-21T07:10:43.421563+0000","last_clean":"2024-09-21T07:10:43.421563+0000","last_became_active":"2024-09-21T07:10:43.413221+0000","last_became_peered":"2024-09-21T07:10:43.413221+0000","last_unstale":"2024-09-21T07:10:43.421563+0000","last_undegraded":"2024-09-21T07:10:43.421563+0000","last_fullsized":"2024-09-21T07:10:43.421563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:30.348938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404706+0000","last_change":"2024-09-21T07:10:43.425911+0000","last_active":"2024-09-21T07:10:44.404706+0000","last_peered":"2024-09-21T07:10:44.404706+0000","last_clean":"2024-09-21T07:10:44.404706+0000","last_became_active":"2024-09-21T07:10:43.424831+0000","last_became_peered":"2024-09-21T07:10:43.424831+0000","last_unstale":"2024-09-21T07:10:44.404706+0000","last_undegraded":"2024-09-21T07:10:44.404706+0000","last_fullsized":"2024-09-21T07:10:44.404706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:52.852007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.405662+0000","last_change":"2024-09-21T07:10:43.402987+0000","last_active":"2024-09-21T07:10:43.405662+0000","last_peered":"2024-09-21T07:10:43.405662+0000","last_clean":"2024-09-21T07:10:43.405662+0000","last_became_active":"2024-09-21T07:10:43.402600+0000","last_became_peered":"2024-09-21T07:10:43.402600+0000","last_unstale":"2024-09-21T07:10:43.405662+0000","last_undegraded":"2024-09-21T07:10:43.405662+0000","last_fullsized":"2024-09-21T07:10:43.405662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:51.667187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405847+0000","last_change":"2024-09-21T07:10:43.418498+0000","last_active":"2024-09-21T07:10:44.405847+0000","last_peered":"2024-09-21T07:10:44.405847+0000","last_clean":"2024-09-21T07:10:44.405847+0000","last_became_active":"2024-09-21T07:10:43.418075+0000","last_became_peered":"2024-09-21T07:10:43.418075+0000","last_unstale":"2024-09-21T07:10:44.405847+0000","last_undegraded":"2024-09-21T07:10:44.405847+0000","last_fullsized":"2024-09-21T07:10:44.405847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:39.715349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.420495+0000","last_change":"2024-09-21T07:10:43.409859+0000","last_active":"2024-09-21T07:10:43.420495+0000","last_peered":"2024-09-21T07:10:43.420495+0000","last_clean":"2024-09-21T07:10:43.420495+0000","last_became_active":"2024-09-21T07:10:43.409171+0000","last_became_peered":"2024-09-21T07:10:43.409171+0000","last_unstale":"2024-09-21T07:10:43.420495+0000","last_undegraded":"2024-09-21T07:10:43.420495+0000","last_fullsized":"2024-09-21T07:10:43.420495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:45.146961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405635+0000","last_change":"2024-09-21T07:10:43.408895+0000","last_active":"2024-09-21T07:10:44.405635+0000","last_peered":"2024-09-21T07:10:44.405635+0000","last_clean":"2024-09-21T07:10:44.405635+0000","last_became_active":"2024-09-21T07:10:43.408402+0000","last_became_peered":"2024-09-21T07:10:43.408402+0000","last_unstale":"2024-09-21T07:10:44.405635+0000","last_undegraded":"2024-09-21T07:10:44.405635+0000","last_fullsized":"2024-09-21T07:10:44.405635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:28.893883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.407856+0000","last_change":"2024-09-21T07:10:43.404599+0000","last_active":"2024-09-21T07:10:43.407856+0000","last_peered":"2024-09-21T07:10:43.407856+0000","last_clean":"2024-09-21T07:10:43.407856+0000","last_became_active":"2024-09-21T07:10:43.404288+0000","last_became_peered":"2024-09-21T07:10:43.404288+0000","last_unstale":"2024-09-21T07:10:43.407856+0000","last_undegraded":"2024-09-21T07:10:43.407856+0000","last_fullsized":"2024-09-21T07:10:43.407856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:53.391760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419329+0000","last_change":"2024-09-21T07:10:43.412128+0000","last_active":"2024-09-21T07:10:43.419329+0000","last_peered":"2024-09-21T07:10:43.419329+0000","last_clean":"2024-09-21T07:10:43.419329+0000","last_became_active":"2024-09-21T07:10:43.410969+0000","last_became_peered":"2024-09-21T07:10:43.410969+0000","last_unstale":"2024-09-21T07:10:43.419329+0000","last_undegraded":"2024-09-21T07:10:43.419329+0000","last_fullsized":"2024-09-21T07:10:43.419329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:16.951261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422493+0000","last_change":"2024-09-21T07:10:43.420504+0000","last_active":"2024-09-21T07:10:43.422493+0000","last_peered":"2024-09-21T07:10:43.422493+0000","last_clean":"2024-09-21T07:10:43.422493+0000","last_became_active":"2024-09-21T07:10:43.418716+0000","last_became_peered":"2024-09-21T07:10:43.418716+0000","last_unstale":"2024-09-21T07:10:43.422493+0000","last_undegraded":"2024-09-21T07:10:43.422493+0000","last_fullsized":"2024-09-21T07:10:43.422493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:45.271471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423623+0000","last_change":"2024-09-21T07:10:43.414160+0000","last_active":"2024-09-21T07:10:44.423623+0000","last_peered":"2024-09-21T07:10:44.423623+0000","last_clean":"2024-09-21T07:10:44.423623+0000","last_became_active":"2024-09-21T07:10:43.413651+0000","last_became_peered":"2024-09-21T07:10:43.413651+0000","last_unstale":"2024-09-21T07:10:44.423623+0000","last_undegraded":"2024-09-21T07:10:44.423623+0000","last_fullsized":"2024-09-21T07:10:44.423623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:36.925353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423522+0000","last_change":"2024-09-21T07:10:43.414383+0000","last_active":"2024-09-21T07:10:44.423522+0000","last_peered":"2024-09-21T07:10:44.423522+0000","last_clean":"2024-09-21T07:10:44.423522+0000","last_became_active":"2024-09-21T07:10:43.413520+0000","last_became_peered":"2024-09-21T07:10:43.413520+0000","last_unstale":"2024-09-21T07:10:44.423522+0000","last_undegraded":"2024-09-21T07:10:44.423522+0000","last_fullsized":"2024-09-21T07:10:44.423522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:58.082249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419825+0000","last_change":"2024-09-21T07:10:43.417909+0000","last_active":"2024-09-21T07:10:43.419825+0000","last_peered":"2024-09-21T07:10:43.419825+0000","last_clean":"2024-09-21T07:10:43.419825+0000","last_became_active":"2024-09-21T07:10:43.417587+0000","last_became_peered":"2024-09-21T07:10:43.417587+0000","last_unstale":"2024-09-21T07:10:43.419825+0000","last_undegraded":"2024-09-21T07:10:43.419825+0000","last_fullsized":"2024-09-21T07:10:43.419825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:32.119652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419387+0000","last_change":"2024-09-21T07:10:43.412277+0000","last_active":"2024-09-21T07:10:43.419387+0000","last_peered":"2024-09-21T07:10:43.419387+0000","last_clean":"2024-09-21T07:10:43.419387+0000","last_became_active":"2024-09-21T07:10:43.411507+0000","last_became_peered":"2024-09-21T07:10:43.411507+0000","last_unstale":"2024-09-21T07:10:43.419387+0000","last_undegraded":"2024-09-21T07:10:43.419387+0000","last_fullsized":"2024-09-21T07:10:43.419387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:02.068200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422843+0000","last_change":"2024-09-21T07:10:43.418752+0000","last_active":"2024-09-21T07:10:43.422843+0000","last_peered":"2024-09-21T07:10:43.422843+0000","last_clean":"2024-09-21T07:10:43.422843+0000","last_became_active":"2024-09-21T07:10:43.418424+0000","last_became_peered":"2024-09-21T07:10:43.418424+0000","last_unstale":"2024-09-21T07:10:43.422843+0000","last_undegraded":"2024-09-21T07:10:43.422843+0000","last_fullsized":"2024-09-21T07:10:43.422843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:55.912212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404284+0000","last_change":"2024-09-21T07:10:43.415461+0000","last_active":"2024-09-21T07:10:44.404284+0000","last_peered":"2024-09-21T07:10:44.404284+0000","last_clean":"2024-09-21T07:10:44.404284+0000","last_became_active":"2024-09-21T07:10:43.410697+0000","last_became_peered":"2024-09-21T07:10:43.410697+0000","last_unstale":"2024-09-21T07:10:44.404284+0000","last_undegraded":"2024-09-21T07:10:44.404284+0000","last_fullsized":"2024-09-21T07:10:44.404284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:14.665635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405475+0000","last_change":"2024-09-21T07:10:43.413220+0000","last_active":"2024-09-21T07:10:44.405475+0000","last_peered":"2024-09-21T07:10:44.405475+0000","last_clean":"2024-09-21T07:10:44.405475+0000","last_became_active":"2024-09-21T07:10:43.412892+0000","last_became_peered":"2024-09-21T07:10:43.412892+0000","last_unstale":"2024-09-21T07:10:44.405475+0000","last_undegraded":"2024-09-21T07:10:44.405475+0000","last_fullsized":"2024-09-21T07:10:44.405475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:55.242127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406808+0000","last_change":"2024-09-21T07:10:43.409834+0000","last_active":"2024-09-21T07:10:44.406808+0000","last_peered":"2024-09-21T07:10:44.406808+0000","last_clean":"2024-09-21T07:10:44.406808+0000","last_became_active":"2024-09-21T07:10:43.409533+0000","last_became_peered":"2024-09-21T07:10:43.409533+0000","last_unstale":"2024-09-21T07:10:44.406808+0000","last_undegraded":"2024-09-21T07:10:44.406808+0000","last_fullsized":"2024-09-21T07:10:44.406808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:26.185434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405326+0000","last_change":"2024-09-21T07:10:43.414453+0000","last_active":"2024-09-21T07:10:44.405326+0000","last_peered":"2024-09-21T07:10:44.405326+0000","last_clean":"2024-09-21T07:10:44.405326+0000","last_became_active":"2024-09-21T07:10:43.414138+0000","last_became_peered":"2024-09-21T07:10:43.414138+0000","last_unstale":"2024-09-21T07:10:44.405326+0000","last_undegraded":"2024-09-21T07:10:44.405326+0000","last_fullsized":"2024-09-21T07:10:44.405326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:26.960157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.416908+0000","last_change":"2024-09-21T07:10:43.408892+0000","last_active":"2024-09-21T07:10:43.416908+0000","last_peered":"2024-09-21T07:10:43.416908+0000","last_clean":"2024-09-21T07:10:43.416908+0000","last_became_active":"2024-09-21T07:10:43.408554+0000","last_became_peered":"2024-09-21T07:10:43.408554+0000","last_unstale":"2024-09-21T07:10:43.416908+0000","last_undegraded":"2024-09-21T07:10:43.416908+0000","last_fullsized":"2024-09-21T07:10:43.416908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:59.444256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423355+0000","last_change":"2024-09-21T07:10:43.418255+0000","last_active":"2024-09-21T07:10:44.423355+0000","last_peered":"2024-09-21T07:10:44.423355+0000","last_clean":"2024-09-21T07:10:44.423355+0000","last_became_active":"2024-09-21T07:10:43.417893+0000","last_became_peered":"2024-09-21T07:10:43.417893+0000","last_unstale":"2024-09-21T07:10:44.423355+0000","last_undegraded":"2024-09-21T07:10:44.423355+0000","last_fullsized":"2024-09-21T07:10:44.423355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:28.683802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423386+0000","last_change":"2024-09-21T07:10:43.414479+0000","last_active":"2024-09-21T07:10:43.423386+0000","last_peered":"2024-09-21T07:10:43.423386+0000","last_clean":"2024-09-21T07:10:43.423386+0000","last_became_active":"2024-09-21T07:10:43.414121+0000","last_became_peered":"2024-09-21T07:10:43.414121+0000","last_unstale":"2024-09-21T07:10:43.423386+0000","last_undegraded":"2024-09-21T07:10:43.423386+0000","last_fullsized":"2024-09-21T07:10:43.423386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:11.463765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405904+0000","last_change":"2024-09-21T07:10:43.409741+0000","last_active":"2024-09-21T07:10:44.405904+0000","last_peered":"2024-09-21T07:10:44.405904+0000","last_clean":"2024-09-21T07:10:44.405904+0000","last_became_active":"2024-09-21T07:10:43.408139+0000","last_became_peered":"2024-09-21T07:10:43.408139+0000","last_unstale":"2024-09-21T07:10:44.405904+0000","last_undegraded":"2024-09-21T07:10:44.405904+0000","last_fullsized":"2024-09-21T07:10:44.405904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:03.311605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422706+0000","last_change":"2024-09-21T07:10:43.416414+0000","last_active":"2024-09-21T07:10:43.422706+0000","last_peered":"2024-09-21T07:10:43.422706+0000","last_clean":"2024-09-21T07:10:43.422706+0000","last_became_active":"2024-09-21T07:10:43.415380+0000","last_became_peered":"2024-09-21T07:10:43.415380+0000","last_unstale":"2024-09-21T07:10:43.422706+0000","last_undegraded":"2024-09-21T07:10:43.422706+0000","last_fullsized":"2024-09-21T07:10:43.422706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:42.770919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405523+0000","last_change":"2024-09-21T07:10:43.407135+0000","last_active":"2024-09-21T07:10:44.405523+0000","last_peered":"2024-09-21T07:10:44.405523+0000","last_clean":"2024-09-21T07:10:44.405523+0000","last_became_active":"2024-09-21T07:10:43.406562+0000","last_became_peered":"2024-09-21T07:10:43.406562+0000","last_unstale":"2024-09-21T07:10:44.405523+0000","last_undegraded":"2024-09-21T07:10:44.405523+0000","last_fullsized":"2024-09-21T07:10:44.405523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:45.271471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422667+0000","last_change":"2024-09-21T07:10:43.415169+0000","last_active":"2024-09-21T07:10:43.422667+0000","last_peered":"2024-09-21T07:10:43.422667+0000","last_clean":"2024-09-21T07:10:43.422667+0000","last_became_active":"2024-09-21T07:10:43.414845+0000","last_became_peered":"2024-09-21T07:10:43.414845+0000","last_unstale":"2024-09-21T07:10:43.422667+0000","last_undegraded":"2024-09-21T07:10:43.422667+0000","last_fullsized":"2024-09-21T07:10:43.422667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:48.180670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423654+0000","last_change":"2024-09-21T07:10:43.410604+0000","last_active":"2024-09-21T07:10:44.423654+0000","last_peered":"2024-09-21T07:10:44.423654+0000","last_clean":"2024-09-21T07:10:44.423654+0000","last_became_active":"2024-09-21T07:10:43.410225+0000","last_became_peered":"2024-09-21T07:10:43.410225+0000","last_unstale":"2024-09-21T07:10:44.423654+0000","last_undegraded":"2024-09-21T07:10:44.423654+0000","last_fullsized":"2024-09-21T07:10:44.423654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:04.920178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404615+0000","last_change":"2024-09-21T07:10:43.425050+0000","last_active":"2024-09-21T07:10:44.404615+0000","last_peered":"2024-09-21T07:10:44.404615+0000","last_clean":"2024-09-21T07:10:44.404615+0000","last_became_active":"2024-09-21T07:10:43.424686+0000","last_became_peered":"2024-09-21T07:10:43.424686+0000","last_unstale":"2024-09-21T07:10:44.404615+0000","last_undegraded":"2024-09-21T07:10:44.404615+0000","last_fullsized":"2024-09-21T07:10:44.404615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:11.009112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.425732+0000","last_change":"2024-09-21T07:10:43.415955+0000","last_active":"2024-09-21T07:10:43.425732+0000","last_peered":"2024-09-21T07:10:43.425732+0000","last_clean":"2024-09-21T07:10:43.425732+0000","last_became_active":"2024-09-21T07:10:43.415633+0000","last_became_peered":"2024-09-21T07:10:43.415633+0000","last_unstale":"2024-09-21T07:10:43.425732+0000","last_undegraded":"2024-09-21T07:10:43.425732+0000","last_fullsized":"2024-09-21T07:10:43.425732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:53.391760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423437+0000","last_change":"2024-09-21T07:10:43.417820+0000","last_active":"2024-09-21T07:10:43.423437+0000","last_peered":"2024-09-21T07:10:43.423437+0000","last_clean":"2024-09-21T07:10:43.423437+0000","last_became_active":"2024-09-21T07:10:43.417482+0000","last_became_peered":"2024-09-21T07:10:43.417482+0000","last_unstale":"2024-09-21T07:10:43.423437+0000","last_undegraded":"2024-09-21T07:10:43.423437+0000","last_fullsized":"2024-09-21T07:10:43.423437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:32.997642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406171+0000","last_change":"2024-09-21T07:10:43.416076+0000","last_active":"2024-09-21T07:10:44.406171+0000","last_peered":"2024-09-21T07:10:44.406171+0000","last_clean":"2024-09-21T07:10:44.406171+0000","last_became_active":"2024-09-21T07:10:43.415727+0000","last_became_peered":"2024-09-21T07:10:43.415727+0000","last_unstale":"2024-09-21T07:10:44.406171+0000","last_undegraded":"2024-09-21T07:10:44.406171+0000","last_fullsized":"2024-09-21T07:10:44.406171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:30.034257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405184+0000","last_change":"2024-09-21T07:10:43.411355+0000","last_active":"2024-09-21T07:10:44.405184+0000","last_peered":"2024-09-21T07:10:44.405184+0000","last_clean":"2024-09-21T07:10:44.405184+0000","last_became_active":"2024-09-21T07:10:43.408638+0000","last_became_peered":"2024-09-21T07:10:43.408638+0000","last_unstale":"2024-09-21T07:10:44.405184+0000","last_undegraded":"2024-09-21T07:10:44.405184+0000","last_fullsized":"2024-09-21T07:10:44.405184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:34.237185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423340+0000","last_change":"2024-09-21T07:10:43.422509+0000","last_active":"2024-09-21T07:10:44.423340+0000","last_peered":"2024-09-21T07:10:44.423340+0000","last_clean":"2024-09-21T07:10:44.423340+0000","last_became_active":"2024-09-21T07:10:43.422122+0000","last_became_peered":"2024-09-21T07:10:43.422122+0000","last_unstale":"2024-09-21T07:10:44.423340+0000","last_undegraded":"2024-09-21T07:10:44.423340+0000","last_fullsized":"2024-09-21T07:10:44.423340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:38.675519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.416284+0000","last_change":"2024-09-21T07:10:43.411295+0000","last_active":"2024-09-21T07:10:43.416284+0000","last_peered":"2024-09-21T07:10:43.416284+0000","last_clean":"2024-09-21T07:10:43.416284+0000","last_became_active":"2024-09-21T07:10:43.410963+0000","last_became_peered":"2024-09-21T07:10:43.410963+0000","last_unstale":"2024-09-21T07:10:43.416284+0000","last_undegraded":"2024-09-21T07:10:43.416284+0000","last_fullsized":"2024-09-21T07:10:43.416284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:37.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.427477+0000","last_change":"2024-09-21T07:10:42.407850+0000","last_active":"2024-09-21T07:10:43.427477+0000","last_peered":"2024-09-21T07:10:43.427477+0000","last_clean":"2024-09-21T07:10:43.427477+0000","last_became_active":"2024-09-21T07:10:42.407497+0000","last_became_peered":"2024-09-21T07:10:42.407497+0000","last_unstale":"2024-09-21T07:10:43.427477+0000","last_undegraded":"2024-09-21T07:10:43.427477+0000","last_fullsized":"2024-09-21T07:10:43.427477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:34.583545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.402886+0000","last_change":"2024-09-21T07:10:43.398164+0000","last_active":"2024-09-21T07:10:43.402886+0000","last_peered":"2024-09-21T07:10:43.402886+0000","last_clean":"2024-09-21T07:10:43.402886+0000","last_became_active":"2024-09-21T07:10:43.397191+0000","last_became_peered":"2024-09-21T07:10:43.397191+0000","last_unstale":"2024-09-21T07:10:43.402886+0000","last_undegraded":"2024-09-21T07:10:43.402886+0000","last_fullsized":"2024-09-21T07:10:43.402886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:09.942947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423132+0000","last_change":"2024-09-21T07:10:42.403613+0000","last_active":"2024-09-21T07:10:44.423132+0000","last_peered":"2024-09-21T07:10:44.423132+0000","last_clean":"2024-09-21T07:10:44.423132+0000","last_became_active":"2024-09-21T07:10:42.402543+0000","last_became_peered":"2024-09-21T07:10:42.402543+0000","last_unstale":"2024-09-21T07:10:44.423132+0000","last_undegraded":"2024-09-21T07:10:44.423132+0000","last_fullsized":"2024-09-21T07:10:44.423132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:15.945210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.400692+0000","last_change":"2024-09-21T07:10:42.405878+0000","last_active":"2024-09-21T07:10:43.400692+0000","last_peered":"2024-09-21T07:10:43.400692+0000","last_clean":"2024-09-21T07:10:43.400692+0000","last_became_active":"2024-09-21T07:10:42.404760+0000","last_became_peered":"2024-09-21T07:10:42.404760+0000","last_unstale":"2024-09-21T07:10:43.400692+0000","last_undegraded":"2024-09-21T07:10:43.400692+0000","last_fullsized":"2024-09-21T07:10:43.400692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:24.910811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.427097+0000","last_change":"2024-09-21T07:10:43.421622+0000","last_active":"2024-09-21T07:10:43.427097+0000","last_peered":"2024-09-21T07:10:43.427097+0000","last_clean":"2024-09-21T07:10:43.427097+0000","last_became_active":"2024-09-21T07:10:43.421299+0000","last_became_peered":"2024-09-21T07:10:43.421299+0000","last_unstale":"2024-09-21T07:10:43.427097+0000","last_undegraded":"2024-09-21T07:10:43.427097+0000","last_fullsized":"2024-09-21T07:10:43.427097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:59.444256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405639+0000","last_change":"2024-09-21T07:10:42.401842+0000","last_active":"2024-09-21T07:10:44.405639+0000","last_peered":"2024-09-21T07:10:44.405639+0000","last_clean":"2024-09-21T07:10:44.405639+0000","last_became_active":"2024-09-21T07:10:42.401304+0000","last_became_peered":"2024-09-21T07:10:42.401304+0000","last_unstale":"2024-09-21T07:10:44.405639+0000","last_undegraded":"2024-09-21T07:10:44.405639+0000","last_fullsized":"2024-09-21T07:10:44.405639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:31.113600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404237+0000","last_change":"2024-09-21T07:10:43.424849+0000","last_active":"2024-09-21T07:10:44.404237+0000","last_peered":"2024-09-21T07:10:44.404237+0000","last_clean":"2024-09-21T07:10:44.404237+0000","last_became_active":"2024-09-21T07:10:43.424491+0000","last_became_peered":"2024-09-21T07:10:43.424491+0000","last_unstale":"2024-09-21T07:10:44.404237+0000","last_undegraded":"2024-09-21T07:10:44.404237+0000","last_fullsized":"2024-09-21T07:10:44.404237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:15.151519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423579+0000","last_change":"2024-09-21T07:10:42.404454+0000","last_active":"2024-09-21T07:10:44.423579+0000","last_peered":"2024-09-21T07:10:44.423579+0000","last_clean":"2024-09-21T07:10:44.423579+0000","last_became_active":"2024-09-21T07:10:42.404062+0000","last_became_peered":"2024-09-21T07:10:42.404062+0000","last_unstale":"2024-09-21T07:10:44.423579+0000","last_undegraded":"2024-09-21T07:10:44.423579+0000","last_fullsized":"2024-09-21T07:10:44.423579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:33.377412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406705+0000","last_change":"2024-09-21T07:10:43.409200+0000","last_active":"2024-09-21T07:10:44.406705+0000","last_peered":"2024-09-21T07:10:44.406705+0000","last_clean":"2024-09-21T07:10:44.406705+0000","last_became_active":"2024-09-21T07:10:43.408864+0000","last_became_peered":"2024-09-21T07:10:43.408864+0000","last_unstale":"2024-09-21T07:10:44.406705+0000","last_undegraded":"2024-09-21T07:10:44.406705+0000","last_fullsized":"2024-09-21T07:10:44.406705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:39.695264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406436+0000","last_change":"2024-09-21T07:10:42.406774+0000","last_active":"2024-09-21T07:10:44.406436+0000","last_peered":"2024-09-21T07:10:44.406436+0000","last_clean":"2024-09-21T07:10:44.406436+0000","last_became_active":"2024-09-21T07:10:42.404461+0000","last_became_peered":"2024-09-21T07:10:42.404461+0000","last_unstale":"2024-09-21T07:10:44.406436+0000","last_undegraded":"2024-09-21T07:10:44.406436+0000","last_fullsized":"2024-09-21T07:10:44.406436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:38.533867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.420700+0000","last_change":"2024-09-21T07:10:43.408995+0000","last_active":"2024-09-21T07:10:43.420700+0000","last_peered":"2024-09-21T07:10:43.420700+0000","last_clean":"2024-09-21T07:10:43.420700+0000","last_became_active":"2024-09-21T07:10:43.408670+0000","last_became_peered":"2024-09-21T07:10:43.408670+0000","last_unstale":"2024-09-21T07:10:43.420700+0000","last_undegraded":"2024-09-21T07:10:43.420700+0000","last_fullsized":"2024-09-21T07:10:43.420700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:39.823395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404702+0000","last_change":"2024-09-21T07:10:42.412327+0000","last_active":"2024-09-21T07:10:44.404702+0000","last_peered":"2024-09-21T07:10:44.404702+0000","last_clean":"2024-09-21T07:10:44.404702+0000","last_became_active":"2024-09-21T07:10:42.411992+0000","last_became_peered":"2024-09-21T07:10:42.411992+0000","last_unstale":"2024-09-21T07:10:44.404702+0000","last_undegraded":"2024-09-21T07:10:44.404702+0000","last_fullsized":"2024-09-21T07:10:44.404702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:12.534169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419789+0000","last_change":"2024-09-21T07:10:43.408223+0000","last_active":"2024-09-21T07:10:43.419789+0000","last_peered":"2024-09-21T07:10:43.419789+0000","last_clean":"2024-09-21T07:10:43.419789+0000","last_became_active":"2024-09-21T07:10:43.407894+0000","last_became_peered":"2024-09-21T07:10:43.407894+0000","last_unstale":"2024-09-21T07:10:43.419789+0000","last_undegraded":"2024-09-21T07:10:43.419789+0000","last_fullsized":"2024-09-21T07:10:43.419789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:52.310406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423435+0000","last_change":"2024-09-21T07:10:42.399128+0000","last_active":"2024-09-21T07:10:44.423435+0000","last_peered":"2024-09-21T07:10:44.423435+0000","last_clean":"2024-09-21T07:10:44.423435+0000","last_became_active":"2024-09-21T07:10:42.398772+0000","last_became_peered":"2024-09-21T07:10:42.398772+0000","last_unstale":"2024-09-21T07:10:44.423435+0000","last_undegraded":"2024-09-21T07:10:44.423435+0000","last_fullsized":"2024-09-21T07:10:44.423435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:01.062149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.421215+0000","last_change":"2024-09-21T07:10:43.415524+0000","last_active":"2024-09-21T07:10:43.421215+0000","last_peered":"2024-09-21T07:10:43.421215+0000","last_clean":"2024-09-21T07:10:43.421215+0000","last_became_active":"2024-09-21T07:10:43.415196+0000","last_became_peered":"2024-09-21T07:10:43.415196+0000","last_unstale":"2024-09-21T07:10:43.421215+0000","last_undegraded":"2024-09-21T07:10:43.421215+0000","last_fullsized":"2024-09-21T07:10:43.421215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:25.088487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422070+0000","last_change":"2024-09-21T07:10:42.402240+0000","last_active":"2024-09-21T07:10:43.422070+0000","last_peered":"2024-09-21T07:10:43.422070+0000","last_clean":"2024-09-21T07:10:43.422070+0000","last_became_active":"2024-09-21T07:10:42.401874+0000","last_became_peered":"2024-09-21T07:10:42.401874+0000","last_unstale":"2024-09-21T07:10:43.422070+0000","last_undegraded":"2024-09-21T07:10:43.422070+0000","last_fullsized":"2024-09-21T07:10:43.422070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:57.539687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.421567+0000","last_change":"2024-09-21T07:10:43.411598+0000","last_active":"2024-09-21T07:10:43.421567+0000","last_peered":"2024-09-21T07:10:43.421567+0000","last_clean":"2024-09-21T07:10:43.421567+0000","last_became_active":"2024-09-21T07:10:43.411274+0000","last_became_peered":"2024-09-21T07:10:43.411274+0000","last_unstale":"2024-09-21T07:10:43.421567+0000","last_undegraded":"2024-09-21T07:10:43.421567+0000","last_fullsized":"2024-09-21T07:10:43.421567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:13.540221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406106+0000","last_change":"2024-09-21T07:10:42.401021+0000","last_active":"2024-09-21T07:10:44.406106+0000","last_peered":"2024-09-21T07:10:44.406106+0000","last_clean":"2024-09-21T07:10:44.406106+0000","last_became_active":"2024-09-21T07:10:42.400700+0000","last_became_peered":"2024-09-21T07:10:42.400700+0000","last_unstale":"2024-09-21T07:10:44.406106+0000","last_undegraded":"2024-09-21T07:10:44.406106+0000","last_fullsized":"2024-09-21T07:10:44.406106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:05.347695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.421014+0000","last_change":"2024-09-21T07:10:43.410354+0000","last_active":"2024-09-21T07:10:43.421014+0000","last_peered":"2024-09-21T07:10:43.421014+0000","last_clean":"2024-09-21T07:10:43.421014+0000","last_became_active":"2024-09-21T07:10:43.409526+0000","last_became_peered":"2024-09-21T07:10:43.409526+0000","last_unstale":"2024-09-21T07:10:43.421014+0000","last_undegraded":"2024-09-21T07:10:43.421014+0000","last_fullsized":"2024-09-21T07:10:43.421014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:39.734827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423098+0000","last_change":"2024-09-21T07:10:42.402010+0000","last_active":"2024-09-21T07:10:44.423098+0000","last_peered":"2024-09-21T07:10:44.423098+0000","last_clean":"2024-09-21T07:10:44.423098+0000","last_became_active":"2024-09-21T07:10:42.401682+0000","last_became_peered":"2024-09-21T07:10:42.401682+0000","last_unstale":"2024-09-21T07:10:44.423098+0000","last_undegraded":"2024-09-21T07:10:44.423098+0000","last_fullsized":"2024-09-21T07:10:44.423098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:15.662211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423495+0000","last_change":"2024-09-21T07:10:43.412631+0000","last_active":"2024-09-21T07:10:44.423495+0000","last_peered":"2024-09-21T07:10:44.423495+0000","last_clean":"2024-09-21T07:10:44.423495+0000","last_became_active":"2024-09-21T07:10:43.412250+0000","last_became_peered":"2024-09-21T07:10:43.412250+0000","last_unstale":"2024-09-21T07:10:44.423495+0000","last_undegraded":"2024-09-21T07:10:44.423495+0000","last_fullsized":"2024-09-21T07:10:44.423495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:40.609307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405073+0000","last_change":"2024-09-21T07:10:42.405955+0000","last_active":"2024-09-21T07:10:44.405073+0000","last_peered":"2024-09-21T07:10:44.405073+0000","last_clean":"2024-09-21T07:10:44.405073+0000","last_became_active":"2024-09-21T07:10:42.405499+0000","last_became_peered":"2024-09-21T07:10:42.405499+0000","last_unstale":"2024-09-21T07:10:44.405073+0000","last_undegraded":"2024-09-21T07:10:44.405073+0000","last_fullsized":"2024-09-21T07:10:44.405073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:11.896704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.415898+0000","last_change":"2024-09-21T07:10:43.408372+0000","last_active":"2024-09-21T07:10:43.415898+0000","last_peered":"2024-09-21T07:10:43.415898+0000","last_clean":"2024-09-21T07:10:43.415898+0000","last_became_active":"2024-09-21T07:10:43.407452+0000","last_became_peered":"2024-09-21T07:10:43.407452+0000","last_unstale":"2024-09-21T07:10:43.415898+0000","last_undegraded":"2024-09-21T07:10:43.415898+0000","last_fullsized":"2024-09-21T07:10:43.415898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:42.770919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.424660+0000","last_change":"2024-09-21T07:10:42.406082+0000","last_active":"2024-09-21T07:10:43.424660+0000","last_peered":"2024-09-21T07:10:43.424660+0000","last_clean":"2024-09-21T07:10:43.424660+0000","last_became_active":"2024-09-21T07:10:42.405726+0000","last_became_peered":"2024-09-21T07:10:42.405726+0000","last_unstale":"2024-09-21T07:10:43.424660+0000","last_undegraded":"2024-09-21T07:10:43.424660+0000","last_fullsized":"2024-09-21T07:10:43.424660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:21.349501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.421258+0000","last_change":"2024-09-21T07:10:43.412104+0000","last_active":"2024-09-21T07:10:43.421258+0000","last_peered":"2024-09-21T07:10:43.421258+0000","last_clean":"2024-09-21T07:10:43.421258+0000","last_became_active":"2024-09-21T07:10:43.411622+0000","last_became_peered":"2024-09-21T07:10:43.411622+0000","last_unstale":"2024-09-21T07:10:43.421258+0000","last_undegraded":"2024-09-21T07:10:43.421258+0000","last_fullsized":"2024-09-21T07:10:43.421258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:48.605884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405248+0000","last_change":"2024-09-21T07:10:42.391724+0000","last_active":"2024-09-21T07:10:44.405248+0000","last_peered":"2024-09-21T07:10:44.405248+0000","last_clean":"2024-09-21T07:10:44.405248+0000","last_became_active":"2024-09-21T07:10:42.391190+0000","last_became_peered":"2024-09-21T07:10:42.391190+0000","last_unstale":"2024-09-21T07:10:44.405248+0000","last_undegraded":"2024-09-21T07:10:44.405248+0000","last_fullsized":"2024-09-21T07:10:44.405248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:04.908220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.421690+0000","last_change":"2024-09-21T07:10:43.420199+0000","last_active":"2024-09-21T07:10:43.421690+0000","last_peered":"2024-09-21T07:10:43.421690+0000","last_clean":"2024-09-21T07:10:43.421690+0000","last_became_active":"2024-09-21T07:10:43.418363+0000","last_became_peered":"2024-09-21T07:10:43.418363+0000","last_unstale":"2024-09-21T07:10:43.421690+0000","last_undegraded":"2024-09-21T07:10:43.421690+0000","last_fullsized":"2024-09-21T07:10:43.421690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:55.242127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404730+0000","last_change":"2024-09-21T07:10:42.410464+0000","last_active":"2024-09-21T07:10:44.404730+0000","last_peered":"2024-09-21T07:10:44.404730+0000","last_clean":"2024-09-21T07:10:44.404730+0000","last_became_active":"2024-09-21T07:10:42.410107+0000","last_became_peered":"2024-09-21T07:10:42.410107+0000","last_unstale":"2024-09-21T07:10:44.404730+0000","last_undegraded":"2024-09-21T07:10:44.404730+0000","last_fullsized":"2024-09-21T07:10:44.404730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:31.991591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406480+0000","last_change":"2024-09-21T07:10:43.418911+0000","last_active":"2024-09-21T07:10:44.406480+0000","last_peered":"2024-09-21T07:10:44.406480+0000","last_clean":"2024-09-21T07:10:44.406480+0000","last_became_active":"2024-09-21T07:10:43.418563+0000","last_became_peered":"2024-09-21T07:10:43.418563+0000","last_unstale":"2024-09-21T07:10:44.406480+0000","last_undegraded":"2024-09-21T07:10:44.406480+0000","last_fullsized":"2024-09-21T07:10:44.406480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:18.068383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405257+0000","last_change":"2024-09-21T07:10:42.402258+0000","last_active":"2024-09-21T07:10:44.405257+0000","last_peered":"2024-09-21T07:10:44.405257+0000","last_clean":"2024-09-21T07:10:44.405257+0000","last_became_active":"2024-09-21T07:10:42.401789+0000","last_became_peered":"2024-09-21T07:10:42.401789+0000","last_unstale":"2024-09-21T07:10:44.405257+0000","last_undegraded":"2024-09-21T07:10:44.405257+0000","last_fullsized":"2024-09-21T07:10:44.405257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:21.657184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.421184+0000","last_change":"2024-09-21T07:10:43.415279+0000","last_active":"2024-09-21T07:10:43.421184+0000","last_peered":"2024-09-21T07:10:43.421184+0000","last_clean":"2024-09-21T07:10:43.421184+0000","last_became_active":"2024-09-21T07:10:43.414955+0000","last_became_peered":"2024-09-21T07:10:43.414955+0000","last_unstale":"2024-09-21T07:10:43.421184+0000","last_undegraded":"2024-09-21T07:10:43.421184+0000","last_fullsized":"2024-09-21T07:10:43.421184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:23.794008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":109,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.400344+0000","last_change":"2024-09-21T07:10:32.034091+0000","last_active":"2024-09-21T07:10:43.400344+0000","last_peered":"2024-09-21T07:10:43.400344+0000","last_clean":"2024-09-21T07:10:43.400344+0000","last_became_active":"2024-09-21T07:10:32.033005+0000","last_became_peered":"2024-09-21T07:10:32.033005+0000","last_unstale":"2024-09-21T07:10:43.400344+0000","last_undegraded":"2024-09-21T07:10:43.400344+0000","last_fullsized":"2024-09-21T07:10:43.400344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_clean_scrub_stamp":"2024-09-21T07:10:31.011167+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:10.064019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406044+0000","last_change":"2024-09-21T07:10:42.402630+0000","last_active":"2024-09-21T07:10:44.406044+0000","last_peered":"2024-09-21T07:10:44.406044+0000","last_clean":"2024-09-21T07:10:44.406044+0000","last_became_active":"2024-09-21T07:10:42.402315+0000","last_became_peered":"2024-09-21T07:10:42.402315+0000","last_unstale":"2024-09-21T07:10:44.406044+0000","last_undegraded":"2024-09-21T07:10:44.406044+0000","last_fullsized":"2024-09-21T07:10:44.406044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:33.518055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422484+0000","last_change":"2024-09-21T07:10:43.414223+0000","last_active":"2024-09-21T07:10:43.422484+0000","last_peered":"2024-09-21T07:10:43.422484+0000","last_clean":"2024-09-21T07:10:43.422484+0000","last_became_active":"2024-09-21T07:10:43.413923+0000","last_became_peered":"2024-09-21T07:10:43.413923+0000","last_unstale":"2024-09-21T07:10:43.422484+0000","last_undegraded":"2024-09-21T07:10:43.422484+0000","last_fullsized":"2024-09-21T07:10:43.422484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:47.584490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.400263+0000","last_change":"2024-09-21T07:10:42.411409+0000","last_active":"2024-09-21T07:10:43.400263+0000","last_peered":"2024-09-21T07:10:43.400263+0000","last_clean":"2024-09-21T07:10:43.400263+0000","last_became_active":"2024-09-21T07:10:42.411018+0000","last_became_peered":"2024-09-21T07:10:42.411018+0000","last_unstale":"2024-09-21T07:10:43.400263+0000","last_undegraded":"2024-09-21T07:10:43.400263+0000","last_fullsized":"2024-09-21T07:10:43.400263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:47.174619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.400889+0000","last_change":"2024-09-21T07:10:43.396425+0000","last_active":"2024-09-21T07:10:43.400889+0000","last_peered":"2024-09-21T07:10:43.400889+0000","last_clean":"2024-09-21T07:10:43.400889+0000","last_became_active":"2024-09-21T07:10:43.396080+0000","last_became_peered":"2024-09-21T07:10:43.396080+0000","last_unstale":"2024-09-21T07:10:43.400889+0000","last_undegraded":"2024-09-21T07:10:43.400889+0000","last_fullsized":"2024-09-21T07:10:43.400889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:28.816031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405149+0000","last_change":"2024-09-21T07:10:42.391433+0000","last_active":"2024-09-21T07:10:44.405149+0000","last_peered":"2024-09-21T07:10:44.405149+0000","last_clean":"2024-09-21T07:10:44.405149+0000","last_became_active":"2024-09-21T07:10:42.391123+0000","last_became_peered":"2024-09-21T07:10:42.391123+0000","last_unstale":"2024-09-21T07:10:44.405149+0000","last_undegraded":"2024-09-21T07:10:44.405149+0000","last_fullsized":"2024-09-21T07:10:44.405149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:25.948155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404277+0000","last_change":"2024-09-21T07:10:43.419811+0000","last_active":"2024-09-21T07:10:44.404277+0000","last_peered":"2024-09-21T07:10:44.404277+0000","last_clean":"2024-09-21T07:10:44.404277+0000","last_became_active":"2024-09-21T07:10:43.419490+0000","last_became_peered":"2024-09-21T07:10:43.419490+0000","last_unstale":"2024-09-21T07:10:44.404277+0000","last_undegraded":"2024-09-21T07:10:44.404277+0000","last_fullsized":"2024-09-21T07:10:44.404277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:08.183794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406254+0000","last_change":"2024-09-21T07:10:42.407863+0000","last_active":"2024-09-21T07:10:44.406254+0000","last_peered":"2024-09-21T07:10:44.406254+0000","last_clean":"2024-09-21T07:10:44.406254+0000","last_became_active":"2024-09-21T07:10:42.407458+0000","last_became_peered":"2024-09-21T07:10:42.407458+0000","last_unstale":"2024-09-21T07:10:44.406254+0000","last_undegraded":"2024-09-21T07:10:44.406254+0000","last_fullsized":"2024-09-21T07:10:44.406254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:49.720067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.409034+0000","last_change":"2024-09-21T07:10:43.404989+0000","last_active":"2024-09-21T07:10:43.409034+0000","last_peered":"2024-09-21T07:10:43.409034+0000","last_clean":"2024-09-21T07:10:43.409034+0000","last_became_active":"2024-09-21T07:10:43.404366+0000","last_became_peered":"2024-09-21T07:10:43.404366+0000","last_unstale":"2024-09-21T07:10:43.409034+0000","last_undegraded":"2024-09-21T07:10:43.409034+0000","last_fullsized":"2024-09-21T07:10:43.409034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:52.091578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404434+0000","last_change":"2024-09-21T07:10:42.407164+0000","last_active":"2024-09-21T07:10:44.404434+0000","last_peered":"2024-09-21T07:10:44.404434+0000","last_clean":"2024-09-21T07:10:44.404434+0000","last_became_active":"2024-09-21T07:10:42.406833+0000","last_became_peered":"2024-09-21T07:10:42.406833+0000","last_unstale":"2024-09-21T07:10:44.404434+0000","last_undegraded":"2024-09-21T07:10:44.404434+0000","last_fullsized":"2024-09-21T07:10:44.404434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:50.661135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406462+0000","last_change":"2024-09-21T07:10:43.415076+0000","last_active":"2024-09-21T07:10:44.406462+0000","last_peered":"2024-09-21T07:10:44.406462+0000","last_clean":"2024-09-21T07:10:44.406462+0000","last_became_active":"2024-09-21T07:10:43.414738+0000","last_became_peered":"2024-09-21T07:10:43.414738+0000","last_unstale":"2024-09-21T07:10:44.406462+0000","last_undegraded":"2024-09-21T07:10:44.406462+0000","last_fullsized":"2024-09-21T07:10:44.406462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:37.114753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.399371+0000","last_change":"2024-09-21T07:10:42.411427+0000","last_active":"2024-09-21T07:10:43.399371+0000","last_peered":"2024-09-21T07:10:43.399371+0000","last_clean":"2024-09-21T07:10:43.399371+0000","last_became_active":"2024-09-21T07:10:42.411048+0000","last_became_peered":"2024-09-21T07:10:42.411048+0000","last_unstale":"2024-09-21T07:10:43.399371+0000","last_undegraded":"2024-09-21T07:10:43.399371+0000","last_fullsized":"2024-09-21T07:10:43.399371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:55.046653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404296+0000","last_change":"2024-09-21T07:10:43.416948+0000","last_active":"2024-09-21T07:10:44.404296+0000","last_peered":"2024-09-21T07:10:44.404296+0000","last_clean":"2024-09-21T07:10:44.404296+0000","last_became_active":"2024-09-21T07:10:43.416515+0000","last_became_peered":"2024-09-21T07:10:43.416515+0000","last_unstale":"2024-09-21T07:10:44.404296+0000","last_undegraded":"2024-09-21T07:10:44.404296+0000","last_fullsized":"2024-09-21T07:10:44.404296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:23.952801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404606+0000","last_change":"2024-09-21T07:10:42.408894+0000","last_active":"2024-09-21T07:10:44.404606+0000","last_peered":"2024-09-21T07:10:44.404606+0000","last_clean":"2024-09-21T07:10:44.404606+0000","last_became_active":"2024-09-21T07:10:42.408392+0000","last_became_peered":"2024-09-21T07:10:42.408392+0000","last_unstale":"2024-09-21T07:10:44.404606+0000","last_undegraded":"2024-09-21T07:10:44.404606+0000","last_fullsized":"2024-09-21T07:10:44.404606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:22.386244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.422637+0000","last_change":"2024-09-21T07:10:43.413469+0000","last_active":"2024-09-21T07:10:43.422637+0000","last_peered":"2024-09-21T07:10:43.422637+0000","last_clean":"2024-09-21T07:10:43.422637+0000","last_became_active":"2024-09-21T07:10:43.413144+0000","last_became_peered":"2024-09-21T07:10:43.413144+0000","last_unstale":"2024-09-21T07:10:43.422637+0000","last_undegraded":"2024-09-21T07:10:43.422637+0000","last_fullsized":"2024-09-21T07:10:43.422637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:26.991092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423623+0000","last_change":"2024-09-21T07:10:42.408673+0000","last_active":"2024-09-21T07:10:44.423623+0000","last_peered":"2024-09-21T07:10:44.423623+0000","last_clean":"2024-09-21T07:10:44.423623+0000","last_became_active":"2024-09-21T07:10:42.408275+0000","last_became_peered":"2024-09-21T07:10:42.408275+0000","last_unstale":"2024-09-21T07:10:44.423623+0000","last_undegraded":"2024-09-21T07:10:44.423623+0000","last_fullsized":"2024-09-21T07:10:44.423623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:53.210856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423115+0000","last_change":"2024-09-21T07:10:43.419670+0000","last_active":"2024-09-21T07:10:43.423115+0000","last_peered":"2024-09-21T07:10:43.423115+0000","last_clean":"2024-09-21T07:10:43.423115+0000","last_became_active":"2024-09-21T07:10:43.419363+0000","last_became_peered":"2024-09-21T07:10:43.419363+0000","last_unstale":"2024-09-21T07:10:43.423115+0000","last_undegraded":"2024-09-21T07:10:43.423115+0000","last_fullsized":"2024-09-21T07:10:43.423115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:16.496407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.400007+0000","last_change":"2024-09-21T07:10:42.412541+0000","last_active":"2024-09-21T07:10:43.400007+0000","last_peered":"2024-09-21T07:10:43.400007+0000","last_clean":"2024-09-21T07:10:43.400007+0000","last_became_active":"2024-09-21T07:10:42.412026+0000","last_became_peered":"2024-09-21T07:10:42.412026+0000","last_unstale":"2024-09-21T07:10:43.400007+0000","last_undegraded":"2024-09-21T07:10:43.400007+0000","last_fullsized":"2024-09-21T07:10:43.400007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:46.578438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.418153+0000","last_change":"2024-09-21T07:10:43.414157+0000","last_active":"2024-09-21T07:10:43.418153+0000","last_peered":"2024-09-21T07:10:43.418153+0000","last_clean":"2024-09-21T07:10:43.418153+0000","last_became_active":"2024-09-21T07:10:43.413820+0000","last_became_peered":"2024-09-21T07:10:43.413820+0000","last_unstale":"2024-09-21T07:10:43.418153+0000","last_undegraded":"2024-09-21T07:10:43.418153+0000","last_fullsized":"2024-09-21T07:10:43.418153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:34.524106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404360+0000","last_change":"2024-09-21T07:10:42.412473+0000","last_active":"2024-09-21T07:10:44.404360+0000","last_peered":"2024-09-21T07:10:44.404360+0000","last_clean":"2024-09-21T07:10:44.404360+0000","last_became_active":"2024-09-21T07:10:42.412072+0000","last_became_peered":"2024-09-21T07:10:42.412072+0000","last_unstale":"2024-09-21T07:10:44.404360+0000","last_undegraded":"2024-09-21T07:10:44.404360+0000","last_fullsized":"2024-09-21T07:10:44.404360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:38.817344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.423320+0000","last_change":"2024-09-21T07:10:43.413781+0000","last_active":"2024-09-21T07:10:43.423320+0000","last_peered":"2024-09-21T07:10:43.423320+0000","last_clean":"2024-09-21T07:10:43.423320+0000","last_became_active":"2024-09-21T07:10:43.413312+0000","last_became_peered":"2024-09-21T07:10:43.413312+0000","last_unstale":"2024-09-21T07:10:43.423320+0000","last_undegraded":"2024-09-21T07:10:43.423320+0000","last_fullsized":"2024-09-21T07:10:43.423320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:56.052704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404554+0000","last_change":"2024-09-21T07:10:42.409241+0000","last_active":"2024-09-21T07:10:44.404554+0000","last_peered":"2024-09-21T07:10:44.404554+0000","last_clean":"2024-09-21T07:10:44.404554+0000","last_became_active":"2024-09-21T07:10:42.408948+0000","last_became_peered":"2024-09-21T07:10:42.408948+0000","last_unstale":"2024-09-21T07:10:44.404554+0000","last_undegraded":"2024-09-21T07:10:44.404554+0000","last_fullsized":"2024-09-21T07:10:44.404554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:10.457714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419343+0000","last_change":"2024-09-21T07:10:43.410463+0000","last_active":"2024-09-21T07:10:43.419343+0000","last_peered":"2024-09-21T07:10:43.419343+0000","last_clean":"2024-09-21T07:10:43.419343+0000","last_became_active":"2024-09-21T07:10:43.410089+0000","last_became_peered":"2024-09-21T07:10:43.410089+0000","last_unstale":"2024-09-21T07:10:43.419343+0000","last_undegraded":"2024-09-21T07:10:43.419343+0000","last_fullsized":"2024-09-21T07:10:43.419343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:16.668262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.416809+0000","last_change":"2024-09-21T07:10:42.408618+0000","last_active":"2024-09-21T07:10:43.416809+0000","last_peered":"2024-09-21T07:10:43.416809+0000","last_clean":"2024-09-21T07:10:43.416809+0000","last_became_active":"2024-09-21T07:10:42.408144+0000","last_became_peered":"2024-09-21T07:10:42.408144+0000","last_unstale":"2024-09-21T07:10:43.416809+0000","last_undegraded":"2024-09-21T07:10:43.416809+0000","last_fullsized":"2024-09-21T07:10:43.416809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:25.985040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423370+0000","last_change":"2024-09-21T07:10:43.404982+0000","last_active":"2024-09-21T07:10:44.423370+0000","last_peered":"2024-09-21T07:10:44.423370+0000","last_clean":"2024-09-21T07:10:44.423370+0000","last_became_active":"2024-09-21T07:10:43.404649+0000","last_became_peered":"2024-09-21T07:10:43.404649+0000","last_unstale":"2024-09-21T07:10:44.423370+0000","last_undegraded":"2024-09-21T07:10:44.423370+0000","last_fullsized":"2024-09-21T07:10:44.423370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:32.944402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406445+0000","last_change":"2024-09-21T07:10:43.410758+0000","last_active":"2024-09-21T07:10:44.406445+0000","last_peered":"2024-09-21T07:10:44.406445+0000","last_clean":"2024-09-21T07:10:44.406445+0000","last_became_active":"2024-09-21T07:10:43.410445+0000","last_became_peered":"2024-09-21T07:10:43.410445+0000","last_unstale":"2024-09-21T07:10:44.406445+0000","last_undegraded":"2024-09-21T07:10:44.406445+0000","last_fullsized":"2024-09-21T07:10:44.406445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:26.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.418018+0000","last_change":"2024-09-21T07:10:42.410865+0000","last_active":"2024-09-21T07:10:43.418018+0000","last_peered":"2024-09-21T07:10:43.418018+0000","last_clean":"2024-09-21T07:10:43.418018+0000","last_became_active":"2024-09-21T07:10:42.410458+0000","last_became_peered":"2024-09-21T07:10:42.410458+0000","last_unstale":"2024-09-21T07:10:43.418018+0000","last_undegraded":"2024-09-21T07:10:43.418018+0000","last_fullsized":"2024-09-21T07:10:43.418018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:15.945210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405825+0000","last_change":"2024-09-21T07:10:43.406733+0000","last_active":"2024-09-21T07:10:44.405825+0000","last_peered":"2024-09-21T07:10:44.405825+0000","last_clean":"2024-09-21T07:10:44.405825+0000","last_became_active":"2024-09-21T07:10:43.406364+0000","last_became_peered":"2024-09-21T07:10:43.406364+0000","last_unstale":"2024-09-21T07:10:44.405825+0000","last_undegraded":"2024-09-21T07:10:44.405825+0000","last_fullsized":"2024-09-21T07:10:44.405825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:03.491744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.414895+0000","last_change":"2024-09-21T07:10:42.409936+0000","last_active":"2024-09-21T07:10:43.414895+0000","last_peered":"2024-09-21T07:10:43.414895+0000","last_clean":"2024-09-21T07:10:43.414895+0000","last_became_active":"2024-09-21T07:10:42.409492+0000","last_became_peered":"2024-09-21T07:10:42.409492+0000","last_unstale":"2024-09-21T07:10:43.414895+0000","last_undegraded":"2024-09-21T07:10:43.414895+0000","last_fullsized":"2024-09-21T07:10:43.414895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:01.062149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.420400+0000","last_change":"2024-09-21T07:10:43.408059+0000","last_active":"2024-09-21T07:10:43.420400+0000","last_peered":"2024-09-21T07:10:43.420400+0000","last_clean":"2024-09-21T07:10:43.420400+0000","last_became_active":"2024-09-21T07:10:43.407707+0000","last_became_peered":"2024-09-21T07:10:43.407707+0000","last_unstale":"2024-09-21T07:10:43.420400+0000","last_undegraded":"2024-09-21T07:10:43.420400+0000","last_fullsized":"2024-09-21T07:10:43.420400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:23.392296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.427614+0000","last_change":"2024-09-21T07:10:42.403998+0000","last_active":"2024-09-21T07:10:43.427614+0000","last_peered":"2024-09-21T07:10:43.427614+0000","last_clean":"2024-09-21T07:10:43.427614+0000","last_became_active":"2024-09-21T07:10:42.403552+0000","last_became_peered":"2024-09-21T07:10:42.403552+0000","last_unstale":"2024-09-21T07:10:43.427614+0000","last_undegraded":"2024-09-21T07:10:43.427614+0000","last_fullsized":"2024-09-21T07:10:43.427614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:33.377412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.419407+0000","last_change":"2024-09-21T07:10:43.411885+0000","last_active":"2024-09-21T07:10:43.419407+0000","last_peered":"2024-09-21T07:10:43.419407+0000","last_clean":"2024-09-21T07:10:43.419407+0000","last_became_active":"2024-09-21T07:10:43.410907+0000","last_became_peered":"2024-09-21T07:10:43.410907+0000","last_unstale":"2024-09-21T07:10:43.419407+0000","last_undegraded":"2024-09-21T07:10:43.419407+0000","last_fullsized":"2024-09-21T07:10:43.419407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:54.216907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T07:10:43.424450+0000","last_change":"2024-09-21T07:10:42.408992+0000","last_active":"2024-09-21T07:10:43.424450+0000","last_peered":"2024-09-21T07:10:43.424450+0000","last_clean":"2024-09-21T07:10:43.424450+0000","last_became_active":"2024-09-21T07:10:42.408041+0000","last_became_peered":"2024-09-21T07:10:42.408041+0000","last_unstale":"2024-09-21T07:10:43.424450+0000","last_undegraded":"2024-09-21T07:10:43.424450+0000","last_fullsized":"2024-09-21T07:10:43.424450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:36.986751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":794624,"data_stored":657769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":74731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":212992,"data_stored":73209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":208896,"data_stored":66945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":73119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":68431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":217088,"data_stored":73279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":802816,"data_stored":657825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:10:51.992 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:10:52.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.121+0000 7fa9f2d0b640 1 -- 172.21.15.18:0/1786362229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ec15c520 msgr2=0x7fa9ec0d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:52.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.121+0000 7fa9f2d0b640 1 --2- 172.21.15.18:0/1786362229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ec15c520 0x7fa9ec0d3040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009820 tx=0x7fa9dc02a510 comp rx=0 tx=0).stop 2024-09-21T07:10:52.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.121+0000 7fa9f2d0b640 1 -- 172.21.15.18:0/1786362229 shutdown_connections 2024-09-21T07:10:52.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.121+0000 7fa9f2d0b640 1 --2- 172.21.15.18:0/1786362229 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa9ec0d3580 0x7fa9ec162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.121+0000 7fa9f2d0b640 1 --2- 172.21.15.18:0/1786362229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ec15c520 0x7fa9ec0d3040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.121+0000 7fa9f2d0b640 1 -- 172.21.15.18:0/1786362229 >> 172.21.15.18:0/1786362229 conn(0x7fa9ec073f30 msgr2=0x7fa9ec0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:52.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.121+0000 7fa9f2d0b640 1 -- 172.21.15.18:0/1786362229 shutdown_connections 2024-09-21T07:10:52.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.121+0000 7fa9f2d0b640 1 -- 172.21.15.18:0/1786362229 wait complete. 2024-09-21T07:10:52.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.122+0000 7fa9f2d0b640 1 Processor -- start 2024-09-21T07:10:52.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.123+0000 7fa9f2d0b640 1 -- start start 2024-09-21T07:10:52.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.124+0000 7fa9f2d0b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9ec0d3580 0x7fa9ec0acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:52.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.124+0000 7fa9f2d0b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa9ec15c520 0x7fa9ec0cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:52.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.124+0000 7fa9f2d0b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ec15ef50 0x7fa9ec15b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:52.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.124+0000 7fa9f2d0b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec0d1020 con 0x7fa9ec15ef50 2024-09-21T07:10:52.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.124+0000 7fa9f2d0b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec163380 con 0x7fa9ec0d3580 2024-09-21T07:10:52.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.124+0000 7fa9f2d0b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fa9ec0d11a0 con 0x7fa9ec15c520 2024-09-21T07:10:52.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.124+0000 7fa9f12a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ec15ef50 0x7fa9ec15b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.124+0000 7fa9f12a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ec15ef50 0x7fa9ec15b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50024/0 (socket says 172.21.15.18:50024) 2024-09-21T07:10:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.124+0000 7fa9f12a8640 1 -- 172.21.15.18:0/1383172566 learned_addr learned my addr 172.21.15.18:0/1383172566 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.124+0000 7fa9e3fff640 1 --2- 172.21.15.18:0/1383172566 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa9ec15c520 0x7fa9ec0cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.124+0000 7fa9f0aa7640 1 --2- 172.21.15.18:0/1383172566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9ec0d3580 0x7fa9ec0acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.125+0000 7fa9f12a8640 1 -- 172.21.15.18:0/1383172566 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa9ec15c520 msgr2=0x7fa9ec0cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.125+0000 7fa9f12a8640 1 --2- 172.21.15.18:0/1383172566 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa9ec15c520 0x7fa9ec0cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.125+0000 7fa9f12a8640 1 -- 172.21.15.18:0/1383172566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9ec0d3580 msgr2=0x7fa9ec0acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.125+0000 7fa9f12a8640 1 --2- 172.21.15.18:0/1383172566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9ec0d3580 0x7fa9ec0acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.125+0000 7fa9f12a8640 1 -- 172.21.15.18:0/1383172566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ec0ab370 con 0x7fa9ec15ef50 2024-09-21T07:10:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.125+0000 7fa9f12a8640 1 --2- 172.21.15.18:0/1383172566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ec15ef50 0x7fa9ec15b7f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa9e400d9a0 tx=0x7fa9e400de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.125+0000 7fa9e17fa640 1 -- 172.21.15.18:0/1383172566 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4017070 con 0x7fa9ec15ef50 2024-09-21T07:10:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.125+0000 7fa9e17fa640 1 -- 172.21.15.18:0/1383172566 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9e400be00 con 0x7fa9ec15ef50 2024-09-21T07:10:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.125+0000 7fa9e17fa640 1 -- 172.21.15.18:0/1383172566 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4003bd0 con 0x7fa9ec15ef50 2024-09-21T07:10:52.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.125+0000 7fa9f2d0b640 1 -- 172.21.15.18:0/1383172566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9ec0ab650 con 0x7fa9ec15ef50 2024-09-21T07:10:52.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.125+0000 7fa9f2d0b640 1 -- 172.21.15.18:0/1383172566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9ec0ac130 con 0x7fa9ec15ef50 2024-09-21T07:10:52.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.126+0000 7fa9f2d0b640 1 -- 172.21.15.18:0/1383172566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9ec0cea30 con 0x7fa9ec15ef50 2024-09-21T07:10:52.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.127+0000 7fa9e17fa640 1 -- 172.21.15.18:0/1383172566 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa9e4010460 con 0x7fa9ec15ef50 2024-09-21T07:10:52.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.127+0000 7fa9e17fa640 1 --2- 172.21.15.18:0/1383172566 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa9d8078b90 0x7fa9d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:52.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.127+0000 7fa9e17fa640 1 -- 172.21.15.18:0/1383172566 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa9e409b0d0 con 0x7fa9ec15ef50 2024-09-21T07:10:52.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.128+0000 7fa9f0aa7640 1 --2- 172.21.15.18:0/1383172566 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa9d8078b90 0x7fa9d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:52.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.128+0000 7fa9f0aa7640 1 --2- 172.21.15.18:0/1383172566 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa9d8078b90 0x7fa9d807b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8007fd0 tx=0x7fa9e8001370 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:52.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.132+0000 7fa9e17fa640 1 -- 172.21.15.18:0/1383172566 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa9e4062ed0 con 0x7fa9ec15ef50 2024-09-21T07:10:52.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.317+0000 7fa9f2d0b640 1 -- 172.21.15.18:0/1383172566 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa9ec0ab120 con 0x7fa9d8078b90 2024-09-21T07:10:52.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.322+0000 7fa9e17fa640 1 -- 172.21.15.18:0/1383172566 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251861 (secure 0 0 0) 0x7fa9ec0ab120 con 0x7fa9d8078b90 2024-09-21T07:10:52.327 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:52.329 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-21T07:10:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.325+0000 7fa9f2d0b640 1 -- 172.21.15.18:0/1383172566 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa9d8078b90 msgr2=0x7fa9d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.325+0000 7fa9f2d0b640 1 --2- 172.21.15.18:0/1383172566 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa9d8078b90 0x7fa9d807b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8007fd0 tx=0x7fa9e8001370 comp rx=0 tx=0).stop 2024-09-21T07:10:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.325+0000 7fa9f2d0b640 1 -- 172.21.15.18:0/1383172566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ec15ef50 msgr2=0x7fa9ec15b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.325+0000 7fa9f2d0b640 1 --2- 172.21.15.18:0/1383172566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ec15ef50 0x7fa9ec15b7f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa9e400d9a0 tx=0x7fa9e400de60 comp rx=0 tx=0).stop 2024-09-21T07:10:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.325+0000 7fa9f2d0b640 1 -- 172.21.15.18:0/1383172566 shutdown_connections 2024-09-21T07:10:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.325+0000 7fa9f2d0b640 1 --2- 172.21.15.18:0/1383172566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ec15ef50 0x7fa9ec15b7f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.325+0000 7fa9f2d0b640 1 --2- 172.21.15.18:0/1383172566 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa9d8078b90 0x7fa9d807b0a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.325+0000 7fa9f2d0b640 1 --2- 172.21.15.18:0/1383172566 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa9ec15c520 0x7fa9ec0cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.325+0000 7fa9f2d0b640 1 --2- 172.21.15.18:0/1383172566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9ec0d3580 0x7fa9ec0acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.325+0000 7fa9f2d0b640 1 -- 172.21.15.18:0/1383172566 >> 172.21.15.18:0/1383172566 conn(0x7fa9ec073f30 msgr2=0x7fa9ec15d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.325+0000 7fa9f2d0b640 1 -- 172.21.15.18:0/1383172566 shutdown_connections 2024-09-21T07:10:52.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.325+0000 7fa9f2d0b640 1 -- 172.21.15.18:0/1383172566 wait complete. 2024-09-21T07:10:52.339 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-21T07:10:52.316030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":269012,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754705708,"statfs":{"total":773094113280,"available":772818644992,"internally_reserved":0,"allocated":2924544,"data_stored":1770508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.927680"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380397+0000","last_change":"2024-09-21T07:10:43.418758+0000","last_active":"2024-09-21T07:10:47.380397+0000","last_peered":"2024-09-21T07:10:47.380397+0000","last_clean":"2024-09-21T07:10:47.380397+0000","last_became_active":"2024-09-21T07:10:43.413221+0000","last_became_peered":"2024-09-21T07:10:43.413221+0000","last_unstale":"2024-09-21T07:10:47.380397+0000","last_undegraded":"2024-09-21T07:10:47.380397+0000","last_fullsized":"2024-09-21T07:10:47.380397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:15.423169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404706+0000","last_change":"2024-09-21T07:10:43.425911+0000","last_active":"2024-09-21T07:10:44.404706+0000","last_peered":"2024-09-21T07:10:44.404706+0000","last_clean":"2024-09-21T07:10:44.404706+0000","last_became_active":"2024-09-21T07:10:43.424831+0000","last_became_peered":"2024-09-21T07:10:43.424831+0000","last_unstale":"2024-09-21T07:10:44.404706+0000","last_undegraded":"2024-09-21T07:10:44.404706+0000","last_fullsized":"2024-09-21T07:10:44.404706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:52.852007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378570+0000","last_change":"2024-09-21T07:10:43.402987+0000","last_active":"2024-09-21T07:10:47.378570+0000","last_peered":"2024-09-21T07:10:47.378570+0000","last_clean":"2024-09-21T07:10:47.378570+0000","last_became_active":"2024-09-21T07:10:43.402600+0000","last_became_peered":"2024-09-21T07:10:43.402600+0000","last_unstale":"2024-09-21T07:10:47.378570+0000","last_undegraded":"2024-09-21T07:10:47.378570+0000","last_fullsized":"2024-09-21T07:10:47.378570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:27.607737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405847+0000","last_change":"2024-09-21T07:10:43.418498+0000","last_active":"2024-09-21T07:10:44.405847+0000","last_peered":"2024-09-21T07:10:44.405847+0000","last_clean":"2024-09-21T07:10:44.405847+0000","last_became_active":"2024-09-21T07:10:43.418075+0000","last_became_peered":"2024-09-21T07:10:43.418075+0000","last_unstale":"2024-09-21T07:10:44.405847+0000","last_undegraded":"2024-09-21T07:10:44.405847+0000","last_fullsized":"2024-09-21T07:10:44.405847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:39.715349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379099+0000","last_change":"2024-09-21T07:10:43.409859+0000","last_active":"2024-09-21T07:10:47.379099+0000","last_peered":"2024-09-21T07:10:47.379099+0000","last_clean":"2024-09-21T07:10:47.379099+0000","last_became_active":"2024-09-21T07:10:43.409171+0000","last_became_peered":"2024-09-21T07:10:43.409171+0000","last_unstale":"2024-09-21T07:10:47.379099+0000","last_undegraded":"2024-09-21T07:10:47.379099+0000","last_fullsized":"2024-09-21T07:10:47.379099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:28.893883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405635+0000","last_change":"2024-09-21T07:10:43.408895+0000","last_active":"2024-09-21T07:10:44.405635+0000","last_peered":"2024-09-21T07:10:44.405635+0000","last_clean":"2024-09-21T07:10:44.405635+0000","last_became_active":"2024-09-21T07:10:43.408402+0000","last_became_peered":"2024-09-21T07:10:43.408402+0000","last_unstale":"2024-09-21T07:10:44.405635+0000","last_undegraded":"2024-09-21T07:10:44.405635+0000","last_fullsized":"2024-09-21T07:10:44.405635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:28.893883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379333+0000","last_change":"2024-09-21T07:10:43.404599+0000","last_active":"2024-09-21T07:10:47.379333+0000","last_peered":"2024-09-21T07:10:47.379333+0000","last_clean":"2024-09-21T07:10:47.379333+0000","last_became_active":"2024-09-21T07:10:43.404288+0000","last_became_peered":"2024-09-21T07:10:43.404288+0000","last_unstale":"2024-09-21T07:10:47.379333+0000","last_undegraded":"2024-09-21T07:10:47.379333+0000","last_fullsized":"2024-09-21T07:10:47.379333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:03.491744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378441+0000","last_change":"2024-09-21T07:10:43.412128+0000","last_active":"2024-09-21T07:10:47.378441+0000","last_peered":"2024-09-21T07:10:47.378441+0000","last_clean":"2024-09-21T07:10:47.378441+0000","last_became_active":"2024-09-21T07:10:43.410969+0000","last_became_peered":"2024-09-21T07:10:43.410969+0000","last_unstale":"2024-09-21T07:10:47.378441+0000","last_undegraded":"2024-09-21T07:10:47.378441+0000","last_fullsized":"2024-09-21T07:10:47.378441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:38.675519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380450+0000","last_change":"2024-09-21T07:10:43.420504+0000","last_active":"2024-09-21T07:10:47.380450+0000","last_peered":"2024-09-21T07:10:47.380450+0000","last_clean":"2024-09-21T07:10:47.380450+0000","last_became_active":"2024-09-21T07:10:43.418716+0000","last_became_peered":"2024-09-21T07:10:43.418716+0000","last_unstale":"2024-09-21T07:10:47.380450+0000","last_undegraded":"2024-09-21T07:10:47.380450+0000","last_fullsized":"2024-09-21T07:10:47.380450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:39.695264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423623+0000","last_change":"2024-09-21T07:10:43.414160+0000","last_active":"2024-09-21T07:10:44.423623+0000","last_peered":"2024-09-21T07:10:44.423623+0000","last_clean":"2024-09-21T07:10:44.423623+0000","last_became_active":"2024-09-21T07:10:43.413651+0000","last_became_peered":"2024-09-21T07:10:43.413651+0000","last_unstale":"2024-09-21T07:10:44.423623+0000","last_undegraded":"2024-09-21T07:10:44.423623+0000","last_fullsized":"2024-09-21T07:10:44.423623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:36.925353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423522+0000","last_change":"2024-09-21T07:10:43.414383+0000","last_active":"2024-09-21T07:10:44.423522+0000","last_peered":"2024-09-21T07:10:44.423522+0000","last_clean":"2024-09-21T07:10:44.423522+0000","last_became_active":"2024-09-21T07:10:43.413520+0000","last_became_peered":"2024-09-21T07:10:43.413520+0000","last_unstale":"2024-09-21T07:10:44.423522+0000","last_undegraded":"2024-09-21T07:10:44.423522+0000","last_fullsized":"2024-09-21T07:10:44.423522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:58.082249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379251+0000","last_change":"2024-09-21T07:10:43.417909+0000","last_active":"2024-09-21T07:10:47.379251+0000","last_peered":"2024-09-21T07:10:47.379251+0000","last_clean":"2024-09-21T07:10:47.379251+0000","last_became_active":"2024-09-21T07:10:43.417587+0000","last_became_peered":"2024-09-21T07:10:43.417587+0000","last_unstale":"2024-09-21T07:10:47.379251+0000","last_undegraded":"2024-09-21T07:10:47.379251+0000","last_fullsized":"2024-09-21T07:10:47.379251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:16.951261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378633+0000","last_change":"2024-09-21T07:10:43.412277+0000","last_active":"2024-09-21T07:10:47.378633+0000","last_peered":"2024-09-21T07:10:47.378633+0000","last_clean":"2024-09-21T07:10:47.378633+0000","last_became_active":"2024-09-21T07:10:43.411507+0000","last_became_peered":"2024-09-21T07:10:43.411507+0000","last_unstale":"2024-09-21T07:10:47.378633+0000","last_undegraded":"2024-09-21T07:10:47.378633+0000","last_fullsized":"2024-09-21T07:10:47.378633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:28.683802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379022+0000","last_change":"2024-09-21T07:10:43.418752+0000","last_active":"2024-09-21T07:10:47.379022+0000","last_peered":"2024-09-21T07:10:47.379022+0000","last_clean":"2024-09-21T07:10:47.379022+0000","last_became_active":"2024-09-21T07:10:43.418424+0000","last_became_peered":"2024-09-21T07:10:43.418424+0000","last_unstale":"2024-09-21T07:10:47.379022+0000","last_undegraded":"2024-09-21T07:10:47.379022+0000","last_fullsized":"2024-09-21T07:10:47.379022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:27.138072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404284+0000","last_change":"2024-09-21T07:10:43.415461+0000","last_active":"2024-09-21T07:10:44.404284+0000","last_peered":"2024-09-21T07:10:44.404284+0000","last_clean":"2024-09-21T07:10:44.404284+0000","last_became_active":"2024-09-21T07:10:43.410697+0000","last_became_peered":"2024-09-21T07:10:43.410697+0000","last_unstale":"2024-09-21T07:10:44.404284+0000","last_undegraded":"2024-09-21T07:10:44.404284+0000","last_fullsized":"2024-09-21T07:10:44.404284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:14.665635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405475+0000","last_change":"2024-09-21T07:10:43.413220+0000","last_active":"2024-09-21T07:10:44.405475+0000","last_peered":"2024-09-21T07:10:44.405475+0000","last_clean":"2024-09-21T07:10:44.405475+0000","last_became_active":"2024-09-21T07:10:43.412892+0000","last_became_peered":"2024-09-21T07:10:43.412892+0000","last_unstale":"2024-09-21T07:10:44.405475+0000","last_undegraded":"2024-09-21T07:10:44.405475+0000","last_fullsized":"2024-09-21T07:10:44.405475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:55.242127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406808+0000","last_change":"2024-09-21T07:10:43.409834+0000","last_active":"2024-09-21T07:10:44.406808+0000","last_peered":"2024-09-21T07:10:44.406808+0000","last_clean":"2024-09-21T07:10:44.406808+0000","last_became_active":"2024-09-21T07:10:43.409533+0000","last_became_peered":"2024-09-21T07:10:43.409533+0000","last_unstale":"2024-09-21T07:10:44.406808+0000","last_undegraded":"2024-09-21T07:10:44.406808+0000","last_fullsized":"2024-09-21T07:10:44.406808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:26.185434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405326+0000","last_change":"2024-09-21T07:10:43.414453+0000","last_active":"2024-09-21T07:10:44.405326+0000","last_peered":"2024-09-21T07:10:44.405326+0000","last_clean":"2024-09-21T07:10:44.405326+0000","last_became_active":"2024-09-21T07:10:43.414138+0000","last_became_peered":"2024-09-21T07:10:43.414138+0000","last_unstale":"2024-09-21T07:10:44.405326+0000","last_undegraded":"2024-09-21T07:10:44.405326+0000","last_fullsized":"2024-09-21T07:10:44.405326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:26.960157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380386+0000","last_change":"2024-09-21T07:10:43.408892+0000","last_active":"2024-09-21T07:10:47.380386+0000","last_peered":"2024-09-21T07:10:47.380386+0000","last_clean":"2024-09-21T07:10:47.380386+0000","last_became_active":"2024-09-21T07:10:43.408554+0000","last_became_peered":"2024-09-21T07:10:43.408554+0000","last_unstale":"2024-09-21T07:10:47.380386+0000","last_undegraded":"2024-09-21T07:10:47.380386+0000","last_fullsized":"2024-09-21T07:10:47.380386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:18.068383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423355+0000","last_change":"2024-09-21T07:10:43.418255+0000","last_active":"2024-09-21T07:10:44.423355+0000","last_peered":"2024-09-21T07:10:44.423355+0000","last_clean":"2024-09-21T07:10:44.423355+0000","last_became_active":"2024-09-21T07:10:43.417893+0000","last_became_peered":"2024-09-21T07:10:43.417893+0000","last_unstale":"2024-09-21T07:10:44.423355+0000","last_undegraded":"2024-09-21T07:10:44.423355+0000","last_fullsized":"2024-09-21T07:10:44.423355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:28.683802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379786+0000","last_change":"2024-09-21T07:10:43.414479+0000","last_active":"2024-09-21T07:10:47.379786+0000","last_peered":"2024-09-21T07:10:47.379786+0000","last_clean":"2024-09-21T07:10:47.379786+0000","last_became_active":"2024-09-21T07:10:43.414121+0000","last_became_peered":"2024-09-21T07:10:43.414121+0000","last_unstale":"2024-09-21T07:10:47.379786+0000","last_undegraded":"2024-09-21T07:10:47.379786+0000","last_fullsized":"2024-09-21T07:10:47.379786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:23.952801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405904+0000","last_change":"2024-09-21T07:10:43.409741+0000","last_active":"2024-09-21T07:10:44.405904+0000","last_peered":"2024-09-21T07:10:44.405904+0000","last_clean":"2024-09-21T07:10:44.405904+0000","last_became_active":"2024-09-21T07:10:43.408139+0000","last_became_peered":"2024-09-21T07:10:43.408139+0000","last_unstale":"2024-09-21T07:10:44.405904+0000","last_undegraded":"2024-09-21T07:10:44.405904+0000","last_fullsized":"2024-09-21T07:10:44.405904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:03.311605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379526+0000","last_change":"2024-09-21T07:10:43.416414+0000","last_active":"2024-09-21T07:10:47.379526+0000","last_peered":"2024-09-21T07:10:47.379526+0000","last_clean":"2024-09-21T07:10:47.379526+0000","last_became_active":"2024-09-21T07:10:43.415380+0000","last_became_peered":"2024-09-21T07:10:43.415380+0000","last_unstale":"2024-09-21T07:10:47.379526+0000","last_undegraded":"2024-09-21T07:10:47.379526+0000","last_fullsized":"2024-09-21T07:10:47.379526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:34:29.882522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405523+0000","last_change":"2024-09-21T07:10:43.407135+0000","last_active":"2024-09-21T07:10:44.405523+0000","last_peered":"2024-09-21T07:10:44.405523+0000","last_clean":"2024-09-21T07:10:44.405523+0000","last_became_active":"2024-09-21T07:10:43.406562+0000","last_became_peered":"2024-09-21T07:10:43.406562+0000","last_unstale":"2024-09-21T07:10:44.405523+0000","last_undegraded":"2024-09-21T07:10:44.405523+0000","last_fullsized":"2024-09-21T07:10:44.405523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:45.271471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379360+0000","last_change":"2024-09-21T07:10:43.415169+0000","last_active":"2024-09-21T07:10:47.379360+0000","last_peered":"2024-09-21T07:10:47.379360+0000","last_clean":"2024-09-21T07:10:47.379360+0000","last_became_active":"2024-09-21T07:10:43.414845+0000","last_became_peered":"2024-09-21T07:10:43.414845+0000","last_unstale":"2024-09-21T07:10:47.379360+0000","last_undegraded":"2024-09-21T07:10:47.379360+0000","last_fullsized":"2024-09-21T07:10:47.379360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:14.930286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423654+0000","last_change":"2024-09-21T07:10:43.410604+0000","last_active":"2024-09-21T07:10:44.423654+0000","last_peered":"2024-09-21T07:10:44.423654+0000","last_clean":"2024-09-21T07:10:44.423654+0000","last_became_active":"2024-09-21T07:10:43.410225+0000","last_became_peered":"2024-09-21T07:10:43.410225+0000","last_unstale":"2024-09-21T07:10:44.423654+0000","last_undegraded":"2024-09-21T07:10:44.423654+0000","last_fullsized":"2024-09-21T07:10:44.423654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:04.920178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404615+0000","last_change":"2024-09-21T07:10:43.425050+0000","last_active":"2024-09-21T07:10:44.404615+0000","last_peered":"2024-09-21T07:10:44.404615+0000","last_clean":"2024-09-21T07:10:44.404615+0000","last_became_active":"2024-09-21T07:10:43.424686+0000","last_became_peered":"2024-09-21T07:10:43.424686+0000","last_unstale":"2024-09-21T07:10:44.404615+0000","last_undegraded":"2024-09-21T07:10:44.404615+0000","last_fullsized":"2024-09-21T07:10:44.404615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:11.009112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379756+0000","last_change":"2024-09-21T07:10:43.415955+0000","last_active":"2024-09-21T07:10:47.379756+0000","last_peered":"2024-09-21T07:10:47.379756+0000","last_clean":"2024-09-21T07:10:47.379756+0000","last_became_active":"2024-09-21T07:10:43.415633+0000","last_became_peered":"2024-09-21T07:10:43.415633+0000","last_unstale":"2024-09-21T07:10:47.379756+0000","last_undegraded":"2024-09-21T07:10:47.379756+0000","last_fullsized":"2024-09-21T07:10:47.379756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:08.696212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379956+0000","last_change":"2024-09-21T07:10:43.417820+0000","last_active":"2024-09-21T07:10:47.379956+0000","last_peered":"2024-09-21T07:10:47.379956+0000","last_clean":"2024-09-21T07:10:47.379956+0000","last_became_active":"2024-09-21T07:10:43.417482+0000","last_became_peered":"2024-09-21T07:10:43.417482+0000","last_unstale":"2024-09-21T07:10:47.379956+0000","last_undegraded":"2024-09-21T07:10:47.379956+0000","last_fullsized":"2024-09-21T07:10:47.379956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:11.009112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406171+0000","last_change":"2024-09-21T07:10:43.416076+0000","last_active":"2024-09-21T07:10:44.406171+0000","last_peered":"2024-09-21T07:10:44.406171+0000","last_clean":"2024-09-21T07:10:44.406171+0000","last_became_active":"2024-09-21T07:10:43.415727+0000","last_became_peered":"2024-09-21T07:10:43.415727+0000","last_unstale":"2024-09-21T07:10:44.406171+0000","last_undegraded":"2024-09-21T07:10:44.406171+0000","last_fullsized":"2024-09-21T07:10:44.406171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:30.034257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405184+0000","last_change":"2024-09-21T07:10:43.411355+0000","last_active":"2024-09-21T07:10:44.405184+0000","last_peered":"2024-09-21T07:10:44.405184+0000","last_clean":"2024-09-21T07:10:44.405184+0000","last_became_active":"2024-09-21T07:10:43.408638+0000","last_became_peered":"2024-09-21T07:10:43.408638+0000","last_unstale":"2024-09-21T07:10:44.405184+0000","last_undegraded":"2024-09-21T07:10:44.405184+0000","last_fullsized":"2024-09-21T07:10:44.405184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:34.237185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423340+0000","last_change":"2024-09-21T07:10:43.422509+0000","last_active":"2024-09-21T07:10:44.423340+0000","last_peered":"2024-09-21T07:10:44.423340+0000","last_clean":"2024-09-21T07:10:44.423340+0000","last_became_active":"2024-09-21T07:10:43.422122+0000","last_became_peered":"2024-09-21T07:10:43.422122+0000","last_unstale":"2024-09-21T07:10:44.423340+0000","last_undegraded":"2024-09-21T07:10:44.423340+0000","last_fullsized":"2024-09-21T07:10:44.423340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:38.675519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379436+0000","last_change":"2024-09-21T07:10:43.411295+0000","last_active":"2024-09-21T07:10:47.379436+0000","last_peered":"2024-09-21T07:10:47.379436+0000","last_clean":"2024-09-21T07:10:47.379436+0000","last_became_active":"2024-09-21T07:10:43.410963+0000","last_became_peered":"2024-09-21T07:10:43.410963+0000","last_unstale":"2024-09-21T07:10:47.379436+0000","last_undegraded":"2024-09-21T07:10:47.379436+0000","last_fullsized":"2024-09-21T07:10:47.379436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:02.068200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379059+0000","last_change":"2024-09-21T07:10:42.407850+0000","last_active":"2024-09-21T07:10:47.379059+0000","last_peered":"2024-09-21T07:10:47.379059+0000","last_clean":"2024-09-21T07:10:47.379059+0000","last_became_active":"2024-09-21T07:10:42.407497+0000","last_became_peered":"2024-09-21T07:10:42.407497+0000","last_unstale":"2024-09-21T07:10:47.379059+0000","last_undegraded":"2024-09-21T07:10:47.379059+0000","last_fullsized":"2024-09-21T07:10:47.379059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:34.583545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379982+0000","last_change":"2024-09-21T07:10:43.398164+0000","last_active":"2024-09-21T07:10:47.379982+0000","last_peered":"2024-09-21T07:10:47.379982+0000","last_clean":"2024-09-21T07:10:47.379982+0000","last_became_active":"2024-09-21T07:10:43.397191+0000","last_became_peered":"2024-09-21T07:10:43.397191+0000","last_unstale":"2024-09-21T07:10:47.379982+0000","last_undegraded":"2024-09-21T07:10:47.379982+0000","last_fullsized":"2024-09-21T07:10:47.379982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:52.852007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423132+0000","last_change":"2024-09-21T07:10:42.403613+0000","last_active":"2024-09-21T07:10:44.423132+0000","last_peered":"2024-09-21T07:10:44.423132+0000","last_clean":"2024-09-21T07:10:44.423132+0000","last_became_active":"2024-09-21T07:10:42.402543+0000","last_became_peered":"2024-09-21T07:10:42.402543+0000","last_unstale":"2024-09-21T07:10:44.423132+0000","last_undegraded":"2024-09-21T07:10:44.423132+0000","last_fullsized":"2024-09-21T07:10:44.423132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:15.945210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379738+0000","last_change":"2024-09-21T07:10:42.405878+0000","last_active":"2024-09-21T07:10:47.379738+0000","last_peered":"2024-09-21T07:10:47.379738+0000","last_clean":"2024-09-21T07:10:47.379738+0000","last_became_active":"2024-09-21T07:10:42.404760+0000","last_became_peered":"2024-09-21T07:10:42.404760+0000","last_unstale":"2024-09-21T07:10:47.379738+0000","last_undegraded":"2024-09-21T07:10:47.379738+0000","last_fullsized":"2024-09-21T07:10:47.379738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:24.910811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378702+0000","last_change":"2024-09-21T07:10:43.421622+0000","last_active":"2024-09-21T07:10:47.378702+0000","last_peered":"2024-09-21T07:10:47.378702+0000","last_clean":"2024-09-21T07:10:47.378702+0000","last_became_active":"2024-09-21T07:10:43.421299+0000","last_became_peered":"2024-09-21T07:10:43.421299+0000","last_unstale":"2024-09-21T07:10:47.378702+0000","last_undegraded":"2024-09-21T07:10:47.378702+0000","last_fullsized":"2024-09-21T07:10:47.378702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:32.944402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405639+0000","last_change":"2024-09-21T07:10:42.401842+0000","last_active":"2024-09-21T07:10:44.405639+0000","last_peered":"2024-09-21T07:10:44.405639+0000","last_clean":"2024-09-21T07:10:44.405639+0000","last_became_active":"2024-09-21T07:10:42.401304+0000","last_became_peered":"2024-09-21T07:10:42.401304+0000","last_unstale":"2024-09-21T07:10:44.405639+0000","last_undegraded":"2024-09-21T07:10:44.405639+0000","last_fullsized":"2024-09-21T07:10:44.405639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:31.113600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404237+0000","last_change":"2024-09-21T07:10:43.424849+0000","last_active":"2024-09-21T07:10:44.404237+0000","last_peered":"2024-09-21T07:10:44.404237+0000","last_clean":"2024-09-21T07:10:44.404237+0000","last_became_active":"2024-09-21T07:10:43.424491+0000","last_became_peered":"2024-09-21T07:10:43.424491+0000","last_unstale":"2024-09-21T07:10:44.404237+0000","last_undegraded":"2024-09-21T07:10:44.404237+0000","last_fullsized":"2024-09-21T07:10:44.404237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:15.151519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423579+0000","last_change":"2024-09-21T07:10:42.404454+0000","last_active":"2024-09-21T07:10:44.423579+0000","last_peered":"2024-09-21T07:10:44.423579+0000","last_clean":"2024-09-21T07:10:44.423579+0000","last_became_active":"2024-09-21T07:10:42.404062+0000","last_became_peered":"2024-09-21T07:10:42.404062+0000","last_unstale":"2024-09-21T07:10:44.423579+0000","last_undegraded":"2024-09-21T07:10:44.423579+0000","last_fullsized":"2024-09-21T07:10:44.423579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:33.377412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406705+0000","last_change":"2024-09-21T07:10:43.409200+0000","last_active":"2024-09-21T07:10:44.406705+0000","last_peered":"2024-09-21T07:10:44.406705+0000","last_clean":"2024-09-21T07:10:44.406705+0000","last_became_active":"2024-09-21T07:10:43.408864+0000","last_became_peered":"2024-09-21T07:10:43.408864+0000","last_unstale":"2024-09-21T07:10:44.406705+0000","last_undegraded":"2024-09-21T07:10:44.406705+0000","last_fullsized":"2024-09-21T07:10:44.406705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:39.695264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406436+0000","last_change":"2024-09-21T07:10:42.406774+0000","last_active":"2024-09-21T07:10:44.406436+0000","last_peered":"2024-09-21T07:10:44.406436+0000","last_clean":"2024-09-21T07:10:44.406436+0000","last_became_active":"2024-09-21T07:10:42.404461+0000","last_became_peered":"2024-09-21T07:10:42.404461+0000","last_unstale":"2024-09-21T07:10:44.406436+0000","last_undegraded":"2024-09-21T07:10:44.406436+0000","last_fullsized":"2024-09-21T07:10:44.406436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:38.533867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379345+0000","last_change":"2024-09-21T07:10:43.408995+0000","last_active":"2024-09-21T07:10:47.379345+0000","last_peered":"2024-09-21T07:10:47.379345+0000","last_clean":"2024-09-21T07:10:47.379345+0000","last_became_active":"2024-09-21T07:10:43.408670+0000","last_became_peered":"2024-09-21T07:10:43.408670+0000","last_unstale":"2024-09-21T07:10:47.379345+0000","last_undegraded":"2024-09-21T07:10:47.379345+0000","last_fullsized":"2024-09-21T07:10:47.379345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:08.183794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404702+0000","last_change":"2024-09-21T07:10:42.412327+0000","last_active":"2024-09-21T07:10:44.404702+0000","last_peered":"2024-09-21T07:10:44.404702+0000","last_clean":"2024-09-21T07:10:44.404702+0000","last_became_active":"2024-09-21T07:10:42.411992+0000","last_became_peered":"2024-09-21T07:10:42.411992+0000","last_unstale":"2024-09-21T07:10:44.404702+0000","last_undegraded":"2024-09-21T07:10:44.404702+0000","last_fullsized":"2024-09-21T07:10:44.404702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:12.534169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379508+0000","last_change":"2024-09-21T07:10:43.408223+0000","last_active":"2024-09-21T07:10:47.379508+0000","last_peered":"2024-09-21T07:10:47.379508+0000","last_clean":"2024-09-21T07:10:47.379508+0000","last_became_active":"2024-09-21T07:10:43.407894+0000","last_became_peered":"2024-09-21T07:10:43.407894+0000","last_unstale":"2024-09-21T07:10:47.379508+0000","last_undegraded":"2024-09-21T07:10:47.379508+0000","last_fullsized":"2024-09-21T07:10:47.379508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:26.991092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423435+0000","last_change":"2024-09-21T07:10:42.399128+0000","last_active":"2024-09-21T07:10:44.423435+0000","last_peered":"2024-09-21T07:10:44.423435+0000","last_clean":"2024-09-21T07:10:44.423435+0000","last_became_active":"2024-09-21T07:10:42.398772+0000","last_became_peered":"2024-09-21T07:10:42.398772+0000","last_unstale":"2024-09-21T07:10:44.423435+0000","last_undegraded":"2024-09-21T07:10:44.423435+0000","last_fullsized":"2024-09-21T07:10:44.423435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:01.062149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379989+0000","last_change":"2024-09-21T07:10:43.415524+0000","last_active":"2024-09-21T07:10:47.379989+0000","last_peered":"2024-09-21T07:10:47.379989+0000","last_clean":"2024-09-21T07:10:47.379989+0000","last_became_active":"2024-09-21T07:10:43.415196+0000","last_became_peered":"2024-09-21T07:10:43.415196+0000","last_unstale":"2024-09-21T07:10:47.379989+0000","last_undegraded":"2024-09-21T07:10:47.379989+0000","last_fullsized":"2024-09-21T07:10:47.379989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:30.034257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380068+0000","last_change":"2024-09-21T07:10:42.402240+0000","last_active":"2024-09-21T07:10:47.380068+0000","last_peered":"2024-09-21T07:10:47.380068+0000","last_clean":"2024-09-21T07:10:47.380068+0000","last_became_active":"2024-09-21T07:10:42.401874+0000","last_became_peered":"2024-09-21T07:10:42.401874+0000","last_unstale":"2024-09-21T07:10:47.380068+0000","last_undegraded":"2024-09-21T07:10:47.380068+0000","last_fullsized":"2024-09-21T07:10:47.380068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:57.539687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379271+0000","last_change":"2024-09-21T07:10:43.411598+0000","last_active":"2024-09-21T07:10:47.379271+0000","last_peered":"2024-09-21T07:10:47.379271+0000","last_clean":"2024-09-21T07:10:47.379271+0000","last_became_active":"2024-09-21T07:10:43.411274+0000","last_became_peered":"2024-09-21T07:10:43.411274+0000","last_unstale":"2024-09-21T07:10:47.379271+0000","last_undegraded":"2024-09-21T07:10:47.379271+0000","last_fullsized":"2024-09-21T07:10:47.379271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:15.151519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406106+0000","last_change":"2024-09-21T07:10:42.401021+0000","last_active":"2024-09-21T07:10:44.406106+0000","last_peered":"2024-09-21T07:10:44.406106+0000","last_clean":"2024-09-21T07:10:44.406106+0000","last_became_active":"2024-09-21T07:10:42.400700+0000","last_became_peered":"2024-09-21T07:10:42.400700+0000","last_unstale":"2024-09-21T07:10:44.406106+0000","last_undegraded":"2024-09-21T07:10:44.406106+0000","last_fullsized":"2024-09-21T07:10:44.406106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:05.347695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379844+0000","last_change":"2024-09-21T07:10:43.410354+0000","last_active":"2024-09-21T07:10:47.379844+0000","last_peered":"2024-09-21T07:10:47.379844+0000","last_clean":"2024-09-21T07:10:47.379844+0000","last_became_active":"2024-09-21T07:10:43.409526+0000","last_became_peered":"2024-09-21T07:10:43.409526+0000","last_unstale":"2024-09-21T07:10:47.379844+0000","last_undegraded":"2024-09-21T07:10:47.379844+0000","last_fullsized":"2024-09-21T07:10:47.379844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:39.715349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423098+0000","last_change":"2024-09-21T07:10:42.402010+0000","last_active":"2024-09-21T07:10:44.423098+0000","last_peered":"2024-09-21T07:10:44.423098+0000","last_clean":"2024-09-21T07:10:44.423098+0000","last_became_active":"2024-09-21T07:10:42.401682+0000","last_became_peered":"2024-09-21T07:10:42.401682+0000","last_unstale":"2024-09-21T07:10:44.423098+0000","last_undegraded":"2024-09-21T07:10:44.423098+0000","last_fullsized":"2024-09-21T07:10:44.423098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:15.662211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423495+0000","last_change":"2024-09-21T07:10:43.412631+0000","last_active":"2024-09-21T07:10:44.423495+0000","last_peered":"2024-09-21T07:10:44.423495+0000","last_clean":"2024-09-21T07:10:44.423495+0000","last_became_active":"2024-09-21T07:10:43.412250+0000","last_became_peered":"2024-09-21T07:10:43.412250+0000","last_unstale":"2024-09-21T07:10:44.423495+0000","last_undegraded":"2024-09-21T07:10:44.423495+0000","last_fullsized":"2024-09-21T07:10:44.423495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:40.609307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405073+0000","last_change":"2024-09-21T07:10:42.405955+0000","last_active":"2024-09-21T07:10:44.405073+0000","last_peered":"2024-09-21T07:10:44.405073+0000","last_clean":"2024-09-21T07:10:44.405073+0000","last_became_active":"2024-09-21T07:10:42.405499+0000","last_became_peered":"2024-09-21T07:10:42.405499+0000","last_unstale":"2024-09-21T07:10:44.405073+0000","last_undegraded":"2024-09-21T07:10:44.405073+0000","last_fullsized":"2024-09-21T07:10:44.405073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:11.896704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379646+0000","last_change":"2024-09-21T07:10:43.408372+0000","last_active":"2024-09-21T07:10:47.379646+0000","last_peered":"2024-09-21T07:10:47.379646+0000","last_clean":"2024-09-21T07:10:47.379646+0000","last_became_active":"2024-09-21T07:10:43.407452+0000","last_became_peered":"2024-09-21T07:10:43.407452+0000","last_unstale":"2024-09-21T07:10:47.379646+0000","last_undegraded":"2024-09-21T07:10:47.379646+0000","last_fullsized":"2024-09-21T07:10:47.379646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:08.696212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379139+0000","last_change":"2024-09-21T07:10:42.406082+0000","last_active":"2024-09-21T07:10:47.379139+0000","last_peered":"2024-09-21T07:10:47.379139+0000","last_clean":"2024-09-21T07:10:47.379139+0000","last_became_active":"2024-09-21T07:10:42.405726+0000","last_became_peered":"2024-09-21T07:10:42.405726+0000","last_unstale":"2024-09-21T07:10:47.379139+0000","last_undegraded":"2024-09-21T07:10:47.379139+0000","last_fullsized":"2024-09-21T07:10:47.379139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:21.349501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380329+0000","last_change":"2024-09-21T07:10:43.412104+0000","last_active":"2024-09-21T07:10:47.380329+0000","last_peered":"2024-09-21T07:10:47.380329+0000","last_clean":"2024-09-21T07:10:47.380329+0000","last_became_active":"2024-09-21T07:10:43.411622+0000","last_became_peered":"2024-09-21T07:10:43.411622+0000","last_unstale":"2024-09-21T07:10:47.380329+0000","last_undegraded":"2024-09-21T07:10:47.380329+0000","last_fullsized":"2024-09-21T07:10:47.380329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:37.114753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405248+0000","last_change":"2024-09-21T07:10:42.391724+0000","last_active":"2024-09-21T07:10:44.405248+0000","last_peered":"2024-09-21T07:10:44.405248+0000","last_clean":"2024-09-21T07:10:44.405248+0000","last_became_active":"2024-09-21T07:10:42.391190+0000","last_became_peered":"2024-09-21T07:10:42.391190+0000","last_unstale":"2024-09-21T07:10:44.405248+0000","last_undegraded":"2024-09-21T07:10:44.405248+0000","last_fullsized":"2024-09-21T07:10:44.405248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:04.908220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380620+0000","last_change":"2024-09-21T07:10:43.420199+0000","last_active":"2024-09-21T07:10:47.380620+0000","last_peered":"2024-09-21T07:10:47.380620+0000","last_clean":"2024-09-21T07:10:47.380620+0000","last_became_active":"2024-09-21T07:10:43.418363+0000","last_became_peered":"2024-09-21T07:10:43.418363+0000","last_unstale":"2024-09-21T07:10:47.380620+0000","last_undegraded":"2024-09-21T07:10:47.380620+0000","last_fullsized":"2024-09-21T07:10:47.380620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:05.987550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404730+0000","last_change":"2024-09-21T07:10:42.410464+0000","last_active":"2024-09-21T07:10:44.404730+0000","last_peered":"2024-09-21T07:10:44.404730+0000","last_clean":"2024-09-21T07:10:44.404730+0000","last_became_active":"2024-09-21T07:10:42.410107+0000","last_became_peered":"2024-09-21T07:10:42.410107+0000","last_unstale":"2024-09-21T07:10:44.404730+0000","last_undegraded":"2024-09-21T07:10:44.404730+0000","last_fullsized":"2024-09-21T07:10:44.404730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:31.991591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406480+0000","last_change":"2024-09-21T07:10:43.418911+0000","last_active":"2024-09-21T07:10:44.406480+0000","last_peered":"2024-09-21T07:10:44.406480+0000","last_clean":"2024-09-21T07:10:44.406480+0000","last_became_active":"2024-09-21T07:10:43.418563+0000","last_became_peered":"2024-09-21T07:10:43.418563+0000","last_unstale":"2024-09-21T07:10:44.406480+0000","last_undegraded":"2024-09-21T07:10:44.406480+0000","last_fullsized":"2024-09-21T07:10:44.406480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:18.068383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405257+0000","last_change":"2024-09-21T07:10:42.402258+0000","last_active":"2024-09-21T07:10:44.405257+0000","last_peered":"2024-09-21T07:10:44.405257+0000","last_clean":"2024-09-21T07:10:44.405257+0000","last_became_active":"2024-09-21T07:10:42.401789+0000","last_became_peered":"2024-09-21T07:10:42.401789+0000","last_unstale":"2024-09-21T07:10:44.405257+0000","last_undegraded":"2024-09-21T07:10:44.405257+0000","last_fullsized":"2024-09-21T07:10:44.405257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:21.657184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380075+0000","last_change":"2024-09-21T07:10:43.415279+0000","last_active":"2024-09-21T07:10:47.380075+0000","last_peered":"2024-09-21T07:10:47.380075+0000","last_clean":"2024-09-21T07:10:47.380075+0000","last_became_active":"2024-09-21T07:10:43.414955+0000","last_became_peered":"2024-09-21T07:10:43.414955+0000","last_unstale":"2024-09-21T07:10:47.380075+0000","last_undegraded":"2024-09-21T07:10:47.380075+0000","last_fullsized":"2024-09-21T07:10:47.380075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:26.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379230+0000","last_change":"2024-09-21T07:10:32.034091+0000","last_active":"2024-09-21T07:10:47.379230+0000","last_peered":"2024-09-21T07:10:47.379230+0000","last_clean":"2024-09-21T07:10:47.379230+0000","last_became_active":"2024-09-21T07:10:32.033005+0000","last_became_peered":"2024-09-21T07:10:32.033005+0000","last_unstale":"2024-09-21T07:10:47.379230+0000","last_undegraded":"2024-09-21T07:10:47.379230+0000","last_fullsized":"2024-09-21T07:10:47.379230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_clean_scrub_stamp":"2024-09-21T07:10:31.011167+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:10.064019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406044+0000","last_change":"2024-09-21T07:10:42.402630+0000","last_active":"2024-09-21T07:10:44.406044+0000","last_peered":"2024-09-21T07:10:44.406044+0000","last_clean":"2024-09-21T07:10:44.406044+0000","last_became_active":"2024-09-21T07:10:42.402315+0000","last_became_peered":"2024-09-21T07:10:42.402315+0000","last_unstale":"2024-09-21T07:10:44.406044+0000","last_undegraded":"2024-09-21T07:10:44.406044+0000","last_fullsized":"2024-09-21T07:10:44.406044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:33.518055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378828+0000","last_change":"2024-09-21T07:10:43.414223+0000","last_active":"2024-09-21T07:10:47.378828+0000","last_peered":"2024-09-21T07:10:47.378828+0000","last_clean":"2024-09-21T07:10:47.378828+0000","last_became_active":"2024-09-21T07:10:43.413923+0000","last_became_peered":"2024-09-21T07:10:43.413923+0000","last_unstale":"2024-09-21T07:10:47.378828+0000","last_undegraded":"2024-09-21T07:10:47.378828+0000","last_fullsized":"2024-09-21T07:10:47.378828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:40.609307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378700+0000","last_change":"2024-09-21T07:10:42.411409+0000","last_active":"2024-09-21T07:10:47.378700+0000","last_peered":"2024-09-21T07:10:47.378700+0000","last_clean":"2024-09-21T07:10:47.378700+0000","last_became_active":"2024-09-21T07:10:42.411018+0000","last_became_peered":"2024-09-21T07:10:42.411018+0000","last_unstale":"2024-09-21T07:10:47.378700+0000","last_undegraded":"2024-09-21T07:10:47.378700+0000","last_fullsized":"2024-09-21T07:10:47.378700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:47.174619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378665+0000","last_change":"2024-09-21T07:10:43.396425+0000","last_active":"2024-09-21T07:10:47.378665+0000","last_peered":"2024-09-21T07:10:47.378665+0000","last_clean":"2024-09-21T07:10:47.378665+0000","last_became_active":"2024-09-21T07:10:43.396080+0000","last_became_peered":"2024-09-21T07:10:43.396080+0000","last_unstale":"2024-09-21T07:10:47.378665+0000","last_undegraded":"2024-09-21T07:10:47.378665+0000","last_fullsized":"2024-09-21T07:10:47.378665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:55.907463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405149+0000","last_change":"2024-09-21T07:10:42.391433+0000","last_active":"2024-09-21T07:10:44.405149+0000","last_peered":"2024-09-21T07:10:44.405149+0000","last_clean":"2024-09-21T07:10:44.405149+0000","last_became_active":"2024-09-21T07:10:42.391123+0000","last_became_peered":"2024-09-21T07:10:42.391123+0000","last_unstale":"2024-09-21T07:10:44.405149+0000","last_undegraded":"2024-09-21T07:10:44.405149+0000","last_fullsized":"2024-09-21T07:10:44.405149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:25.948155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404277+0000","last_change":"2024-09-21T07:10:43.419811+0000","last_active":"2024-09-21T07:10:44.404277+0000","last_peered":"2024-09-21T07:10:44.404277+0000","last_clean":"2024-09-21T07:10:44.404277+0000","last_became_active":"2024-09-21T07:10:43.419490+0000","last_became_peered":"2024-09-21T07:10:43.419490+0000","last_unstale":"2024-09-21T07:10:44.404277+0000","last_undegraded":"2024-09-21T07:10:44.404277+0000","last_fullsized":"2024-09-21T07:10:44.404277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:08.183794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406254+0000","last_change":"2024-09-21T07:10:42.407863+0000","last_active":"2024-09-21T07:10:44.406254+0000","last_peered":"2024-09-21T07:10:44.406254+0000","last_clean":"2024-09-21T07:10:44.406254+0000","last_became_active":"2024-09-21T07:10:42.407458+0000","last_became_peered":"2024-09-21T07:10:42.407458+0000","last_unstale":"2024-09-21T07:10:44.406254+0000","last_undegraded":"2024-09-21T07:10:44.406254+0000","last_fullsized":"2024-09-21T07:10:44.406254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:49.720067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379751+0000","last_change":"2024-09-21T07:10:43.404989+0000","last_active":"2024-09-21T07:10:47.379751+0000","last_peered":"2024-09-21T07:10:47.379751+0000","last_clean":"2024-09-21T07:10:47.379751+0000","last_became_active":"2024-09-21T07:10:43.404366+0000","last_became_peered":"2024-09-21T07:10:43.404366+0000","last_unstale":"2024-09-21T07:10:47.379751+0000","last_undegraded":"2024-09-21T07:10:47.379751+0000","last_fullsized":"2024-09-21T07:10:47.379751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:47.584490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404434+0000","last_change":"2024-09-21T07:10:42.407164+0000","last_active":"2024-09-21T07:10:44.404434+0000","last_peered":"2024-09-21T07:10:44.404434+0000","last_clean":"2024-09-21T07:10:44.404434+0000","last_became_active":"2024-09-21T07:10:42.406833+0000","last_became_peered":"2024-09-21T07:10:42.406833+0000","last_unstale":"2024-09-21T07:10:44.404434+0000","last_undegraded":"2024-09-21T07:10:44.404434+0000","last_fullsized":"2024-09-21T07:10:44.404434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:50.661135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406462+0000","last_change":"2024-09-21T07:10:43.415076+0000","last_active":"2024-09-21T07:10:44.406462+0000","last_peered":"2024-09-21T07:10:44.406462+0000","last_clean":"2024-09-21T07:10:44.406462+0000","last_became_active":"2024-09-21T07:10:43.414738+0000","last_became_peered":"2024-09-21T07:10:43.414738+0000","last_unstale":"2024-09-21T07:10:44.406462+0000","last_undegraded":"2024-09-21T07:10:44.406462+0000","last_fullsized":"2024-09-21T07:10:44.406462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:37.114753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380363+0000","last_change":"2024-09-21T07:10:42.411427+0000","last_active":"2024-09-21T07:10:47.380363+0000","last_peered":"2024-09-21T07:10:47.380363+0000","last_clean":"2024-09-21T07:10:47.380363+0000","last_became_active":"2024-09-21T07:10:42.411048+0000","last_became_peered":"2024-09-21T07:10:42.411048+0000","last_unstale":"2024-09-21T07:10:47.380363+0000","last_undegraded":"2024-09-21T07:10:47.380363+0000","last_fullsized":"2024-09-21T07:10:47.380363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:55.046653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404296+0000","last_change":"2024-09-21T07:10:43.416948+0000","last_active":"2024-09-21T07:10:44.404296+0000","last_peered":"2024-09-21T07:10:44.404296+0000","last_clean":"2024-09-21T07:10:44.404296+0000","last_became_active":"2024-09-21T07:10:43.416515+0000","last_became_peered":"2024-09-21T07:10:43.416515+0000","last_unstale":"2024-09-21T07:10:44.404296+0000","last_undegraded":"2024-09-21T07:10:44.404296+0000","last_fullsized":"2024-09-21T07:10:44.404296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:23.952801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:45.334427+0000","last_change":"2024-09-21T07:10:42.408894+0000","last_active":"2024-09-21T07:10:45.334427+0000","last_peered":"2024-09-21T07:10:45.334427+0000","last_clean":"2024-09-21T07:10:45.334427+0000","last_became_active":"2024-09-21T07:10:42.408392+0000","last_became_peered":"2024-09-21T07:10:42.408392+0000","last_unstale":"2024-09-21T07:10:45.334427+0000","last_undegraded":"2024-09-21T07:10:45.334427+0000","last_fullsized":"2024-09-21T07:10:45.334427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:22.386244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379581+0000","last_change":"2024-09-21T07:10:43.413469+0000","last_active":"2024-09-21T07:10:47.379581+0000","last_peered":"2024-09-21T07:10:47.379581+0000","last_clean":"2024-09-21T07:10:47.379581+0000","last_became_active":"2024-09-21T07:10:43.413144+0000","last_became_peered":"2024-09-21T07:10:43.413144+0000","last_unstale":"2024-09-21T07:10:47.379581+0000","last_undegraded":"2024-09-21T07:10:47.379581+0000","last_fullsized":"2024-09-21T07:10:47.379581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:42.566546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423623+0000","last_change":"2024-09-21T07:10:42.408673+0000","last_active":"2024-09-21T07:10:44.423623+0000","last_peered":"2024-09-21T07:10:44.423623+0000","last_clean":"2024-09-21T07:10:44.423623+0000","last_became_active":"2024-09-21T07:10:42.408275+0000","last_became_peered":"2024-09-21T07:10:42.408275+0000","last_unstale":"2024-09-21T07:10:44.423623+0000","last_undegraded":"2024-09-21T07:10:44.423623+0000","last_fullsized":"2024-09-21T07:10:44.423623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:53.210856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379385+0000","last_change":"2024-09-21T07:10:43.419670+0000","last_active":"2024-09-21T07:10:47.379385+0000","last_peered":"2024-09-21T07:10:47.379385+0000","last_clean":"2024-09-21T07:10:47.379385+0000","last_became_active":"2024-09-21T07:10:43.419363+0000","last_became_peered":"2024-09-21T07:10:43.419363+0000","last_unstale":"2024-09-21T07:10:47.379385+0000","last_undegraded":"2024-09-21T07:10:47.379385+0000","last_fullsized":"2024-09-21T07:10:47.379385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:05.776799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378700+0000","last_change":"2024-09-21T07:10:42.412541+0000","last_active":"2024-09-21T07:10:47.378700+0000","last_peered":"2024-09-21T07:10:47.378700+0000","last_clean":"2024-09-21T07:10:47.378700+0000","last_became_active":"2024-09-21T07:10:42.412026+0000","last_became_peered":"2024-09-21T07:10:42.412026+0000","last_unstale":"2024-09-21T07:10:47.378700+0000","last_undegraded":"2024-09-21T07:10:47.378700+0000","last_fullsized":"2024-09-21T07:10:47.378700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:46.578438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379684+0000","last_change":"2024-09-21T07:10:43.414157+0000","last_active":"2024-09-21T07:10:47.379684+0000","last_peered":"2024-09-21T07:10:47.379684+0000","last_clean":"2024-09-21T07:10:47.379684+0000","last_became_active":"2024-09-21T07:10:43.413820+0000","last_became_peered":"2024-09-21T07:10:43.413820+0000","last_unstale":"2024-09-21T07:10:47.379684+0000","last_undegraded":"2024-09-21T07:10:47.379684+0000","last_fullsized":"2024-09-21T07:10:47.379684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:56.052704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404360+0000","last_change":"2024-09-21T07:10:42.412473+0000","last_active":"2024-09-21T07:10:44.404360+0000","last_peered":"2024-09-21T07:10:44.404360+0000","last_clean":"2024-09-21T07:10:44.404360+0000","last_became_active":"2024-09-21T07:10:42.412072+0000","last_became_peered":"2024-09-21T07:10:42.412072+0000","last_unstale":"2024-09-21T07:10:44.404360+0000","last_undegraded":"2024-09-21T07:10:44.404360+0000","last_fullsized":"2024-09-21T07:10:44.404360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:38.817344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378949+0000","last_change":"2024-09-21T07:10:43.413781+0000","last_active":"2024-09-21T07:10:47.378949+0000","last_peered":"2024-09-21T07:10:47.378949+0000","last_clean":"2024-09-21T07:10:47.378949+0000","last_became_active":"2024-09-21T07:10:43.413312+0000","last_became_peered":"2024-09-21T07:10:43.413312+0000","last_unstale":"2024-09-21T07:10:47.378949+0000","last_undegraded":"2024-09-21T07:10:47.378949+0000","last_fullsized":"2024-09-21T07:10:47.378949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:36.925353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404554+0000","last_change":"2024-09-21T07:10:42.409241+0000","last_active":"2024-09-21T07:10:44.404554+0000","last_peered":"2024-09-21T07:10:44.404554+0000","last_clean":"2024-09-21T07:10:44.404554+0000","last_became_active":"2024-09-21T07:10:42.408948+0000","last_became_peered":"2024-09-21T07:10:42.408948+0000","last_unstale":"2024-09-21T07:10:44.404554+0000","last_undegraded":"2024-09-21T07:10:44.404554+0000","last_fullsized":"2024-09-21T07:10:44.404554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:10.457714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378889+0000","last_change":"2024-09-21T07:10:43.410463+0000","last_active":"2024-09-21T07:10:47.378889+0000","last_peered":"2024-09-21T07:10:47.378889+0000","last_clean":"2024-09-21T07:10:47.378889+0000","last_became_active":"2024-09-21T07:10:43.410089+0000","last_became_peered":"2024-09-21T07:10:43.410089+0000","last_unstale":"2024-09-21T07:10:47.378889+0000","last_undegraded":"2024-09-21T07:10:47.378889+0000","last_fullsized":"2024-09-21T07:10:47.378889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:58.082249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380087+0000","last_change":"2024-09-21T07:10:42.408618+0000","last_active":"2024-09-21T07:10:47.380087+0000","last_peered":"2024-09-21T07:10:47.380087+0000","last_clean":"2024-09-21T07:10:47.380087+0000","last_became_active":"2024-09-21T07:10:42.408144+0000","last_became_peered":"2024-09-21T07:10:42.408144+0000","last_unstale":"2024-09-21T07:10:47.380087+0000","last_undegraded":"2024-09-21T07:10:47.380087+0000","last_fullsized":"2024-09-21T07:10:47.380087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:25.985040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423370+0000","last_change":"2024-09-21T07:10:43.404982+0000","last_active":"2024-09-21T07:10:44.423370+0000","last_peered":"2024-09-21T07:10:44.423370+0000","last_clean":"2024-09-21T07:10:44.423370+0000","last_became_active":"2024-09-21T07:10:43.404649+0000","last_became_peered":"2024-09-21T07:10:43.404649+0000","last_unstale":"2024-09-21T07:10:44.423370+0000","last_undegraded":"2024-09-21T07:10:44.423370+0000","last_fullsized":"2024-09-21T07:10:44.423370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:32.944402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406445+0000","last_change":"2024-09-21T07:10:43.410758+0000","last_active":"2024-09-21T07:10:44.406445+0000","last_peered":"2024-09-21T07:10:44.406445+0000","last_clean":"2024-09-21T07:10:44.406445+0000","last_became_active":"2024-09-21T07:10:43.410445+0000","last_became_peered":"2024-09-21T07:10:43.410445+0000","last_unstale":"2024-09-21T07:10:44.406445+0000","last_undegraded":"2024-09-21T07:10:44.406445+0000","last_fullsized":"2024-09-21T07:10:44.406445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:26.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380220+0000","last_change":"2024-09-21T07:10:42.410865+0000","last_active":"2024-09-21T07:10:47.380220+0000","last_peered":"2024-09-21T07:10:47.380220+0000","last_clean":"2024-09-21T07:10:47.380220+0000","last_became_active":"2024-09-21T07:10:42.410458+0000","last_became_peered":"2024-09-21T07:10:42.410458+0000","last_unstale":"2024-09-21T07:10:47.380220+0000","last_undegraded":"2024-09-21T07:10:47.380220+0000","last_fullsized":"2024-09-21T07:10:47.380220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:15.945210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405825+0000","last_change":"2024-09-21T07:10:43.406733+0000","last_active":"2024-09-21T07:10:44.405825+0000","last_peered":"2024-09-21T07:10:44.405825+0000","last_clean":"2024-09-21T07:10:44.405825+0000","last_became_active":"2024-09-21T07:10:43.406364+0000","last_became_peered":"2024-09-21T07:10:43.406364+0000","last_unstale":"2024-09-21T07:10:44.405825+0000","last_undegraded":"2024-09-21T07:10:44.405825+0000","last_fullsized":"2024-09-21T07:10:44.405825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:03.491744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380217+0000","last_change":"2024-09-21T07:10:42.409936+0000","last_active":"2024-09-21T07:10:47.380217+0000","last_peered":"2024-09-21T07:10:47.380217+0000","last_clean":"2024-09-21T07:10:47.380217+0000","last_became_active":"2024-09-21T07:10:42.409492+0000","last_became_peered":"2024-09-21T07:10:42.409492+0000","last_unstale":"2024-09-21T07:10:47.380217+0000","last_undegraded":"2024-09-21T07:10:47.380217+0000","last_fullsized":"2024-09-21T07:10:47.380217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:01.062149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378931+0000","last_change":"2024-09-21T07:10:43.408059+0000","last_active":"2024-09-21T07:10:47.378931+0000","last_peered":"2024-09-21T07:10:47.378931+0000","last_clean":"2024-09-21T07:10:47.378931+0000","last_became_active":"2024-09-21T07:10:43.407707+0000","last_became_peered":"2024-09-21T07:10:43.407707+0000","last_unstale":"2024-09-21T07:10:47.378931+0000","last_undegraded":"2024-09-21T07:10:47.378931+0000","last_fullsized":"2024-09-21T07:10:47.378931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:43.156733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379423+0000","last_change":"2024-09-21T07:10:42.403998+0000","last_active":"2024-09-21T07:10:47.379423+0000","last_peered":"2024-09-21T07:10:47.379423+0000","last_clean":"2024-09-21T07:10:47.379423+0000","last_became_active":"2024-09-21T07:10:42.403552+0000","last_became_peered":"2024-09-21T07:10:42.403552+0000","last_unstale":"2024-09-21T07:10:47.379423+0000","last_undegraded":"2024-09-21T07:10:47.379423+0000","last_fullsized":"2024-09-21T07:10:47.379423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:33.377412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379176+0000","last_change":"2024-09-21T07:10:43.411885+0000","last_active":"2024-09-21T07:10:47.379176+0000","last_peered":"2024-09-21T07:10:47.379176+0000","last_clean":"2024-09-21T07:10:47.379176+0000","last_became_active":"2024-09-21T07:10:43.410907+0000","last_became_peered":"2024-09-21T07:10:43.410907+0000","last_unstale":"2024-09-21T07:10:47.379176+0000","last_undegraded":"2024-09-21T07:10:47.379176+0000","last_fullsized":"2024-09-21T07:10:47.379176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:04.920178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379513+0000","last_change":"2024-09-21T07:10:42.408992+0000","last_active":"2024-09-21T07:10:47.379513+0000","last_peered":"2024-09-21T07:10:47.379513+0000","last_clean":"2024-09-21T07:10:47.379513+0000","last_became_active":"2024-09-21T07:10:42.408041+0000","last_became_peered":"2024-09-21T07:10:42.408041+0000","last_unstale":"2024-09-21T07:10:47.379513+0000","last_undegraded":"2024-09-21T07:10:47.379513+0000","last_fullsized":"2024-09-21T07:10:47.379513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:36.986751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":664069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":74731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":212992,"data_stored":73209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":73245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":73119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":221184,"data_stored":74731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":217088,"data_stored":73279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36144,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335696,"statfs":{"total":96636764160,"available":96599752704,"internally_reserved":0,"allocated":815104,"data_stored":664125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:10:52.343 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:10:52.343 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-21T07:10:52.343 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T07:10:52.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.495+0000 7f22434f4640 1 -- 172.21.15.18:0/2769866923 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f223c15c520 msgr2=0x7f223c0d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:52.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.495+0000 7f22434f4640 1 --2- 172.21.15.18:0/2769866923 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f223c15c520 0x7f223c0d3040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f22300098e0 tx=0x7f223002a5d0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.495+0000 7f22434f4640 1 -- 172.21.15.18:0/2769866923 shutdown_connections 2024-09-21T07:10:52.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.495+0000 7f22434f4640 1 --2- 172.21.15.18:0/2769866923 >> v2:172.21.15.49:3300/0 conn(0x7f223c0d3580 0x7f223c162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.495+0000 7f22434f4640 1 --2- 172.21.15.18:0/2769866923 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f223c15c520 0x7f223c0d3040 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.495+0000 7f22434f4640 1 -- 172.21.15.18:0/2769866923 >> 172.21.15.18:0/2769866923 conn(0x7f223c073f30 msgr2=0x7f223c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:52.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.495+0000 7f22434f4640 1 -- 172.21.15.18:0/2769866923 shutdown_connections 2024-09-21T07:10:52.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.495+0000 7f22434f4640 1 -- 172.21.15.18:0/2769866923 wait complete. 2024-09-21T07:10:52.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.497+0000 7f22434f4640 1 Processor -- start 2024-09-21T07:10:52.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.497+0000 7f22434f4640 1 -- start start 2024-09-21T07:10:52.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.498+0000 7f22434f4640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f223c0d3580 0x7f223c0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:52.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.498+0000 7f22434f4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f223c15c520 0x7f223c159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:52.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.498+0000 7f22434f4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f223c15ef50 0x7f223c0acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:52.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.498+0000 7f22434f4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f223c0d11a0 con 0x7f223c15ef50 2024-09-21T07:10:52.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.498+0000 7f22434f4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f223c0d1020 con 0x7f223c15c520 2024-09-21T07:10:52.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.498+0000 7f22434f4640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f223c0d1320 con 0x7f223c0d3580 2024-09-21T07:10:52.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.498+0000 7f2241a91640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f223c15ef50 0x7f223c0acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:52.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.498+0000 7f2241a91640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f223c15ef50 0x7f223c0acf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50030/0 (socket says 172.21.15.18:50030) 2024-09-21T07:10:52.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.498+0000 7f2241a91640 1 -- 172.21.15.18:0/3224539117 learned_addr learned my addr 172.21.15.18:0/3224539117 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:52.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.498+0000 7f2241290640 1 --2- 172.21.15.18:0/3224539117 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f223c0d3580 0x7f223c0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:52.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.498+0000 7f2240a8f640 1 --2- 172.21.15.18:0/3224539117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f223c15c520 0x7f223c159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:52.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.499+0000 7f2241a91640 1 -- 172.21.15.18:0/3224539117 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f223c0d3580 msgr2=0x7f223c0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:52.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.499+0000 7f2241a91640 1 --2- 172.21.15.18:0/3224539117 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f223c0d3580 0x7f223c0cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.499+0000 7f2241a91640 1 -- 172.21.15.18:0/3224539117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f223c15c520 msgr2=0x7f223c159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:52.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.499+0000 7f2241a91640 1 --2- 172.21.15.18:0/3224539117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f223c15c520 0x7f223c159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.499+0000 7f2241a91640 1 -- 172.21.15.18:0/3224539117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c0cb860 con 0x7f223c15ef50 2024-09-21T07:10:52.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.499+0000 7f2241a91640 1 --2- 172.21.15.18:0/3224539117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f223c15ef50 0x7f223c0acf00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f223400e6a0 tx=0x7f223400eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:52.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.499+0000 7f2239ffb640 1 -- 172.21.15.18:0/3224539117 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223400cab0 con 0x7f223c15ef50 2024-09-21T07:10:52.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.499+0000 7f2239ffb640 1 -- 172.21.15.18:0/3224539117 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f223400cc50 con 0x7f223c15ef50 2024-09-21T07:10:52.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.499+0000 7f22434f4640 1 -- 172.21.15.18:0/3224539117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223c0cbb40 con 0x7f223c15ef50 2024-09-21T07:10:52.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.499+0000 7f2239ffb640 1 -- 172.21.15.18:0/3224539117 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2234005280 con 0x7f223c15ef50 2024-09-21T07:10:52.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.499+0000 7f22434f4640 1 -- 172.21.15.18:0/3224539117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f223c0cc100 con 0x7f223c15ef50 2024-09-21T07:10:52.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.500+0000 7f22434f4640 1 -- 172.21.15.18:0/3224539117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f223c0ce240 con 0x7f223c15ef50 2024-09-21T07:10:52.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.501+0000 7f2239ffb640 1 -- 172.21.15.18:0/3224539117 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2234005420 con 0x7f223c15ef50 2024-09-21T07:10:52.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.502+0000 7f2239ffb640 1 --2- 172.21.15.18:0/3224539117 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2228078bc0 0x7f222807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:52.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.502+0000 7f2239ffb640 1 -- 172.21.15.18:0/3224539117 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f223409b5c0 con 0x7f223c15ef50 2024-09-21T07:10:52.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.502+0000 7f2241290640 1 --2- 172.21.15.18:0/3224539117 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2228078bc0 0x7f222807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:52.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.503+0000 7f2241290640 1 --2- 172.21.15.18:0/3224539117 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2228078bc0 0x7f222807b0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f222c001e20 tx=0x7f222c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:52.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.506+0000 7f2239ffb640 1 -- 172.21.15.18:0/3224539117 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f223400ce20 con 0x7f223c15ef50 2024-09-21T07:10:52.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.697+0000 7f22434f4640 1 -- 172.21.15.18:0/3224539117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f223c0d17d0 con 0x7f223c15ef50 2024-09-21T07:10:52.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.697+0000 7f2239ffb640 1 -- 172.21.15.18:0/3224539117 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7f2234063320 con 0x7f223c15ef50 2024-09-21T07:10:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:52.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.699+0000 7f22434f4640 1 -- 172.21.15.18:0/3224539117 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2228078bc0 msgr2=0x7f222807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:52.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.699+0000 7f22434f4640 1 --2- 172.21.15.18:0/3224539117 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2228078bc0 0x7f222807b0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f222c001e20 tx=0x7f222c009040 comp rx=0 tx=0).stop 2024-09-21T07:10:52.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.699+0000 7f22434f4640 1 -- 172.21.15.18:0/3224539117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f223c15ef50 msgr2=0x7f223c0acf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:52.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.699+0000 7f22434f4640 1 --2- 172.21.15.18:0/3224539117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f223c15ef50 0x7f223c0acf00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f223400e6a0 tx=0x7f223400eb60 comp rx=0 tx=0).stop 2024-09-21T07:10:52.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.699+0000 7f22434f4640 1 -- 172.21.15.18:0/3224539117 shutdown_connections 2024-09-21T07:10:52.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.699+0000 7f22434f4640 1 --2- 172.21.15.18:0/3224539117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f223c15ef50 0x7f223c0acf00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.699+0000 7f22434f4640 1 --2- 172.21.15.18:0/3224539117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f223c15c520 0x7f223c159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.699+0000 7f22434f4640 1 --2- 172.21.15.18:0/3224539117 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2228078bc0 0x7f222807b0d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.699+0000 7f22434f4640 1 --2- 172.21.15.18:0/3224539117 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f223c0d3580 0x7f223c0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.699+0000 7f22434f4640 1 -- 172.21.15.18:0/3224539117 >> 172.21.15.18:0/3224539117 conn(0x7f223c073f30 msgr2=0x7f223c15e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:52.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.699+0000 7f22434f4640 1 -- 172.21.15.18:0/3224539117 shutdown_connections 2024-09-21T07:10:52.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.699+0000 7f22434f4640 1 -- 172.21.15.18:0/3224539117 wait complete. 2024-09-21T07:10:52.713 INFO:teuthology.orchestra.run.smithi018.stdout:[{"version":31,"timestamp":"2024-09-21T07:10:30.182448+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"5743.162027"}]}] 2024-09-21T07:10:52.714 INFO:tasks.ceph_manager:config epoch is 31 2024-09-21T07:10:52.714 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T07:10:52.714 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T07:10:52.714 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T07:10:52.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.841+0000 7f7147294640 1 -- 172.21.15.18:0/2352209736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71400709b0 msgr2=0x7f714015d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:52.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.841+0000 7f7147294640 1 --2- 172.21.15.18:0/2352209736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71400709b0 0x7f714015d0f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7140073900 tx=0x7f713802a8b0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.841+0000 7f7147294640 1 -- 172.21.15.18:0/2352209736 shutdown_connections 2024-09-21T07:10:52.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.841+0000 7f7147294640 1 --2- 172.21.15.18:0/2352209736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71400709b0 0x7f714015d0f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.841+0000 7f7147294640 1 --2- 172.21.15.18:0/2352209736 >> v2:172.21.15.49:3300/0 conn(0x7f71400afe70 0x7f7140070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.841+0000 7f7147294640 1 -- 172.21.15.18:0/2352209736 >> 172.21.15.18:0/2352209736 conn(0x7f714009ba60 msgr2=0x7f71400b78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:52.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.842+0000 7f7147294640 1 -- 172.21.15.18:0/2352209736 shutdown_connections 2024-09-21T07:10:52.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.842+0000 7f7147294640 1 -- 172.21.15.18:0/2352209736 wait complete. 2024-09-21T07:10:52.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.843+0000 7f7147294640 1 Processor -- start 2024-09-21T07:10:52.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.843+0000 7f7147294640 1 -- start start 2024-09-21T07:10:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f7147294640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f71400709b0 0x7f71401f5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f7147294640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71400afe70 0x7f714015b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f7147294640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71400b6a00 0x7f714015bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f7147294640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f714015d630 con 0x7f71400afe70 2024-09-21T07:10:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f7147294640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7140070fd0 con 0x7f71400b6a00 2024-09-21T07:10:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f7147294640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f714015d7b0 con 0x7f71400709b0 2024-09-21T07:10:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f714482f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71400afe70 0x7f714015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f714482f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71400afe70 0x7f714015b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50058/0 (socket says 172.21.15.18:50058) 2024-09-21T07:10:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f714482f640 1 -- 172.21.15.18:0/2054681050 learned_addr learned my addr 172.21.15.18:0/2054681050 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f7145030640 1 --2- 172.21.15.18:0/2054681050 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f71400709b0 0x7f71401f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f7145831640 1 --2- 172.21.15.18:0/2054681050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71400b6a00 0x7f714015bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f714482f640 1 -- 172.21.15.18:0/2054681050 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f71400709b0 msgr2=0x7f71401f5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f714482f640 1 --2- 172.21.15.18:0/2054681050 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f71400709b0 0x7f71401f5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f714482f640 1 -- 172.21.15.18:0/2054681050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71400b6a00 msgr2=0x7f714015bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f714482f640 1 --2- 172.21.15.18:0/2054681050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71400b6a00 0x7f714015bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f714482f640 1 -- 172.21.15.18:0/2054681050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7140157f90 con 0x7f71400afe70 2024-09-21T07:10:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f714482f640 1 --2- 172.21.15.18:0/2054681050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71400afe70 0x7f714015b650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f713000d740 tx=0x7f713000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.845+0000 7f7135ffb640 1 -- 172.21.15.18:0/2054681050 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7130017070 con 0x7f71400afe70 2024-09-21T07:10:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.846+0000 7f7135ffb640 1 -- 172.21.15.18:0/2054681050 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7130009d20 con 0x7f71400afe70 2024-09-21T07:10:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.846+0000 7f7147294640 1 -- 172.21.15.18:0/2054681050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7140158270 con 0x7f71400afe70 2024-09-21T07:10:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.846+0000 7f7135ffb640 1 -- 172.21.15.18:0/2054681050 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71300106c0 con 0x7f71400afe70 2024-09-21T07:10:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.846+0000 7f7147294640 1 -- 172.21.15.18:0/2054681050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7140158830 con 0x7f71400afe70 2024-09-21T07:10:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.847+0000 7f7147294640 1 -- 172.21.15.18:0/2054681050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f714015dc60 con 0x7f71400afe70 2024-09-21T07:10:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.847+0000 7f7135ffb640 1 -- 172.21.15.18:0/2054681050 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f713001a070 con 0x7f71400afe70 2024-09-21T07:10:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.848+0000 7f7135ffb640 1 --2- 172.21.15.18:0/2054681050 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7124078b90 0x7f712407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.848+0000 7f7135ffb640 1 -- 172.21.15.18:0/2054681050 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f713009ae30 con 0x7f71400afe70 2024-09-21T07:10:52.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.848+0000 7f7145030640 1 --2- 172.21.15.18:0/2054681050 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7124078b90 0x7f712407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:52.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.849+0000 7f7145030640 1 --2- 172.21.15.18:0/2054681050 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7124078b90 0x7f712407b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f713c000f60 tx=0x7f713c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:52.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:52.852+0000 7f7135ffb640 1 -- 172.21.15.18:0/2054681050 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7130062c20 con 0x7f71400afe70 2024-09-21T07:10:53.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.089+0000 7f7147294640 1 -- 172.21.15.18:0/2054681050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f7140072200 con 0x7f71400afe70 2024-09-21T07:10:53.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.092+0000 7f7135ffb640 1 -- 172.21.15.18:0/2054681050 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194715 (secure 0 0 0) 0x7f7130067650 con 0x7f71400afe70 2024-09-21T07:10:53.097 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.096+0000 7f7147294640 1 -- 172.21.15.18:0/2054681050 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7124078b90 msgr2=0x7f712407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.096+0000 7f7147294640 1 --2- 172.21.15.18:0/2054681050 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7124078b90 0x7f712407b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f713c000f60 tx=0x7f713c009040 comp rx=0 tx=0).stop 2024-09-21T07:10:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.096+0000 7f7147294640 1 -- 172.21.15.18:0/2054681050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71400afe70 msgr2=0x7f714015b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.096+0000 7f7147294640 1 --2- 172.21.15.18:0/2054681050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71400afe70 0x7f714015b650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f713000d740 tx=0x7f713000dc00 comp rx=0 tx=0).stop 2024-09-21T07:10:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.096+0000 7f7147294640 1 -- 172.21.15.18:0/2054681050 shutdown_connections 2024-09-21T07:10:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.096+0000 7f7147294640 1 --2- 172.21.15.18:0/2054681050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71400b6a00 0x7f714015bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.096+0000 7f7147294640 1 --2- 172.21.15.18:0/2054681050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71400afe70 0x7f714015b650 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.096+0000 7f7147294640 1 --2- 172.21.15.18:0/2054681050 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7124078b90 0x7f712407b0a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.096+0000 7f7147294640 1 --2- 172.21.15.18:0/2054681050 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f71400709b0 0x7f71401f5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.096+0000 7f7147294640 1 -- 172.21.15.18:0/2054681050 >> 172.21.15.18:0/2054681050 conn(0x7f714009ba60 msgr2=0x7f71400b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:53.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.096+0000 7f7147294640 1 -- 172.21.15.18:0/2054681050 shutdown_connections 2024-09-21T07:10:53.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.096+0000 7f7147294640 1 -- 172.21.15.18:0/2054681050 wait complete. 2024-09-21T07:10:53.109 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":5,"flags":0,"active_gid":4114,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":1123180713},{"type":"v1","addr":"172.21.15.49:6801","nonce":1123180713}]},"active_addr":"172.21.15.49:6801/1123180713","active_change":"2024-09-21T07:10:22.304763+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":1103718347}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":4192866826}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":1828215717}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":2511844487}]}]} 2024-09-21T07:10:53.113 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T07:10:53.113 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T07:10:53.113 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:10:53.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.226+0000 7f2792a94640 1 -- 172.21.15.18:0/3879908825 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f278c070b80 msgr2=0x7f278c15d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:53.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.226+0000 7f2792a94640 1 --2- 172.21.15.18:0/3879908825 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f278c070b80 0x7f278c15d0f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2784009be0 tx=0x7f278402a8b0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.227+0000 7f2792a94640 1 -- 172.21.15.18:0/3879908825 shutdown_connections 2024-09-21T07:10:53.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.227+0000 7f2792a94640 1 --2- 172.21.15.18:0/3879908825 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f278c070b80 0x7f278c15d0f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.227+0000 7f2792a94640 1 -- 172.21.15.18:0/3879908825 >> 172.21.15.18:0/3879908825 conn(0x7f278c09ba60 msgr2=0x7f278c0b78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:53.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.227+0000 7f2792a94640 1 -- 172.21.15.18:0/3879908825 shutdown_connections 2024-09-21T07:10:53.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.227+0000 7f2792a94640 1 -- 172.21.15.18:0/3879908825 wait complete. 2024-09-21T07:10:53.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.228+0000 7f2792a94640 1 Processor -- start 2024-09-21T07:10:53.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.228+0000 7f2792a94640 1 -- start start 2024-09-21T07:10:53.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2792a94640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f278c070b80 0x7f278c1586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:53.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2792a94640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c0afe70 0x7f278c1f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:53.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2792a94640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f278c0b6a00 0x7f278c1f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:53.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2792a94640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f278c15d7b0 con 0x7f278c070b80 2024-09-21T07:10:53.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2792a94640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f278c15d630 con 0x7f278c0afe70 2024-09-21T07:10:53.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2792a94640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f278c15d930 con 0x7f278c0b6a00 2024-09-21T07:10:53.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2790830640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f278c070b80 0x7f278c1586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:53.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2790830640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f278c070b80 0x7f278c1586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50062/0 (socket says 172.21.15.18:50062) 2024-09-21T07:10:53.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2790830640 1 -- 172.21.15.18:0/3724196048 learned_addr learned my addr 172.21.15.18:0/3724196048 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2791031640 1 --2- 172.21.15.18:0/3724196048 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f278c0b6a00 0x7f278c1f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f278bfff640 1 --2- 172.21.15.18:0/3724196048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c0afe70 0x7f278c1f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2790830640 1 -- 172.21.15.18:0/3724196048 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f278c0b6a00 msgr2=0x7f278c1f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2790830640 1 --2- 172.21.15.18:0/3724196048 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f278c0b6a00 0x7f278c1f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2790830640 1 -- 172.21.15.18:0/3724196048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c0afe70 msgr2=0x7f278c1f0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2790830640 1 --2- 172.21.15.18:0/3724196048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c0afe70 0x7f278c1f0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2790830640 1 -- 172.21.15.18:0/3724196048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c158c20 con 0x7f278c070b80 2024-09-21T07:10:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f278bfff640 1 --2- 172.21.15.18:0/3724196048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c0afe70 0x7f278c1f0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:10:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.230+0000 7f2790830640 1 --2- 172.21.15.18:0/3724196048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f278c070b80 0x7f278c1586e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f278000c660 tx=0x7f278000cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.231+0000 7f27897fa640 1 -- 172.21.15.18:0/3724196048 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780016020 con 0x7f278c070b80 2024-09-21T07:10:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.231+0000 7f27897fa640 1 -- 172.21.15.18:0/3724196048 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f278000a930 con 0x7f278c070b80 2024-09-21T07:10:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.231+0000 7f2792a94640 1 -- 172.21.15.18:0/3724196048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278c159f90 con 0x7f278c070b80 2024-09-21T07:10:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.231+0000 7f27897fa640 1 -- 172.21.15.18:0/3724196048 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278000ce60 con 0x7f278c070b80 2024-09-21T07:10:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.231+0000 7f2792a94640 1 -- 172.21.15.18:0/3724196048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f278c1591d0 con 0x7f278c070b80 2024-09-21T07:10:53.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.232+0000 7f2792a94640 1 -- 172.21.15.18:0/3724196048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f278c15d0f0 con 0x7f278c070b80 2024-09-21T07:10:53.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.233+0000 7f27897fa640 1 -- 172.21.15.18:0/3724196048 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2780019020 con 0x7f278c070b80 2024-09-21T07:10:53.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.233+0000 7f27897fa640 1 --2- 172.21.15.18:0/3724196048 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2770078b90 0x7f277007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:53.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.233+0000 7f27897fa640 1 -- 172.21.15.18:0/3724196048 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f278009ad00 con 0x7f278c070b80 2024-09-21T07:10:53.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.233+0000 7f278bfff640 1 --2- 172.21.15.18:0/3724196048 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2770078b90 0x7f277007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:53.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.234+0000 7f278bfff640 1 --2- 172.21.15.18:0/3724196048 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2770078b90 0x7f277007b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2778007fd0 tx=0x7f2778009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:53.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.238+0000 7f27897fa640 1 -- 172.21.15.18:0/3724196048 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2780020020 con 0x7f278c070b80 2024-09-21T07:10:53.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.427+0000 7f2792a94640 1 -- 172.21.15.18:0/3724196048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f278c15ebb0 con 0x7f278c070b80 2024-09-21T07:10:53.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.428+0000 7f27897fa640 1 -- 172.21.15.18:0/3724196048 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f27800631d0 con 0x7f278c070b80 2024-09-21T07:10:53.431 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:53.431 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:10:44.397635+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:40.463042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:41.734661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:10:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.431+0000 7f2792a94640 1 -- 172.21.15.18:0/3724196048 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2770078b90 msgr2=0x7f277007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.431+0000 7f2792a94640 1 --2- 172.21.15.18:0/3724196048 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2770078b90 0x7f277007b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2778007fd0 tx=0x7f2778009040 comp rx=0 tx=0).stop 2024-09-21T07:10:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.431+0000 7f2792a94640 1 -- 172.21.15.18:0/3724196048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f278c070b80 msgr2=0x7f278c1586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.431+0000 7f2792a94640 1 --2- 172.21.15.18:0/3724196048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f278c070b80 0x7f278c1586e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f278000c660 tx=0x7f278000cb20 comp rx=0 tx=0).stop 2024-09-21T07:10:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.431+0000 7f2792a94640 1 -- 172.21.15.18:0/3724196048 shutdown_connections 2024-09-21T07:10:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.431+0000 7f2792a94640 1 --2- 172.21.15.18:0/3724196048 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2770078b90 0x7f277007b0a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.431+0000 7f2792a94640 1 --2- 172.21.15.18:0/3724196048 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f278c0b6a00 0x7f278c1f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.431+0000 7f2792a94640 1 --2- 172.21.15.18:0/3724196048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c0afe70 0x7f278c1f0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.431+0000 7f2792a94640 1 --2- 172.21.15.18:0/3724196048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f278c070b80 0x7f278c1586e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.431+0000 7f2792a94640 1 -- 172.21.15.18:0/3724196048 >> 172.21.15.18:0/3724196048 conn(0x7f278c09ba60 msgr2=0x7f278c0d2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.431+0000 7f2792a94640 1 -- 172.21.15.18:0/3724196048 shutdown_connections 2024-09-21T07:10:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.431+0000 7f2792a94640 1 -- 172.21.15.18:0/3724196048 wait complete. 2024-09-21T07:10:53.445 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T07:10:53.445 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:10:53.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.558+0000 7f223f139640 1 -- 172.21.15.18:0/1836956068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f223815ef50 msgr2=0x7f223815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:53.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.558+0000 7f223f139640 1 --2- 172.21.15.18:0/1836956068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f223815ef50 0x7f223815c520 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f22380d1fb0 tx=0x7f222c02a5f0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.558+0000 7f223f139640 1 -- 172.21.15.18:0/1836956068 shutdown_connections 2024-09-21T07:10:53.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.558+0000 7f223f139640 1 --2- 172.21.15.18:0/1836956068 >> v2:172.21.15.49:3300/0 conn(0x7f22380cef70 0x7f22380d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.558+0000 7f223f139640 1 --2- 172.21.15.18:0/1836956068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f223815ef50 0x7f223815c520 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.558+0000 7f223f139640 1 -- 172.21.15.18:0/1836956068 >> 172.21.15.18:0/1836956068 conn(0x7f2238073f30 msgr2=0x7f22380b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:53.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.558+0000 7f223f139640 1 -- 172.21.15.18:0/1836956068 shutdown_connections 2024-09-21T07:10:53.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.558+0000 7f223f139640 1 -- 172.21.15.18:0/1836956068 wait complete. 2024-09-21T07:10:53.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.560+0000 7f223f139640 1 Processor -- start 2024-09-21T07:10:53.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.560+0000 7f223f139640 1 -- start start 2024-09-21T07:10:53.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223f139640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22380cef70 0x7f22380abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:53.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223f139640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22380d3580 0x7f223815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:53.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223f139640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f223815ef50 0x7f223815cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:53.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223f139640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22380d1020 con 0x7f22380cef70 2024-09-21T07:10:53.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223f139640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2238163360 con 0x7f22380d3580 2024-09-21T07:10:53.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223f139640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f22380d11a0 con 0x7f223815ef50 2024-09-21T07:10:53.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223ced5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22380cef70 0x7f22380abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:53.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223ced5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22380cef70 0x7f22380abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50088/0 (socket says 172.21.15.18:50088) 2024-09-21T07:10:53.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223ced5640 1 -- 172.21.15.18:0/2142284924 learned_addr learned my addr 172.21.15.18:0/2142284924 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:53.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f2237fff640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22380d3580 0x7f223815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:53.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223d6d6640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f223815ef50 0x7f223815cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:53.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223ced5640 1 -- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f223815ef50 msgr2=0x7f223815cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:53.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223ced5640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f223815ef50 0x7f223815cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223ced5640 1 -- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22380d3580 msgr2=0x7f223815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:53.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223ced5640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22380d3580 0x7f223815a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223ced5640 1 -- 172.21.15.18:0/2142284924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22381f6560 con 0x7f22380cef70 2024-09-21T07:10:53.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f2237fff640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22380d3580 0x7f223815a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:10:53.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223d6d6640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f223815ef50 0x7f223815cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:10:53.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223ced5640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22380cef70 0x7f22380abb10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f222c0099c0 tx=0x7f222c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:53.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f22357fa640 1 -- 172.21.15.18:0/2142284924 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c03e030 con 0x7f22380cef70 2024-09-21T07:10:53.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f22357fa640 1 -- 172.21.15.18:0/2142284924 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f222c0047a0 con 0x7f22380cef70 2024-09-21T07:10:53.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f22357fa640 1 -- 172.21.15.18:0/2142284924 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c035040 con 0x7f22380cef70 2024-09-21T07:10:53.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223f139640 1 -- 172.21.15.18:0/2142284924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22380ccb80 con 0x7f22380cef70 2024-09-21T07:10:53.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.562+0000 7f223f139640 1 -- 172.21.15.18:0/2142284924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22380cd370 con 0x7f22380cef70 2024-09-21T07:10:53.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.563+0000 7f223f139640 1 -- 172.21.15.18:0/2142284924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f223815c520 con 0x7f22380cef70 2024-09-21T07:10:53.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.564+0000 7f22357fa640 1 -- 172.21.15.18:0/2142284924 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f222c041030 con 0x7f22380cef70 2024-09-21T07:10:53.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.565+0000 7f22357fa640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f221c078bc0 0x7f221c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:53.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.565+0000 7f22357fa640 1 -- 172.21.15.18:0/2142284924 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f222c0bb430 con 0x7f22380cef70 2024-09-21T07:10:53.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.565+0000 7f2237fff640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f221c078bc0 0x7f221c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:53.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.566+0000 7f2237fff640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f221c078bc0 0x7f221c07b0d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2224005fd0 tx=0x7f2224005ec0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:53.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.569+0000 7f22357fa640 1 -- 172.21.15.18:0/2142284924 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f222c083900 con 0x7f22380cef70 2024-09-21T07:10:53.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.757+0000 7f223f139640 1 -- 172.21.15.18:0/2142284924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22380b3510 con 0x7f22380cef70 2024-09-21T07:10:53.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.758+0000 7f22357fa640 1 -- 172.21.15.18:0/2142284924 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f222c083200 con 0x7f22380cef70 2024-09-21T07:10:53.761 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:53.761 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:10:44.397635+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:40.463042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:41.734661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:10:53.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.760+0000 7f223f139640 1 -- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f221c078bc0 msgr2=0x7f221c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:53.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.760+0000 7f223f139640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f221c078bc0 0x7f221c07b0d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2224005fd0 tx=0x7f2224005ec0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.760+0000 7f223f139640 1 -- 172.21.15.18:0/2142284924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22380cef70 msgr2=0x7f22380abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:53.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.760+0000 7f223f139640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22380cef70 0x7f22380abb10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f222c0099c0 tx=0x7f222c0039e0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.760+0000 7f223f139640 1 -- 172.21.15.18:0/2142284924 shutdown_connections 2024-09-21T07:10:53.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.760+0000 7f223f139640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f221c078bc0 0x7f221c07b0d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.760+0000 7f223f139640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f223815ef50 0x7f223815cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.760+0000 7f223f139640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22380d3580 0x7f223815a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.760+0000 7f223f139640 1 --2- 172.21.15.18:0/2142284924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22380cef70 0x7f22380abb10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:53.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.760+0000 7f223f139640 1 -- 172.21.15.18:0/2142284924 >> 172.21.15.18:0/2142284924 conn(0x7f2238073f30 msgr2=0x7f223815bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:53.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.760+0000 7f223f139640 1 -- 172.21.15.18:0/2142284924 shutdown_connections 2024-09-21T07:10:53.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:53.760+0000 7f223f139640 1 -- 172.21.15.18:0/2142284924 wait complete. 2024-09-21T07:10:53.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T07:10:53.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T07:10:53.776 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T07:10:53.776 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T07:10:53.776 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T07:10:53.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T07:10:53.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T07:10:53.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T07:10:54.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.001+0000 7ffa44bad640 1 -- 172.21.15.18:0/2563653772 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ffa400743c0 msgr2=0x7ffa400747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.001+0000 7ffa44bad640 1 --2- 172.21.15.18:0/2563653772 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ffa400743c0 0x7ffa400747d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa38005fd0 tx=0x7ffa3802a800 comp rx=0 tx=0).stop 2024-09-21T07:10:54.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.001+0000 7f04fffff640 1 -- 172.21.15.18:0/3351991670 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f05000b52a0 msgr2=0x7f05000af4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.001+0000 7f04fffff640 1 --2- 172.21.15.18:0/3351991670 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f05000b52a0 0x7f05000af4b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009900 tx=0x7f04f402a5d0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.001+0000 7fa18532a640 1 -- 172.21.15.18:0/588088167 <== mon.1 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17802b720 con 0x7fa16c0053a0 2024-09-21T07:10:54.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.001+0000 7ffa44bad640 1 -- 172.21.15.18:0/2563653772 shutdown_connections 2024-09-21T07:10:54.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.001+0000 7ffa44bad640 1 --2- 172.21.15.18:0/2563653772 >> v2:172.21.15.18:3300/0 conn(0x7ffa400cf2c0 0x7ffa400cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.001+0000 7ffa44bad640 1 --2- 172.21.15.18:0/2563653772 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ffa400743c0 0x7ffa400747d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.001+0000 7ffa44bad640 1 -- 172.21.15.18:0/2563653772 >> 172.21.15.18:0/2563653772 conn(0x7ffa400ccd30 msgr2=0x7ffa400cd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.001+0000 7ffa44bad640 1 -- 172.21.15.18:0/2563653772 shutdown_connections 2024-09-21T07:10:54.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.001+0000 7ffa44bad640 1 -- 172.21.15.18:0/2563653772 wait complete. 2024-09-21T07:10:54.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.002+0000 7fa188590640 1 -- 172.21.15.18:0/588088167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa16c0053a0 msgr2=0x7fa16c00ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.002+0000 7fa188590640 1 --2- 172.21.15.18:0/588088167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa16c0053a0 0x7fa16c00ba20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa1800cda90 tx=0x7fa16c005830 comp rx=0 tx=0).stop 2024-09-21T07:10:54.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.002+0000 7fa186b2d640 1 -- 172.21.15.18:0/588088167 reap_dead start 2024-09-21T07:10:54.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.002+0000 7fa188590640 1 -- 172.21.15.18:0/588088167 shutdown_connections 2024-09-21T07:10:54.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.002+0000 7fa188590640 1 -- 172.21.15.18:0/588088167 >> 172.21.15.18:0/588088167 conn(0x7fa1800ccd30 msgr2=0x7fa1800cd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.002+0000 7f04fffff640 1 -- 172.21.15.18:0/3351991670 shutdown_connections 2024-09-21T07:10:54.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.002+0000 7f04fffff640 1 --2- 172.21.15.18:0/3351991670 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f05000b52a0 0x7f05000af4b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.002+0000 7f04fffff640 1 -- 172.21.15.18:0/3351991670 >> 172.21.15.18:0/3351991670 conn(0x7f05000b2030 msgr2=0x7f05000b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.003+0000 7fa188590640 1 -- 172.21.15.18:0/588088167 shutdown_connections 2024-09-21T07:10:54.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.003+0000 7fa188590640 1 -- 172.21.15.18:0/588088167 wait complete. 2024-09-21T07:10:54.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.004+0000 7f04fffff640 1 -- 172.21.15.18:0/3351991670 shutdown_connections 2024-09-21T07:10:54.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.005+0000 7f04fffff640 1 -- 172.21.15.18:0/3351991670 wait complete. 2024-09-21T07:10:54.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.005+0000 7fe1f4835640 1 -- 172.21.15.18:0/4273817622 <== mon.2 v2:172.21.15.49:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0032890 con 0x7fe1f00cf7c0 2024-09-21T07:10:54.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.005+0000 7fe1f6839640 1 -- 172.21.15.18:0/4273817622 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe1f00cf7c0 msgr2=0x7fe1f00b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.005+0000 7fe1f6839640 1 --2- 172.21.15.18:0/4273817622 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe1f00cf7c0 0x7fe1f00b5bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009860 tx=0x7fe1e002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.005+0000 7fe1f6839640 1 -- 172.21.15.18:0/4273817622 shutdown_connections 2024-09-21T07:10:54.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.005+0000 7fe1f6839640 1 --2- 172.21.15.18:0/4273817622 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe1f00cf7c0 0x7fe1f00b5bf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.005+0000 7fe1f6839640 1 -- 172.21.15.18:0/4273817622 >> 172.21.15.18:0/4273817622 conn(0x7fe1f006eda0 msgr2=0x7fe1f00d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.004+0000 7ffa44bad640 1 Processor -- start 2024-09-21T07:10:54.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.005+0000 7ffa44bad640 1 -- start start 2024-09-21T07:10:54.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.006+0000 7fe1f6839640 1 -- 172.21.15.18:0/4273817622 shutdown_connections 2024-09-21T07:10:54.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.006+0000 7fe1f6839640 1 -- 172.21.15.18:0/4273817622 wait complete. 2024-09-21T07:10:54.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.006+0000 7fa188590640 1 Processor -- start 2024-09-21T07:10:54.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.006+0000 7fa188590640 1 -- start start 2024-09-21T07:10:54.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.007+0000 7fa67d1af640 1 -- 172.21.15.18:0/1816728514 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa674003610 con 0x7fa664003aa0 2024-09-21T07:10:54.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.007+0000 7ffa44bad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa400743c0 0x7ffa4009dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.007+0000 7ffa44bad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa400cf2c0 0x7ffa4014a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.007+0000 7fa680415640 1 -- 172.21.15.18:0/1816728514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa664003aa0 msgr2=0x7fa664003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.007+0000 7fa680415640 1 --2- 172.21.15.18:0/1816728514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa664003aa0 0x7fa664003f10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa674006f70 tx=0x7fa664005830 comp rx=0 tx=0).stop 2024-09-21T07:10:54.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.007+0000 7f04fffff640 1 Processor -- start 2024-09-21T07:10:54.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.007+0000 7ffa3dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa400cf2c0 0x7ffa4014a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.007+0000 7ffa3dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa400cf2c0 0x7ffa4014a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50164/0 (socket says 172.21.15.18:50164) 2024-09-21T07:10:54.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.007+0000 7ffa3e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa400743c0 0x7ffa4009dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.007+0000 7ffa3e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa400743c0 0x7ffa4009dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:44438/0 (socket says 172.21.15.18:44438) 2024-09-21T07:10:54.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.007+0000 7ffa3dd9b640 1 -- 172.21.15.18:0/261469647 learned_addr learned my addr 172.21.15.18:0/261469647 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.007+0000 7f8c34a30640 1 -- 172.21.15.18:0/31934311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c3015afa0 msgr2=0x7f8c3015b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7ffa44bad640 1 --2- 172.21.15.18:0/261469647 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ffa400cfc10 0x7ffa40159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7f8c34a30640 1 --2- 172.21.15.18:0/31934311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c3015afa0 0x7f8c3015b3b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8c3006e1b0 tx=0x7f8c2002b1e0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7ffa44bad640 1 -- 172.21.15.18:0/261469647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffa400cc9c0 con 0x7ffa400cf2c0 2024-09-21T07:10:54.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7f8c34a30640 1 -- 172.21.15.18:0/31934311 shutdown_connections 2024-09-21T07:10:54.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7fa680415640 1 -- 172.21.15.18:0/1816728514 shutdown_connections 2024-09-21T07:10:54.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7fa680415640 1 --2- 172.21.15.18:0/1816728514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa664003aa0 0x7fa664003f10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7fa680415640 1 -- 172.21.15.18:0/1816728514 >> 172.21.15.18:0/1816728514 conn(0x7fa67001e230 msgr2=0x7fa670039ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7f8c34a30640 1 --2- 172.21.15.18:0/31934311 >> v2:172.21.15.49:3300/0 conn(0x7f8c300cf460 0x7f8c300cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7f8c34a30640 1 --2- 172.21.15.18:0/31934311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c3015afa0 0x7f8c3015b3b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7f8c34a30640 1 --2- 172.21.15.18:0/31934311 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8c300d0b10 0x7f8c300b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7f8c34a30640 1 -- 172.21.15.18:0/31934311 >> 172.21.15.18:0/31934311 conn(0x7f8c300b1fe0 msgr2=0x7f8c300b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7f28a8f2a640 1 -- 172.21.15.18:0/2186917460 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894031600 con 0x7f28a40b41b0 2024-09-21T07:10:54.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7ffa3ed9d640 1 --2- 172.21.15.18:0/261469647 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ffa400cfc10 0x7ffa40159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7ffa44bad640 1 -- 172.21.15.18:0/261469647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ffa400b5dd0 con 0x7ffa400743c0 2024-09-21T07:10:54.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7ffa44bad640 1 -- 172.21.15.18:0/261469647 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7ffa400ccb40 con 0x7ffa400cfc10 2024-09-21T07:10:54.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7f8c34a30640 1 -- 172.21.15.18:0/31934311 shutdown_connections 2024-09-21T07:10:54.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7f8c34a30640 1 -- 172.21.15.18:0/31934311 wait complete. 2024-09-21T07:10:54.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7f28aaf2e640 1 -- 172.21.15.18:0/2186917460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a40b41b0 msgr2=0x7f28a406f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7f28aaf2e640 1 --2- 172.21.15.18:0/2186917460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a40b41b0 0x7f28a406f7c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2894009800 tx=0x7f289402a410 comp rx=0 tx=0).stop 2024-09-21T07:10:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7ffa3e59c640 1 -- 172.21.15.18:0/261469647 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ffa400cfc10 msgr2=0x7ffa40159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7fe1f6839640 1 Processor -- start 2024-09-21T07:10:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7fa188590640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c0053a0 0x7fa18014bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7ffa3e59c640 1 --2- 172.21.15.18:0/261469647 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ffa400cfc10 0x7ffa40159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7ffa3e59c640 1 -- 172.21.15.18:0/261469647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa400cf2c0 msgr2=0x7ffa4014a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7ffa3e59c640 1 --2- 172.21.15.18:0/261469647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa400cf2c0 0x7ffa4014a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7ffa3e59c640 1 -- 172.21.15.18:0/261469647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4009a3d0 con 0x7ffa400743c0 2024-09-21T07:10:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7ffa3dd9b640 1 --2- 172.21.15.18:0/261469647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa400cf2c0 0x7ffa4014a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7f762d569640 1 -- 172.21.15.18:0/2822878981 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f762815f350 msgr2=0x7f762815f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7f762d569640 1 --2- 172.21.15.18:0/2822878981 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f762815f350 0x7f762815f760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7620005fd0 tx=0x7f762002a820 comp rx=0 tx=0).stop 2024-09-21T07:10:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7fa188590640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa180159650 0x7fa180159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7fa188590640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa180161480 0x7fa180161890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7fa188590640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1800cc9c0 con 0x7fa16c0053a0 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7f762d569640 1 -- 172.21.15.18:0/2822878981 shutdown_connections 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7f762d569640 1 --2- 172.21.15.18:0/2822878981 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f762815f350 0x7f762815f760 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7f762d569640 1 --2- 172.21.15.18:0/2822878981 >> v2:172.21.15.18:3300/0 conn(0x7f76280d1080 0x7f76280d1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7f762d569640 1 -- 172.21.15.18:0/2822878981 >> 172.21.15.18:0/2822878981 conn(0x7f7628073e20 msgr2=0x7f762806cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7fa188590640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa1800b5db0 con 0x7fa180161480 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7fa18632c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c0053a0 0x7fa18014bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7fa188590640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fa1800ccb40 con 0x7fa180159650 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.008+0000 7f04fffff640 1 -- start start 2024-09-21T07:10:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7fe1f6839640 1 -- start start 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7ffa3e59c640 1 --2- 172.21.15.18:0/261469647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa400743c0 0x7ffa4009dc50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa400740f0 tx=0x7ffa38033e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7fa680415640 1 -- 172.21.15.18:0/1816728514 shutdown_connections 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7fa186b2d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa180161480 0x7fa180161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7fa18632c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c0053a0 0x7fa18014bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50170/0 (socket says 172.21.15.18:50170) 2024-09-21T07:10:54.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7fa18632c640 1 -- 172.21.15.18:0/2196245268 learned_addr learned my addr 172.21.15.18:0/2196245268 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7f28aaf2e640 1 -- 172.21.15.18:0/2186917460 shutdown_connections 2024-09-21T07:10:54.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7f28aaf2e640 1 --2- 172.21.15.18:0/2186917460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a40b41b0 0x7f28a406f7c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7f28aaf2e640 1 -- 172.21.15.18:0/2186917460 >> 172.21.15.18:0/2186917460 conn(0x7f28a406d370 msgr2=0x7f28a40b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7fa186b2d640 1 -- 172.21.15.18:0/2196245268 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa180159650 msgr2=0x7fa180159a60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:10:54.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7fa186b2d640 1 --2- 172.21.15.18:0/2196245268 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa180159650 0x7fa180159a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7fa186b2d640 1 -- 172.21.15.18:0/2196245268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c0053a0 msgr2=0x7fa18014bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7fa186b2d640 1 --2- 172.21.15.18:0/2196245268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c0053a0 0x7fa18014bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7fa186b2d640 1 -- 172.21.15.18:0/2196245268 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa180161dd0 con 0x7fa180161480 2024-09-21T07:10:54.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7ffa2effd640 1 -- 172.21.15.18:0/261469647 <== mon.1 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa38042020 con 0x7ffa400743c0 2024-09-21T07:10:54.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7ffa2effd640 1 -- 172.21.15.18:0/261469647 <== mon.1 v2:172.21.15.49:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa38038040 con 0x7ffa400743c0 2024-09-21T07:10:54.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7ffa2effd640 1 -- 172.21.15.18:0/261469647 <== mon.1 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa38037070 con 0x7ffa400743c0 2024-09-21T07:10:54.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7f762d569640 1 -- 172.21.15.18:0/2822878981 shutdown_connections 2024-09-21T07:10:54.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7ffa44bad640 1 -- 172.21.15.18:0/261469647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa4015f2b0 con 0x7ffa400743c0 2024-09-21T07:10:54.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7ffa44bad640 1 -- 172.21.15.18:0/261469647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa4015f850 con 0x7ffa400743c0 2024-09-21T07:10:54.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7f04fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05000b52a0 0x7f05000b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7f04fffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f050016f9d0 0x7f050020a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7f04feffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05000b52a0 0x7f05000b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7f04feffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05000b52a0 0x7f05000b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50186/0 (socket says 172.21.15.18:50186) 2024-09-21T07:10:54.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7f04fffff640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0500161f20 0x7f0500171dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.009+0000 7fa680415640 1 -- 172.21.15.18:0/1816728514 wait complete. 2024-09-21T07:10:54.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.011+0000 7f8c34a30640 1 Processor -- start 2024-09-21T07:10:54.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.011+0000 7f8c34a30640 1 -- start start 2024-09-21T07:10:54.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.011+0000 7ffa2cff9640 1 -- 172.21.15.18:0/261469647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffa18001030 con 0x7ffa400743c0 2024-09-21T07:10:54.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7f04fffff640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f050017ada0 con 0x7f05000b52a0 2024-09-21T07:10:54.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7f04fffff640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f050017ac20 con 0x7f050016f9d0 2024-09-21T07:10:54.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7f04fffff640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f050017af20 con 0x7f0500161f20 2024-09-21T07:10:54.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7f04feffd640 1 -- 172.21.15.18:0/1108488621 learned_addr learned my addr 172.21.15.18:0/1108488621 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7f04fe7fc640 1 --2- 172.21.15.18:0/1108488621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f050016f9d0 0x7f050020a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.011+0000 7f04ff7fe640 1 --2- 172.21.15.18:0/1108488621 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0500161f20 0x7f0500171dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.011+0000 7f04feffd640 1 -- 172.21.15.18:0/1108488621 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0500161f20 msgr2=0x7f0500171dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.011+0000 7f04feffd640 1 --2- 172.21.15.18:0/1108488621 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0500161f20 0x7f0500171dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.011+0000 7f04feffd640 1 -- 172.21.15.18:0/1108488621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f050016f9d0 msgr2=0x7f050020a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.011+0000 7f04feffd640 1 --2- 172.21.15.18:0/1108488621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f050016f9d0 0x7f050020a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.011+0000 7fe1f6839640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f00701e0 0x7fe1f014da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.011+0000 7fe1f6839640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe1f00cf7c0 0x7fe1f00741f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.011+0000 7fe1f5837640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f00701e0 0x7fe1f014da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.011+0000 7fe1f5837640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f00701e0 0x7fe1f014da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50198/0 (socket says 172.21.15.18:50198) 2024-09-21T07:10:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fe1f5837640 1 -- 172.21.15.18:0/4166206107 learned_addr learned my addr 172.21.15.18:0/4166206107 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fa186b2d640 1 --2- 172.21.15.18:0/2196245268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa180161480 0x7fa180161890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa178030000 tx=0x7fa178004bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fe1f6839640 1 --2- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1f014e170 0x7fe1f0074730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fe1f5036640 1 --2- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe1f00cf7c0 0x7fe1f00741f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fe1f6839640 1 -- 172.21.15.18:0/4166206107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f0151c40 con 0x7fe1f00701e0 2024-09-21T07:10:54.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fe1f6839640 1 -- 172.21.15.18:0/4166206107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f0151ac0 con 0x7fe1f014e170 2024-09-21T07:10:54.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fe1f6839640 1 -- 172.21.15.18:0/4166206107 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f00ce6b0 con 0x7fe1f00cf7c0 2024-09-21T07:10:54.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fa176ffd640 1 -- 172.21.15.18:0/2196245268 <== mon.1 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17802bb30 con 0x7fa180161480 2024-09-21T07:10:54.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fe1f6038640 1 --2- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1f014e170 0x7fe1f0074730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fa680415640 1 Processor -- start 2024-09-21T07:10:54.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fe1f5837640 1 -- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe1f00cf7c0 msgr2=0x7fe1f00741f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fe1f5837640 1 --2- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe1f00cf7c0 0x7fe1f00741f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fe1f5837640 1 -- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1f014e170 msgr2=0x7fe1f0074730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fe1f5837640 1 --2- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1f014e170 0x7fe1f0074730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fe1f5837640 1 -- 172.21.15.18:0/4166206107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f00721d0 con 0x7fe1f00701e0 2024-09-21T07:10:54.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.011+0000 7f04feffd640 1 -- 172.21.15.18:0/1108488621 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0500170170 con 0x7f05000b52a0 2024-09-21T07:10:54.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.013+0000 7f28aaf2e640 1 -- 172.21.15.18:0/2186917460 shutdown_connections 2024-09-21T07:10:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.013+0000 7fa680415640 1 -- start start 2024-09-21T07:10:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fe1f5837640 1 --2- 172.21.15.18:0/4166206107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f00701e0 0x7fe1f014da50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1e002a9e0 tx=0x7fe1e0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.013+0000 7f8c34a30640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8c300cf460 0x7f8c3015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.013+0000 7f8c34a30640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c300d0b10 0x7f8c3015d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.013+0000 7f8c34a30640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c3015afa0 0x7f8c301e3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fa188590640 1 -- 172.21.15.18:0/2196245268 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1801fd530 con 0x7fa180161480 2024-09-21T07:10:54.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f8c34a30640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3006ef20 con 0x7f8c3015afa0 2024-09-21T07:10:54.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f8c34a30640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3006eda0 con 0x7f8c300d0b10 2024-09-21T07:10:54.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f8c34a30640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f8c3006f0a0 con 0x7f8c300cf460 2024-09-21T07:10:54.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f8c2e59c640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8c300cf460 0x7f8c3015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f8c2dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c300d0b10 0x7f8c3015d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f8c2e59c640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8c300cf460 0x7f8c3015cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.18:40160/0 (socket says 172.21.15.18:40160) 2024-09-21T07:10:54.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f8c2e59c640 1 -- 172.21.15.18:0/3809113915 learned_addr learned my addr 172.21.15.18:0/3809113915 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7f04feffd640 1 --2- 172.21.15.18:0/1108488621 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05000b52a0 0x7f05000b18b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f04f0001e70 tx=0x7f04f000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.013+0000 7f04e7fff640 1 -- 172.21.15.18:0/1108488621 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f000cd60 con 0x7f05000b52a0 2024-09-21T07:10:54.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.013+0000 7f04e7fff640 1 -- 172.21.15.18:0/1108488621 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04f00050d0 con 0x7f05000b52a0 2024-09-21T07:10:54.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f04e7fff640 1 -- 172.21.15.18:0/1108488621 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f00035f0 con 0x7f05000b52a0 2024-09-21T07:10:54.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.013+0000 7ffa2effd640 1 -- 172.21.15.18:0/261469647 <== mon.1 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffa38045020 con 0x7ffa400743c0 2024-09-21T07:10:54.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.013+0000 7ffa2effd640 1 --2- 172.21.15.18:0/261469647 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ffa20078b90 0x7ffa2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7ffa3dd9b640 1 --2- 172.21.15.18:0/261469647 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ffa20078b90 0x7ffa2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7ffa2effd640 1 -- 172.21.15.18:0/261469647 <== mon.1 v2:172.21.15.49:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ffa380bbd70 con 0x7ffa400743c0 2024-09-21T07:10:54.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f04fffff640 1 -- 172.21.15.18:0/1108488621 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0500170450 con 0x7f05000b52a0 2024-09-21T07:10:54.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fa176ffd640 1 -- 172.21.15.18:0/2196245268 <== mon.1 v2:172.21.15.49:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa17802bcd0 con 0x7fa180161480 2024-09-21T07:10:54.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fa176ffd640 1 -- 172.21.15.18:0/2196245268 <== mon.1 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178006290 con 0x7fa180161480 2024-09-21T07:10:54.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.012+0000 7fa188590640 1 -- 172.21.15.18:0/2196245268 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1801fdaf0 con 0x7fa180161480 2024-09-21T07:10:54.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.013+0000 7fa188590640 1 -- 172.21.15.18:0/2196245268 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa18006b490 con 0x7fa180161480 2024-09-21T07:10:54.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f04fffff640 1 -- 172.21.15.18:0/1108488621 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05002069a0 con 0x7f05000b52a0 2024-09-21T07:10:54.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.013+0000 7fe1e67fc640 1 -- 172.21.15.18:0/4166206107 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e003f020 con 0x7fe1f00701e0 2024-09-21T07:10:54.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.013+0000 7fe1e67fc640 1 -- 172.21.15.18:0/4166206107 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1e00035f0 con 0x7fe1f00701e0 2024-09-21T07:10:54.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7ffa2effd640 1 --2- 172.21.15.18:0/261469647 >> [v2:172.21.15.18:6808/3354774634,v1:172.21.15.18:6809/3354774634] conn(0x7ffa20080e00 0x7ffa20083250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.013+0000 7fe1e67fc640 1 -- 172.21.15.18:0/4166206107 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0037040 con 0x7fe1f00701e0 2024-09-21T07:10:54.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7ffa2effd640 1 -- 172.21.15.18:0/261469647 --> [v2:172.21.15.18:6808/3354774634,v1:172.21.15.18:6809/3354774634] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffa38045ec0 con 0x7ffa20080e00 2024-09-21T07:10:54.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7ffa2effd640 1 -- 172.21.15.18:0/261469647 <== mon.1 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffa380bc160 con 0x7ffa400743c0 2024-09-21T07:10:54.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7ffa3dd9b640 1 --2- 172.21.15.18:0/261469647 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ffa20078b90 0x7ffa2007b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa4015f090 tx=0x7ffa3000b2e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7fe1f6839640 1 -- 172.21.15.18:0/4166206107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f00ae4e0 con 0x7fe1f00701e0 2024-09-21T07:10:54.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7fe1f6839640 1 -- 172.21.15.18:0/4166206107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f00739e0 con 0x7fe1f00701e0 2024-09-21T07:10:54.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7ffa3ed9d640 1 --2- 172.21.15.18:0/261469647 >> [v2:172.21.15.18:6808/3354774634,v1:172.21.15.18:6809/3354774634] conn(0x7ffa20080e00 0x7ffa20083250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f8c2dd9b640 1 -- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8c300cf460 msgr2=0x7f8c3015cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f8c2dd9b640 1 --2- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8c300cf460 0x7f8c3015cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f8c2dd9b640 1 -- 172.21.15.18:0/3809113915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c3015afa0 msgr2=0x7f8c301e3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f8c2dd9b640 1 --2- 172.21.15.18:0/3809113915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c3015afa0 0x7f8c301e3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f8c2dd9b640 1 -- 172.21.15.18:0/3809113915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c3014e670 con 0x7f8c300d0b10 2024-09-21T07:10:54.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.014+0000 7f8c2e59c640 1 --2- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8c300cf460 0x7f8c3015cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:54.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.015+0000 7f8c2dd9b640 1 --2- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c300d0b10 0x7f8c3015d440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8c300b5520 tx=0x7f8c20003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.015+0000 7fa680415640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa664003aa0 0x7fa6700cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.015+0000 7f04fffff640 1 -- 172.21.15.18:0/1108488621 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f050006b490 con 0x7f05000b52a0 2024-09-21T07:10:54.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.015+0000 7fa680415640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa670181860 0x7fa670181c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.015+0000 7fa680415640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa67004c720 0x7fa67004cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.015+0000 7ffa3ed9d640 1 --2- 172.21.15.18:0/261469647 >> [v2:172.21.15.18:6808/3354774634,v1:172.21.15.18:6809/3354774634] conn(0x7ffa20080e00 0x7ffa20083250 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.015+0000 7fa680415640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa670054b10 con 0x7fa670181860 2024-09-21T07:10:54.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.015+0000 7f8c1effd640 1 -- 172.21.15.18:0/3809113915 <== mon.1 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2002bb20 con 0x7f8c300d0b10 2024-09-21T07:10:54.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.015+0000 7fa680415640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa670054990 con 0x7fa67004c720 2024-09-21T07:10:54.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.015+0000 7fa680415640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fa670054c90 con 0x7fa664003aa0 2024-09-21T07:10:54.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.015+0000 7f8c1effd640 1 -- 172.21.15.18:0/3809113915 <== mon.1 v2:172.21.15.49:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c20007c90 con 0x7f8c300d0b10 2024-09-21T07:10:54.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.015+0000 7f8c34a30640 1 -- 172.21.15.18:0/3809113915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c300af600 con 0x7f8c300d0b10 2024-09-21T07:10:54.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.016+0000 7f8c34a30640 1 -- 172.21.15.18:0/3809113915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c300ad7f0 con 0x7f8c300d0b10 2024-09-21T07:10:54.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.016+0000 7fa67e9b2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa67004c720 0x7fa67004cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.013+0000 7f28aaf2e640 1 -- 172.21.15.18:0/2186917460 wait complete. 2024-09-21T07:10:54.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.016+0000 7fa67e1b1640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa664003aa0 0x7fa6700cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.016+0000 7f28aaf2e640 1 Processor -- start 2024-09-21T07:10:54.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.016+0000 7fa67e1b1640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa664003aa0 0x7fa6700cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.18:40164/0 (socket says 172.21.15.18:40164) 2024-09-21T07:10:54.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.016+0000 7f28aaf2e640 1 -- start start 2024-09-21T07:10:54.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.016+0000 7f8c1effd640 1 -- 172.21.15.18:0/3809113915 <== mon.1 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20005280 con 0x7f8c300d0b10 2024-09-21T07:10:54.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.016+0000 7fa176ffd640 1 -- 172.21.15.18:0/2196245268 <== mon.1 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa178006430 con 0x7fa180161480 2024-09-21T07:10:54.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.010+0000 7f762d569640 1 -- 172.21.15.18:0/2822878981 wait complete. 2024-09-21T07:10:54.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.015+0000 7f762d569640 1 Processor -- start 2024-09-21T07:10:54.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.015+0000 7f762d569640 1 -- start start 2024-09-21T07:10:54.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.016+0000 7fa67e9b2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa67004c720 0x7fa67004cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:44498/0 (socket says 172.21.15.18:44498) 2024-09-21T07:10:54.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.016+0000 7fa67e9b2640 1 -- 172.21.15.18:0/1825823650 learned_addr learned my addr 172.21.15.18:0/1825823650 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.016+0000 7ffa2effd640 1 -- 172.21.15.18:0/261469647 <== osd.0 v2:172.21.15.18:6808/3354774634 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffa38045ec0 con 0x7ffa20080e00 2024-09-21T07:10:54.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.017+0000 7fa67e9b2640 1 -- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa664003aa0 msgr2=0x7fa6700cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.017+0000 7fa176ffd640 1 --2- 172.21.15.18:0/2196245268 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa164078b90 0x7fa16407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.017+0000 7fa176ffd640 1 -- 172.21.15.18:0/2196245268 <== mon.1 v2:172.21.15.49:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa1780bb550 con 0x7fa180161480 2024-09-21T07:10:54.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.017+0000 7fa176ffd640 1 --2- 172.21.15.18:0/2196245268 >> [v2:172.21.15.49:6818/1945709510,v1:172.21.15.49:6819/1945709510] conn(0x7fa164080e60 0x7fa1640832b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.017+0000 7fa176ffd640 1 -- 172.21.15.18:0/2196245268 --> [v2:172.21.15.49:6818/1945709510,v1:172.21.15.49:6819/1945709510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa164083980 con 0x7fa164080e60 2024-09-21T07:10:54.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.017+0000 7fa176ffd640 1 -- 172.21.15.18:0/2196245268 <== mon.1 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa1780bb940 con 0x7fa180161480 2024-09-21T07:10:54.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.017+0000 7fa67e9b2640 1 --2- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa664003aa0 0x7fa6700cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.017+0000 7fa67e9b2640 1 -- 172.21.15.18:0/1825823650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa670181860 msgr2=0x7fa670181c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.017+0000 7fa18632c640 1 --2- 172.21.15.18:0/2196245268 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa164078b90 0x7fa16407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.017+0000 7fa67e9b2640 1 --2- 172.21.15.18:0/1825823650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa670181860 0x7fa670181c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.017+0000 7fa67e9b2640 1 -- 172.21.15.18:0/1825823650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6700d1a00 con 0x7fa67004c720 2024-09-21T07:10:54.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.017+0000 7fa185b2b640 1 --2- 172.21.15.18:0/2196245268 >> [v2:172.21.15.49:6818/1945709510,v1:172.21.15.49:6819/1945709510] conn(0x7fa164080e60 0x7fa1640832b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7f8c34a30640 1 -- 172.21.15.18:0/3809113915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c3006b490 con 0x7f8c300d0b10 2024-09-21T07:10:54.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7f762d569640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f76280b38b0 0x7f76280cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.017+0000 7fe1f6839640 1 -- 172.21.15.18:0/4166206107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe1f014df90 con 0x7fe1f00701e0 2024-09-21T07:10:54.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7f762d569640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76280d1080 0x7f7628153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7fa67e1b1640 1 --2- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa664003aa0 0x7fa6700cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:54.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7f762d569640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762815f350 0x7f76281579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7f762d569640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7628160030 con 0x7f762815f350 2024-09-21T07:10:54.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7f762d569640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f762815feb0 con 0x7f76280d1080 2024-09-21T07:10:54.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7f762d569640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f76280d30a0 con 0x7f76280b38b0 2024-09-21T07:10:54.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7fa67e9b2640 1 --2- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa67004c720 0x7fa67004cb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa67802ebd0 tx=0x7fa67806a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7fa18632c640 1 --2- 172.21.15.18:0/2196245268 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa164078b90 0x7fa16407b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00daa0 tx=0x7fa17c005d50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7f7626ffd640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f76280b38b0 0x7f76280cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7f76267fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76280d1080 0x7f7628153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7f76267fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76280d1080 0x7f7628153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:44514/0 (socket says 172.21.15.18:44514) 2024-09-21T07:10:54.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7f76267fc640 1 -- 172.21.15.18:0/2134838040 learned_addr learned my addr 172.21.15.18:0/2134838040 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7f7626ffd640 1 --2- 172.21.15.18:0/2134838040 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f76280b38b0 0x7f76280cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.18:40174/0 (socket says 172.21.15.18:40174) 2024-09-21T07:10:54.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7fa66effd640 1 -- 172.21.15.18:0/1825823650 <== mon.1 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67809c070 con 0x7fa67004c720 2024-09-21T07:10:54.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7f8c1effd640 1 -- 172.21.15.18:0/3809113915 <== mon.1 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c20042060 con 0x7f8c300d0b10 2024-09-21T07:10:54.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7fa185b2b640 1 --2- 172.21.15.18:0/2196245268 >> [v2:172.21.15.49:6818/1945709510,v1:172.21.15.49:6819/1945709510] conn(0x7fa164080e60 0x7fa1640832b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.018+0000 7fa66effd640 1 -- 172.21.15.18:0/1825823650 <== mon.1 v2:172.21.15.49:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa67806a0b0 con 0x7fa67004c720 2024-09-21T07:10:54.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.019+0000 7fa680415640 1 -- 172.21.15.18:0/1825823650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa670182570 con 0x7fa67004c720 2024-09-21T07:10:54.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.019+0000 7f76277fe640 1 --2- 172.21.15.18:0/2134838040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762815f350 0x7f76281579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.019+0000 7f7626ffd640 1 -- 172.21.15.18:0/2134838040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76280d1080 msgr2=0x7f7628153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.019+0000 7f7626ffd640 1 --2- 172.21.15.18:0/2134838040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76280d1080 0x7f7628153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.019+0000 7f7626ffd640 1 -- 172.21.15.18:0/2134838040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762815f350 msgr2=0x7f76281579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.019+0000 7f7626ffd640 1 --2- 172.21.15.18:0/2134838040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762815f350 0x7f76281579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.019+0000 7f7626ffd640 1 -- 172.21.15.18:0/2134838040 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76281590e0 con 0x7f76280b38b0 2024-09-21T07:10:54.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.019+0000 7fa66effd640 1 -- 172.21.15.18:0/1825823650 <== mon.1 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678096650 con 0x7fa67004c720 2024-09-21T07:10:54.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.019+0000 7fa680415640 1 -- 172.21.15.18:0/1825823650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa67004c200 con 0x7fa67004c720 2024-09-21T07:10:54.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.019+0000 7f8c1effd640 1 --2- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8c10078c90 0x7f8c1007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.019+0000 7f8c1effd640 1 -- 172.21.15.18:0/3809113915 <== mon.1 v2:172.21.15.49:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8c200ba640 con 0x7f8c300d0b10 2024-09-21T07:10:54.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.019+0000 7f8c1effd640 1 --2- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:6826/3277556905,v1:172.21.15.49:6827/3277556905] conn(0x7f8c10080f60 0x7f8c100833b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.020+0000 7f8c2e59c640 1 --2- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8c10078c90 0x7f8c1007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.020+0000 7f8c1effd640 1 -- 172.21.15.18:0/3809113915 --> [v2:172.21.15.49:6826/3277556905,v1:172.21.15.49:6827/3277556905] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c2003fe80 con 0x7f8c10080f60 2024-09-21T07:10:54.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.020+0000 7f8c1effd640 1 -- 172.21.15.18:0/3809113915 <== mon.1 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8c200c1050 con 0x7f8c300d0b10 2024-09-21T07:10:54.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.020+0000 7f04e7fff640 1 -- 172.21.15.18:0/1108488621 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f04f0003790 con 0x7f05000b52a0 2024-09-21T07:10:54.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.020+0000 7fa176ffd640 1 -- 172.21.15.18:0/2196245268 <== osd.4 v2:172.21.15.49:6818/1945709510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa164083980 con 0x7fa164080e60 2024-09-21T07:10:54.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.020+0000 7f8c2ed9d640 1 --2- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:6826/3277556905,v1:172.21.15.49:6827/3277556905] conn(0x7f8c10080f60 0x7f8c100833b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.019+0000 7f7626ffd640 1 --2- 172.21.15.18:0/2134838040 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f76280b38b0 0x7f76280cacd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f761800c390 tx=0x7f761800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.019+0000 7f760f7fe640 1 -- 172.21.15.18:0/2134838040 <== mon.2 v2:172.21.15.49:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618017070 con 0x7f76280b38b0 2024-09-21T07:10:54.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.019+0000 7f762d569640 1 -- 172.21.15.18:0/2134838040 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7628158a90 con 0x7f76280b38b0 2024-09-21T07:10:54.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.020+0000 7f762d569640 1 -- 172.21.15.18:0/2134838040 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f76280cc670 con 0x7f76280b38b0 2024-09-21T07:10:54.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.020+0000 7f760f7fe640 1 -- 172.21.15.18:0/2134838040 <== mon.2 v2:172.21.15.49:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76180035f0 con 0x7f76280b38b0 2024-09-21T07:10:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.020+0000 7f760f7fe640 1 -- 172.21.15.18:0/2134838040 <== mon.2 v2:172.21.15.49:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618003a40 con 0x7f76280b38b0 2024-09-21T07:10:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.020+0000 7f04e7fff640 1 --2- 172.21.15.18:0/1108488621 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f04ec078c60 0x7f04ec07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.020+0000 7f8c2e59c640 1 --2- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8c10078c90 0x7f8c1007b1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8c24009fd0 tx=0x7f8c24005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f8c2ed9d640 1 --2- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:6826/3277556905,v1:172.21.15.49:6827/3277556905] conn(0x7f8c10080f60 0x7f8c100833b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f762d569640 1 -- 172.21.15.18:0/2134838040 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7608001030 con 0x7f76280b38b0 2024-09-21T07:10:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f04e7fff640 1 -- 172.21.15.18:0/1108488621 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f04f00abe30 con 0x7f05000b52a0 2024-09-21T07:10:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f04e7fff640 1 --2- 172.21.15.18:0/1108488621 >> [v2:172.21.15.18:6800/1388965833,v1:172.21.15.18:6801/1388965833] conn(0x7f04ec080f30 0x7f04ec083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f04e7fff640 1 -- 172.21.15.18:0/1108488621 --> [v2:172.21.15.18:6800/1388965833,v1:172.21.15.18:6801/1388965833] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04f002ee50 con 0x7f04ec080f30 2024-09-21T07:10:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f04e7fff640 1 -- 172.21.15.18:0/1108488621 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f04f00ac220 con 0x7f05000b52a0 2024-09-21T07:10:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f04fe7fc640 1 --2- 172.21.15.18:0/1108488621 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f04ec078c60 0x7f04ec07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.020+0000 7fe1e67fc640 1 -- 172.21.15.18:0/4166206107 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe1e0042020 con 0x7fe1f00701e0 2024-09-21T07:10:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f28aaf2e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28a406e6c0 0x7f28a41f9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f28aaf2e640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f28a40b59c0 0x7f28a414cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f28aaf2e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a41f9660 0x7f28a414d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f28aaf2e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f28a4160350 con 0x7f28a41f9660 2024-09-21T07:10:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f28aaf2e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f28a41601d0 con 0x7f28a406e6c0 2024-09-21T07:10:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f28aaf2e640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f28a41604d0 con 0x7f28a40b59c0 2024-09-21T07:10:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f28aa72d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a41f9660 0x7f28a414d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f28aa72d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a41f9660 0x7f28a414d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50208/0 (socket says 172.21.15.18:50208) 2024-09-21T07:10:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f28aa72d640 1 -- 172.21.15.18:0/3624966230 learned_addr learned my addr 172.21.15.18:0/3624966230 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7f28a9f2c640 1 --2- 172.21.15.18:0/3624966230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28a406e6c0 0x7f28a41f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.021+0000 7fa66cff9640 1 -- 172.21.15.18:0/1825823650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa67004ba00 con 0x7fa67004c720 2024-09-21T07:10:54.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7f04ff7fe640 1 --2- 172.21.15.18:0/1108488621 >> [v2:172.21.15.18:6800/1388965833,v1:172.21.15.18:6801/1388965833] conn(0x7f04ec080f30 0x7f04ec083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7f04fe7fc640 1 --2- 172.21.15.18:0/1108488621 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f04ec078c60 0x7f04ec07b170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f050016d1a0 tx=0x7f04f8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7f28aa72d640 1 -- 172.21.15.18:0/3624966230 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f28a40b59c0 msgr2=0x7f28a414cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7f28aa72d640 1 --2- 172.21.15.18:0/3624966230 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f28a40b59c0 0x7f28a414cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7f28aa72d640 1 -- 172.21.15.18:0/3624966230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28a406e6c0 msgr2=0x7f28a41f9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7f28aa72d640 1 --2- 172.21.15.18:0/3624966230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28a406e6c0 0x7f28a41f9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7f28aa72d640 1 -- 172.21.15.18:0/3624966230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a414f910 con 0x7f28a41f9660 2024-09-21T07:10:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7fe1e67fc640 1 --2- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe1d4078be0 0x7fe1d407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7fe1f5036640 1 --2- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe1d4078be0 0x7fe1d407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7fe1e67fc640 1 -- 172.21.15.18:0/4166206107 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe1e00bf060 con 0x7fe1f00701e0 2024-09-21T07:10:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7fa66effd640 1 -- 172.21.15.18:0/1825823650 <== mon.1 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa67809f070 con 0x7fa67004c720 2024-09-21T07:10:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7f8c1effd640 1 -- 172.21.15.18:0/3809113915 <== osd.7 v2:172.21.15.49:6826/3277556905 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c2003fe80 con 0x7f8c10080f60 2024-09-21T07:10:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7f04ff7fe640 1 --2- 172.21.15.18:0/1108488621 >> [v2:172.21.15.18:6800/1388965833,v1:172.21.15.18:6801/1388965833] conn(0x7f04ec080f30 0x7f04ec083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7fe1e67fc640 1 --2- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:6810/3861333879,v1:172.21.15.49:6811/3861333879] conn(0x7fe1d4080eb0 0x7fe1d4083300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7fe1e67fc640 1 -- 172.21.15.18:0/4166206107 --> [v2:172.21.15.49:6810/3861333879,v1:172.21.15.49:6811/3861333879] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1d40839d0 con 0x7fe1d4080eb0 2024-09-21T07:10:54.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.022+0000 7fe1e67fc640 1 -- 172.21.15.18:0/4166206107 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe1e00ba520 con 0x7fe1f00701e0 2024-09-21T07:10:54.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.023+0000 7f760f7fe640 1 -- 172.21.15.18:0/2134838040 <== mon.2 v2:172.21.15.49:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f761801a070 con 0x7f76280b38b0 2024-09-21T07:10:54.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.023+0000 7fa66effd640 1 --2- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa65c078b90 0x7fa65c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.023+0000 7fe1f6038640 1 --2- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:6810/3861333879,v1:172.21.15.49:6811/3861333879] conn(0x7fe1d4080eb0 0x7fe1d4083300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.023+0000 7fe1f5036640 1 --2- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe1d4078be0 0x7fe1d407b0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec006fd0 tx=0x7fe1ec008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.023+0000 7fa67e1b1640 1 --2- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa65c078b90 0x7fa65c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.023+0000 7fa66effd640 1 -- 172.21.15.18:0/1825823650 <== mon.1 v2:172.21.15.49:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa678116750 con 0x7fa67004c720 2024-09-21T07:10:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.023+0000 7fa66effd640 1 --2- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:6802/3256581088,v1:172.21.15.49:6803/3256581088] conn(0x7fa65c080e60 0x7fa65c0832b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.023+0000 7fe1f6038640 1 --2- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:6810/3861333879,v1:172.21.15.49:6811/3861333879] conn(0x7fe1d4080eb0 0x7fe1d4083300 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.023+0000 7f760f7fe640 1 --2- 172.21.15.18:0/2134838040 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7614078b90 0x7f761407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.023+0000 7fa66effd640 1 -- 172.21.15.18:0/1825823650 --> [v2:172.21.15.49:6802/3256581088,v1:172.21.15.49:6803/3256581088] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa678064660 con 0x7fa65c080e60 2024-09-21T07:10:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.023+0000 7f28aa72d640 1 --2- 172.21.15.18:0/3624966230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a41f9660 0x7f28a414d010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f289402aa00 tx=0x7f2894030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.023+0000 7f760f7fe640 1 -- 172.21.15.18:0/2134838040 <== mon.2 v2:172.21.15.49:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f761809a1f0 con 0x7f76280b38b0 2024-09-21T07:10:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.024+0000 7fa66effd640 1 -- 172.21.15.18:0/1825823650 <== mon.1 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa67811d050 con 0x7fa67004c720 2024-09-21T07:10:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.024+0000 7fa67d9b0640 1 --2- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:6802/3256581088,v1:172.21.15.49:6803/3256581088] conn(0x7fa65c080e60 0x7fa65c0832b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.024+0000 7f76267fc640 1 --2- 172.21.15.18:0/2134838040 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7614078b90 0x7f761407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.024+0000 7f760f7fe640 1 --2- 172.21.15.18:0/2134838040 >> [v2:172.21.15.18:6824/2776683579,v1:172.21.15.18:6825/2776683579] conn(0x7f7614080de0 0x7f7614083230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.024+0000 7f760f7fe640 1 -- 172.21.15.18:0/2134838040 --> [v2:172.21.15.18:6824/2776683579,v1:172.21.15.18:6825/2776683579] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7618016ec0 con 0x7f7614080de0 2024-09-21T07:10:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.024+0000 7f760f7fe640 1 -- 172.21.15.18:0/2134838040 <== mon.2 v2:172.21.15.49:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f761809a5a0 con 0x7f76280b38b0 2024-09-21T07:10:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.024+0000 7fa67e1b1640 1 --2- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa65c078b90 0x7fa65c07b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa674033000 tx=0x7fa67402d000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.024+0000 7f76277fe640 1 --2- 172.21.15.18:0/2134838040 >> [v2:172.21.15.18:6824/2776683579,v1:172.21.15.18:6825/2776683579] conn(0x7f7614080de0 0x7f7614083230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.024+0000 7f289a7fc640 1 -- 172.21.15.18:0/3624966230 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894040070 con 0x7f28a41f9660 2024-09-21T07:10:54.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.024+0000 7f04e7fff640 1 -- 172.21.15.18:0/1108488621 <== osd.1 v2:172.21.15.18:6800/1388965833 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f04f002ee50 con 0x7f04ec080f30 2024-09-21T07:10:54.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.024+0000 7f289a7fc640 1 -- 172.21.15.18:0/3624966230 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2894030d40 con 0x7f28a41f9660 2024-09-21T07:10:54.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.024+0000 7f28aaf2e640 1 -- 172.21.15.18:0/3624966230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a414fbf0 con 0x7f28a41f9660 2024-09-21T07:10:54.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.024+0000 7f28aaf2e640 1 -- 172.21.15.18:0/3624966230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a40cdd80 con 0x7f28a41f9660 2024-09-21T07:10:54.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.024+0000 7f289a7fc640 1 -- 172.21.15.18:0/3624966230 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894005c90 con 0x7f28a41f9660 2024-09-21T07:10:54.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.025+0000 7fa67d9b0640 1 --2- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:6802/3256581088,v1:172.21.15.49:6803/3256581088] conn(0x7fa65c080e60 0x7fa65c0832b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.025+0000 7fe1e67fc640 1 -- 172.21.15.18:0/4166206107 <== osd.5 v2:172.21.15.49:6810/3861333879 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe1d40839d0 con 0x7fe1d4080eb0 2024-09-21T07:10:54.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.025+0000 7f28aaf2e640 1 -- 172.21.15.18:0/3624966230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f28a406b490 con 0x7f28a41f9660 2024-09-21T07:10:54.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.025+0000 7f76277fe640 1 --2- 172.21.15.18:0/2134838040 >> [v2:172.21.15.18:6824/2776683579,v1:172.21.15.18:6825/2776683579] conn(0x7f7614080de0 0x7f7614083230 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.026+0000 7f76267fc640 1 --2- 172.21.15.18:0/2134838040 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7614078b90 0x7f761407b0a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f76280d5520 tx=0x7f761c00b390 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.027+0000 7fa66effd640 1 -- 172.21.15.18:0/1825823650 <== osd.6 v2:172.21.15.49:6802/3256581088 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa678064660 con 0x7fa65c080e60 2024-09-21T07:10:54.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.027+0000 7f760f7fe640 1 -- 172.21.15.18:0/2134838040 <== osd.3 v2:172.21.15.18:6824/2776683579 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7618016ec0 con 0x7f7614080de0 2024-09-21T07:10:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.027+0000 7f289a7fc640 1 -- 172.21.15.18:0/3624966230 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2894039040 con 0x7f28a41f9660 2024-09-21T07:10:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.028+0000 7f289a7fc640 1 --2- 172.21.15.18:0/3624966230 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2888078c60 0x7f288807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.028+0000 7f289a7fc640 1 -- 172.21.15.18:0/3624966230 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f28940bbcd0 con 0x7f28a41f9660 2024-09-21T07:10:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.028+0000 7f289a7fc640 1 --2- 172.21.15.18:0/3624966230 >> [v2:172.21.15.18:6816/2742438714,v1:172.21.15.18:6817/2742438714] conn(0x7f2888080f30 0x7f2888083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.029+0000 7f289a7fc640 1 -- 172.21.15.18:0/3624966230 --> [v2:172.21.15.18:6816/2742438714,v1:172.21.15.18:6817/2742438714] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2888083a50 con 0x7f2888080f30 2024-09-21T07:10:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.029+0000 7f289a7fc640 1 -- 172.21.15.18:0/3624966230 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f28940be330 con 0x7f28a41f9660 2024-09-21T07:10:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.029+0000 7f28a972b640 1 --2- 172.21.15.18:0/3624966230 >> [v2:172.21.15.18:6816/2742438714,v1:172.21.15.18:6817/2742438714] conn(0x7f2888080f30 0x7f2888083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.029+0000 7f28a972b640 1 --2- 172.21.15.18:0/3624966230 >> [v2:172.21.15.18:6816/2742438714,v1:172.21.15.18:6817/2742438714] conn(0x7f2888080f30 0x7f2888083380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.030+0000 7f289a7fc640 1 -- 172.21.15.18:0/3624966230 <== osd.2 v2:172.21.15.18:6816/2742438714 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2888083a50 con 0x7f2888080f30 2024-09-21T07:10:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.033+0000 7f28a9f2c640 1 --2- 172.21.15.18:0/3624966230 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2888078c60 0x7f288807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.046+0000 7ffa2cff9640 1 -- 172.21.15.18:0/261469647 --> [v2:172.21.15.18:6808/3354774634,v1:172.21.15.18:6809/3354774634] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffa18002dd0 con 0x7ffa20080e00 2024-09-21T07:10:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.046+0000 7ffa2effd640 1 -- 172.21.15.18:0/261469647 <== osd.0 v2:172.21.15.18:6808/3354774634 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffa18002dd0 con 0x7ffa20080e00 2024-09-21T07:10:54.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.047+0000 7ffa44bad640 1 -- 172.21.15.18:0/261469647 >> [v2:172.21.15.18:6808/3354774634,v1:172.21.15.18:6809/3354774634] conn(0x7ffa20080e00 msgr2=0x7ffa20083250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.047+0000 7ffa44bad640 1 --2- 172.21.15.18:0/261469647 >> [v2:172.21.15.18:6808/3354774634,v1:172.21.15.18:6809/3354774634] conn(0x7ffa20080e00 0x7ffa20083250 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.047+0000 7f28a9f2c640 1 --2- 172.21.15.18:0/3624966230 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2888078c60 0x7f288807b170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f28a0000f60 tx=0x7f28a0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.047+0000 7ffa44bad640 1 -- 172.21.15.18:0/261469647 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ffa20078b90 msgr2=0x7ffa2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.047+0000 7ffa44bad640 1 --2- 172.21.15.18:0/261469647 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ffa20078b90 0x7ffa2007b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa4015f090 tx=0x7ffa3000b2e0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.047+0000 7ffa44bad640 1 -- 172.21.15.18:0/261469647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa400743c0 msgr2=0x7ffa4009dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.047+0000 7ffa44bad640 1 --2- 172.21.15.18:0/261469647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa400743c0 0x7ffa4009dc50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa400740f0 tx=0x7ffa38033e10 comp rx=0 tx=0).stop 2024-09-21T07:10:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.047+0000 7ffa3ed9d640 1 -- 172.21.15.18:0/261469647 reap_dead start 2024-09-21T07:10:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.047+0000 7ffa44bad640 1 -- 172.21.15.18:0/261469647 shutdown_connections 2024-09-21T07:10:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.048+0000 7ffa44bad640 1 -- 172.21.15.18:0/261469647 >> 172.21.15.18:0/261469647 conn(0x7ffa400ccd30 msgr2=0x7ffa4015a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.048+0000 7ffa44bad640 1 -- 172.21.15.18:0/261469647 shutdown_connections 2024-09-21T07:10:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.049+0000 7ffa44bad640 1 -- 172.21.15.18:0/261469647 wait complete. 2024-09-21T07:10:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.050+0000 7fa188590640 1 -- 172.21.15.18:0/2196245268 --> [v2:172.21.15.49:6818/1945709510,v1:172.21.15.49:6819/1945709510] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa1801fd2e0 con 0x7fa164080e60 2024-09-21T07:10:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.051+0000 7fa176ffd640 1 -- 172.21.15.18:0/2196245268 <== osd.4 v2:172.21.15.49:6818/1945709510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa1801fd2e0 con 0x7fa164080e60 2024-09-21T07:10:54.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.052+0000 7fa174ff9640 1 -- 172.21.15.18:0/2196245268 >> [v2:172.21.15.49:6818/1945709510,v1:172.21.15.49:6819/1945709510] conn(0x7fa164080e60 msgr2=0x7fa1640832b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.052+0000 7fa174ff9640 1 --2- 172.21.15.18:0/2196245268 >> [v2:172.21.15.49:6818/1945709510,v1:172.21.15.49:6819/1945709510] conn(0x7fa164080e60 0x7fa1640832b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.052+0000 7fa174ff9640 1 -- 172.21.15.18:0/2196245268 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa164078b90 msgr2=0x7fa16407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.052+0000 7fa174ff9640 1 --2- 172.21.15.18:0/2196245268 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa164078b90 0x7fa16407b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00daa0 tx=0x7fa17c005d50 comp rx=0 tx=0).stop 2024-09-21T07:10:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.052+0000 7fa174ff9640 1 -- 172.21.15.18:0/2196245268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa180161480 msgr2=0x7fa180161890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.052+0000 7fa174ff9640 1 --2- 172.21.15.18:0/2196245268 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa180161480 0x7fa180161890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa178030000 tx=0x7fa178004bb0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.052+0000 7fa186b2d640 1 -- 172.21.15.18:0/2196245268 reap_dead start 2024-09-21T07:10:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.052+0000 7fa174ff9640 1 -- 172.21.15.18:0/2196245268 shutdown_connections 2024-09-21T07:10:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.053+0000 7fa174ff9640 1 -- 172.21.15.18:0/2196245268 >> 172.21.15.18:0/2196245268 conn(0x7fa1800ccd30 msgr2=0x7fa1800ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.053+0000 7fa174ff9640 1 -- 172.21.15.18:0/2196245268 shutdown_connections 2024-09-21T07:10:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.053+0000 7fa174ff9640 1 -- 172.21.15.18:0/2196245268 wait complete. 2024-09-21T07:10:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.054+0000 7f8c34a30640 1 -- 172.21.15.18:0/3809113915 --> [v2:172.21.15.49:6826/3277556905,v1:172.21.15.49:6827/3277556905] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8c3009a0c0 con 0x7f8c10080f60 2024-09-21T07:10:54.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.055+0000 7f8c1effd640 1 -- 172.21.15.18:0/3809113915 <== osd.7 v2:172.21.15.49:6826/3277556905 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8c3009a0c0 con 0x7f8c10080f60 2024-09-21T07:10:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.056+0000 7f8c1cff9640 1 -- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:6826/3277556905,v1:172.21.15.49:6827/3277556905] conn(0x7f8c10080f60 msgr2=0x7f8c100833b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.056+0000 7f8c1cff9640 1 --2- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:6826/3277556905,v1:172.21.15.49:6827/3277556905] conn(0x7f8c10080f60 0x7f8c100833b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.056+0000 7f8c1cff9640 1 -- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8c10078c90 msgr2=0x7f8c1007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.056+0000 7f8c1cff9640 1 --2- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8c10078c90 0x7f8c1007b1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8c24009fd0 tx=0x7f8c24005f90 comp rx=0 tx=0).stop 2024-09-21T07:10:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.056+0000 7f8c1cff9640 1 -- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c300d0b10 msgr2=0x7f8c3015d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.056+0000 7f8c1cff9640 1 --2- 172.21.15.18:0/3809113915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c300d0b10 0x7f8c3015d440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8c300b5520 tx=0x7f8c20003b90 comp rx=0 tx=0).stop 2024-09-21T07:10:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.056+0000 7f8c2ed9d640 1 -- 172.21.15.18:0/3809113915 reap_dead start 2024-09-21T07:10:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.057+0000 7f8c1cff9640 1 -- 172.21.15.18:0/3809113915 shutdown_connections 2024-09-21T07:10:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.057+0000 7f8c1cff9640 1 -- 172.21.15.18:0/3809113915 >> 172.21.15.18:0/3809113915 conn(0x7f8c300b1fe0 msgr2=0x7f8c300b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.057+0000 7fe1f6839640 1 -- 172.21.15.18:0/4166206107 --> [v2:172.21.15.49:6810/3861333879,v1:172.21.15.49:6811/3861333879] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe1f0072720 con 0x7fe1d4080eb0 2024-09-21T07:10:54.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.057+0000 7f8c1cff9640 1 -- 172.21.15.18:0/3809113915 shutdown_connections 2024-09-21T07:10:54.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.057+0000 7f8c1cff9640 1 -- 172.21.15.18:0/3809113915 wait complete. 2024-09-21T07:10:54.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.057+0000 7f762d569640 1 -- 172.21.15.18:0/2134838040 --> [v2:172.21.15.18:6824/2776683579,v1:172.21.15.18:6825/2776683579] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7608002dd0 con 0x7f7614080de0 2024-09-21T07:10:54.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.057+0000 7fe1e67fc640 1 -- 172.21.15.18:0/4166206107 <== osd.5 v2:172.21.15.49:6810/3861333879 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe1f0072720 con 0x7fe1d4080eb0 2024-09-21T07:10:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.057+0000 7f04fffff640 1 -- 172.21.15.18:0/1108488621 --> [v2:172.21.15.18:6800/1388965833,v1:172.21.15.18:6801/1388965833] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f050006b490 con 0x7f04ec080f30 2024-09-21T07:10:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.058+0000 7f760f7fe640 1 -- 172.21.15.18:0/2134838040 <== osd.3 v2:172.21.15.18:6824/2776683579 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7608002dd0 con 0x7f7614080de0 2024-09-21T07:10:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.058+0000 7fe1f6839640 1 -- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:6810/3861333879,v1:172.21.15.49:6811/3861333879] conn(0x7fe1d4080eb0 msgr2=0x7fe1d4083300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.058+0000 7fe1f6839640 1 --2- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:6810/3861333879,v1:172.21.15.49:6811/3861333879] conn(0x7fe1d4080eb0 0x7fe1d4083300 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.058+0000 7f04e7fff640 1 -- 172.21.15.18:0/1108488621 <== osd.1 v2:172.21.15.18:6800/1388965833 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f04f4005570 con 0x7f04ec080f30 2024-09-21T07:10:54.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.058+0000 7fe1f6839640 1 -- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe1d4078be0 msgr2=0x7fe1d407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.058+0000 7fe1f6839640 1 --2- 172.21.15.18:0/4166206107 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe1d4078be0 0x7fe1d407b0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec006fd0 tx=0x7fe1ec008040 comp rx=0 tx=0).stop 2024-09-21T07:10:54.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.058+0000 7f762d569640 1 -- 172.21.15.18:0/2134838040 >> [v2:172.21.15.18:6824/2776683579,v1:172.21.15.18:6825/2776683579] conn(0x7f7614080de0 msgr2=0x7f7614083230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.058+0000 7fe1f6839640 1 -- 172.21.15.18:0/4166206107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f00701e0 msgr2=0x7fe1f014da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.058+0000 7fe1f6839640 1 --2- 172.21.15.18:0/4166206107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f00701e0 0x7fe1f014da50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1e002a9e0 tx=0x7fe1e0033c20 comp rx=0 tx=0).stop 2024-09-21T07:10:54.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.058+0000 7f762d569640 1 --2- 172.21.15.18:0/2134838040 >> [v2:172.21.15.18:6824/2776683579,v1:172.21.15.18:6825/2776683579] conn(0x7f7614080de0 0x7f7614083230 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.058+0000 7fa66cff9640 1 -- 172.21.15.18:0/1825823650 --> [v2:172.21.15.49:6802/3256581088,v1:172.21.15.49:6803/3256581088] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa67004be20 con 0x7fa65c080e60 2024-09-21T07:10:54.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.058+0000 7fe1f6038640 1 -- 172.21.15.18:0/4166206107 reap_dead start 2024-09-21T07:10:54.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.059+0000 7f762d569640 1 -- 172.21.15.18:0/2134838040 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7614078b90 msgr2=0x7f761407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.059+0000 7f762d569640 1 --2- 172.21.15.18:0/2134838040 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7614078b90 0x7f761407b0a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f76280d5520 tx=0x7f761c00b390 comp rx=0 tx=0).stop 2024-09-21T07:10:54.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.059+0000 7f762d569640 1 -- 172.21.15.18:0/2134838040 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f76280b38b0 msgr2=0x7f76280cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.059+0000 7fe1f6839640 1 -- 172.21.15.18:0/4166206107 shutdown_connections 2024-09-21T07:10:54.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.059+0000 7f762d569640 1 --2- 172.21.15.18:0/2134838040 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f76280b38b0 0x7f76280cacd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f761800c390 tx=0x7f761800c850 comp rx=0 tx=0).stop 2024-09-21T07:10:54.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.059+0000 7fe1f6839640 1 -- 172.21.15.18:0/4166206107 >> 172.21.15.18:0/4166206107 conn(0x7fe1f006eda0 msgr2=0x7fe1f00b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.059+0000 7f76277fe640 1 -- 172.21.15.18:0/2134838040 reap_dead start 2024-09-21T07:10:54.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.059+0000 7fa66effd640 1 -- 172.21.15.18:0/1825823650 <== osd.6 v2:172.21.15.49:6802/3256581088 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa67004be20 con 0x7fa65c080e60 2024-09-21T07:10:54.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.059+0000 7f762d569640 1 -- 172.21.15.18:0/2134838040 shutdown_connections 2024-09-21T07:10:54.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.059+0000 7f762d569640 1 -- 172.21.15.18:0/2134838040 >> 172.21.15.18:0/2134838040 conn(0x7f7628073e20 msgr2=0x7f762816b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.059+0000 7f762d569640 1 -- 172.21.15.18:0/2134838040 shutdown_connections 2024-09-21T07:10:54.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.059+0000 7f762d569640 1 -- 172.21.15.18:0/2134838040 wait complete. 2024-09-21T07:10:54.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.060+0000 7fe1f6839640 1 -- 172.21.15.18:0/4166206107 shutdown_connections 2024-09-21T07:10:54.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.060+0000 7fe1f6839640 1 -- 172.21.15.18:0/4166206107 wait complete. 2024-09-21T07:10:54.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.060+0000 7fa680415640 1 -- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:6802/3256581088,v1:172.21.15.49:6803/3256581088] conn(0x7fa65c080e60 msgr2=0x7fa65c0832b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.060+0000 7fa680415640 1 --2- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:6802/3256581088,v1:172.21.15.49:6803/3256581088] conn(0x7fa65c080e60 0x7fa65c0832b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.060+0000 7f04fffff640 1 -- 172.21.15.18:0/1108488621 >> [v2:172.21.15.18:6800/1388965833,v1:172.21.15.18:6801/1388965833] conn(0x7f04ec080f30 msgr2=0x7f04ec083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.060+0000 7f04fffff640 1 --2- 172.21.15.18:0/1108488621 >> [v2:172.21.15.18:6800/1388965833,v1:172.21.15.18:6801/1388965833] conn(0x7f04ec080f30 0x7f04ec083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.060+0000 7f04fffff640 1 -- 172.21.15.18:0/1108488621 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f04ec078c60 msgr2=0x7f04ec07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.060+0000 7f04fffff640 1 --2- 172.21.15.18:0/1108488621 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f04ec078c60 0x7f04ec07b170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f050016d1a0 tx=0x7f04f8009040 comp rx=0 tx=0).stop 2024-09-21T07:10:54.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.060+0000 7f04fffff640 1 -- 172.21.15.18:0/1108488621 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05000b52a0 msgr2=0x7f05000b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.060+0000 7f04fffff640 1 --2- 172.21.15.18:0/1108488621 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05000b52a0 0x7f05000b18b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f04f0001e70 tx=0x7f04f000cb10 comp rx=0 tx=0).stop 2024-09-21T07:10:54.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.060+0000 7f04ff7fe640 1 -- 172.21.15.18:0/1108488621 reap_dead start 2024-09-21T07:10:54.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.061+0000 7f04fffff640 1 -- 172.21.15.18:0/1108488621 shutdown_connections 2024-09-21T07:10:54.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.061+0000 7f04fffff640 1 -- 172.21.15.18:0/1108488621 >> 172.21.15.18:0/1108488621 conn(0x7f05000b2030 msgr2=0x7f0500162b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.061+0000 7f28aaf2e640 1 -- 172.21.15.18:0/3624966230 --> [v2:172.21.15.18:6816/2742438714,v1:172.21.15.18:6817/2742438714] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f28a40b3450 con 0x7f2888080f30 2024-09-21T07:10:54.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.061+0000 7fa680415640 1 -- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa65c078b90 msgr2=0x7fa65c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.061+0000 7fa680415640 1 --2- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa65c078b90 0x7fa65c07b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa674033000 tx=0x7fa67402d000 comp rx=0 tx=0).stop 2024-09-21T07:10:54.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.061+0000 7fa680415640 1 -- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa67004c720 msgr2=0x7fa67004cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.061+0000 7fa680415640 1 --2- 172.21.15.18:0/1825823650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa67004c720 0x7fa67004cb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa67802ebd0 tx=0x7fa67806a7a0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.061+0000 7f04fffff640 1 -- 172.21.15.18:0/1108488621 shutdown_connections 2024-09-21T07:10:54.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.061+0000 7f04fffff640 1 -- 172.21.15.18:0/1108488621 wait complete. 2024-09-21T07:10:54.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.061+0000 7fa67e9b2640 1 -- 172.21.15.18:0/1825823650 reap_dead start 2024-09-21T07:10:54.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.061+0000 7fa680415640 1 -- 172.21.15.18:0/1825823650 shutdown_connections 2024-09-21T07:10:54.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.061+0000 7fa680415640 1 -- 172.21.15.18:0/1825823650 >> 172.21.15.18:0/1825823650 conn(0x7fa67001e230 msgr2=0x7fa6700eda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.062+0000 7f289a7fc640 1 -- 172.21.15.18:0/3624966230 <== osd.2 v2:172.21.15.18:6816/2742438714 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f28a40b3450 con 0x7f2888080f30 2024-09-21T07:10:54.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.062+0000 7fa680415640 1 -- 172.21.15.18:0/1825823650 shutdown_connections 2024-09-21T07:10:54.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.062+0000 7fa680415640 1 -- 172.21.15.18:0/1825823650 wait complete. 2024-09-21T07:10:54.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.062+0000 7f28aaf2e640 1 -- 172.21.15.18:0/3624966230 >> [v2:172.21.15.18:6816/2742438714,v1:172.21.15.18:6817/2742438714] conn(0x7f2888080f30 msgr2=0x7f2888083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.063+0000 7f28aaf2e640 1 --2- 172.21.15.18:0/3624966230 >> [v2:172.21.15.18:6816/2742438714,v1:172.21.15.18:6817/2742438714] conn(0x7f2888080f30 0x7f2888083380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.063+0000 7f28aaf2e640 1 -- 172.21.15.18:0/3624966230 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2888078c60 msgr2=0x7f288807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.063+0000 7f28aaf2e640 1 --2- 172.21.15.18:0/3624966230 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2888078c60 0x7f288807b170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f28a0000f60 tx=0x7f28a0009040 comp rx=0 tx=0).stop 2024-09-21T07:10:54.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.063+0000 7f28aaf2e640 1 -- 172.21.15.18:0/3624966230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a41f9660 msgr2=0x7f28a414d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.063+0000 7f28aaf2e640 1 --2- 172.21.15.18:0/3624966230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28a41f9660 0x7f28a414d010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f289402aa00 tx=0x7f2894030650 comp rx=0 tx=0).stop 2024-09-21T07:10:54.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.063+0000 7f28aa72d640 1 -- 172.21.15.18:0/3624966230 reap_dead start 2024-09-21T07:10:54.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.064+0000 7f28aaf2e640 1 -- 172.21.15.18:0/3624966230 shutdown_connections 2024-09-21T07:10:54.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.064+0000 7f28aaf2e640 1 -- 172.21.15.18:0/3624966230 >> 172.21.15.18:0/3624966230 conn(0x7f28a406d370 msgr2=0x7f28a4155260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.093 INFO:teuthology.orchestra.run.smithi018.stdout:60129542152 2024-09-21T07:10:54.093 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T07:10:54.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.066+0000 7f28aaf2e640 1 -- 172.21.15.18:0/3624966230 shutdown_connections 2024-09-21T07:10:54.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.066+0000 7f28aaf2e640 1 -- 172.21.15.18:0/3624966230 wait complete. 2024-09-21T07:10:54.094 INFO:teuthology.orchestra.run.smithi018.stdout:64424509447 2024-09-21T07:10:54.095 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T07:10:54.096 INFO:teuthology.orchestra.run.smithi018.stdout:60129542150 2024-09-21T07:10:54.096 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T07:10:54.097 INFO:teuthology.orchestra.run.smithi018.stdout:64424509447 2024-09-21T07:10:54.097 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T07:10:54.098 INFO:teuthology.orchestra.run.smithi018.stdout:64424509447 2024-09-21T07:10:54.098 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T07:10:54.099 INFO:teuthology.orchestra.run.smithi018.stdout:64424509448 2024-09-21T07:10:54.099 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T07:10:54.100 INFO:teuthology.orchestra.run.smithi018.stdout:60129542151 2024-09-21T07:10:54.100 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T07:10:54.101 INFO:teuthology.orchestra.run.smithi018.stdout:64424509447 2024-09-21T07:10:54.101 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T07:10:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.362+0000 7f21f8a22640 1 -- 172.21.15.18:0/3428668359 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f21ec052b60 msgr2=0x7f21ec054990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.362+0000 7f21f8a22640 1 --2- 172.21.15.18:0/3428668359 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f21ec052b60 0x7f21ec054990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f21f407b040 tx=0x7f21f4075730 comp rx=0 tx=0).stop 2024-09-21T07:10:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.362+0000 7f21f8a22640 1 -- 172.21.15.18:0/3428668359 shutdown_connections 2024-09-21T07:10:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.362+0000 7f21f8a22640 1 --2- 172.21.15.18:0/3428668359 >> v2:172.21.15.49:3300/0 conn(0x7f21ec0520f0 0x7f21ec006870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.362+0000 7f21f8a22640 1 --2- 172.21.15.18:0/3428668359 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f21ec052b60 0x7f21ec054990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.362+0000 7f21f8a22640 1 -- 172.21.15.18:0/3428668359 >> 172.21.15.18:0/3428668359 conn(0x7f21ec01e230 msgr2=0x7f21ec039ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.363+0000 7f21f8a22640 1 -- 172.21.15.18:0/3428668359 shutdown_connections 2024-09-21T07:10:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.363+0000 7f21f8a22640 1 -- 172.21.15.18:0/3428668359 wait complete. 2024-09-21T07:10:54.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.363+0000 7f8652ea9640 1 -- 172.21.15.18:0/1297973431 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f864c06f850 msgr2=0x7f864c15ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.363+0000 7f8652ea9640 1 --2- 172.21.15.18:0/1297973431 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f864c06f850 0x7f864c15ea60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8644005fd0 tx=0x7f864402aaa0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.363+0000 7f8652ea9640 1 -- 172.21.15.18:0/1297973431 shutdown_connections 2024-09-21T07:10:54.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.363+0000 7f8652ea9640 1 --2- 172.21.15.18:0/1297973431 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f864c06f850 0x7f864c15ea60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.363+0000 7f8652ea9640 1 --2- 172.21.15.18:0/1297973431 >> v2:172.21.15.18:3300/0 conn(0x7f864c0d0b20 0x7f864c0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.363+0000 7f8652ea9640 1 -- 172.21.15.18:0/1297973431 >> 172.21.15.18:0/1297973431 conn(0x7f864c0b1fe0 msgr2=0x7f864c0b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.363+0000 7f8652ea9640 1 -- 172.21.15.18:0/1297973431 shutdown_connections 2024-09-21T07:10:54.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.364+0000 7fd8c2d20640 1 -- 172.21.15.18:0/880878758 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8bc0d30a0 msgr2=0x7fd8bc15c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.364+0000 7fd8c2d20640 1 --2- 172.21.15.18:0/880878758 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8bc0d30a0 0x7fd8bc15c360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4005fd0 tx=0x7fd8b402a9f0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.364+0000 7fd8c2d20640 1 -- 172.21.15.18:0/880878758 shutdown_connections 2024-09-21T07:10:54.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.364+0000 7fd8c2d20640 1 --2- 172.21.15.18:0/880878758 >> v2:172.21.15.49:3300/0 conn(0x7fd8bc0d34b0 0x7fd8bc0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.364+0000 7fd8c2d20640 1 --2- 172.21.15.18:0/880878758 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8bc0d30a0 0x7fd8bc15c360 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.364+0000 7fd8c2d20640 1 -- 172.21.15.18:0/880878758 >> 172.21.15.18:0/880878758 conn(0x7fd8bc073e20 msgr2=0x7fd8bc06cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.364+0000 7fd8c2d20640 1 -- 172.21.15.18:0/880878758 shutdown_connections 2024-09-21T07:10:54.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.364+0000 7fd8c2d20640 1 -- 172.21.15.18:0/880878758 wait complete. 2024-09-21T07:10:54.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.364+0000 7f8652ea9640 1 -- 172.21.15.18:0/1297973431 wait complete. 2024-09-21T07:10:54.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.366+0000 7f21f8a22640 1 Processor -- start 2024-09-21T07:10:54.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.366+0000 7f21f8a22640 1 -- start start 2024-09-21T07:10:54.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7f2454d32640 1 -- 172.21.15.18:0/3941517649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24480534c0 msgr2=0x7f2448037df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7f2454d32640 1 --2- 172.21.15.18:0/3941517649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24480534c0 0x7f2448037df0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2440009830 tx=0x7f244002a480 comp rx=0 tx=0).stop 2024-09-21T07:10:54.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7fdd46883640 1 -- 172.21.15.18:0/1833884605 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdd28004800 msgr2=0x7fdd28004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7fdd46883640 1 --2- 172.21.15.18:0/1833884605 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdd28004800 0x7fdd28004c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdd34006fa0 tx=0x7fdd28005830 comp rx=0 tx=0).stop 2024-09-21T07:10:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7f2454d32640 1 -- 172.21.15.18:0/3941517649 shutdown_connections 2024-09-21T07:10:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7f2454d32640 1 --2- 172.21.15.18:0/3941517649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24480534c0 0x7f2448037df0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7f2454d32640 1 -- 172.21.15.18:0/3941517649 >> 172.21.15.18:0/3941517649 conn(0x7f244801ead0 msgr2=0x7f244803a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7f2454d32640 1 -- 172.21.15.18:0/3941517649 shutdown_connections 2024-09-21T07:10:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7f2454d32640 1 -- 172.21.15.18:0/3941517649 wait complete. 2024-09-21T07:10:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7ff1d055e640 1 -- 172.21.15.18:0/2223906594 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff1c00e4590 msgr2=0x7ff1c0006ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7ff1d055e640 1 --2- 172.21.15.18:0/2223906594 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff1c00e4590 0x7ff1c0006ef0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff1c002b210 tx=0x7ff1b802a3d0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7fdd46082640 1 -- 172.21.15.18:0/1833884605 reap_dead start 2024-09-21T07:10:54.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7fdd46883640 1 -- 172.21.15.18:0/1833884605 shutdown_connections 2024-09-21T07:10:54.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7fdd46883640 1 -- 172.21.15.18:0/1833884605 >> 172.21.15.18:0/1833884605 conn(0x7fdd4006eda0 msgr2=0x7fdd400d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7f8652ea9640 1 Processor -- start 2024-09-21T07:10:54.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7fd8c2d20640 1 Processor -- start 2024-09-21T07:10:54.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7ff1d055e640 1 -- 172.21.15.18:0/2223906594 shutdown_connections 2024-09-21T07:10:54.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7f8652ea9640 1 -- start start 2024-09-21T07:10:54.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7fd8c2d20640 1 -- start start 2024-09-21T07:10:54.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7ff1d055e640 1 --2- 172.21.15.18:0/2223906594 >> v2:172.21.15.49:3300/0 conn(0x7ff1c0036210 0x7ff1c0036620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7ff1d055e640 1 --2- 172.21.15.18:0/2223906594 >> v2:172.21.15.18:3300/0 conn(0x7ff1c0009f60 0x7ff1c0032710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7ff1d055e640 1 --2- 172.21.15.18:0/2223906594 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff1c00e4590 0x7ff1c0006ef0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7ff1d055e640 1 -- 172.21.15.18:0/2223906594 >> 172.21.15.18:0/2223906594 conn(0x7ff1c0051420 msgr2=0x7ff1c0051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7f466e61d640 1 -- 172.21.15.18:0/2320436718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f466815af70 msgr2=0x7f4668073960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7ff1d055e640 1 -- 172.21.15.18:0/2223906594 shutdown_connections 2024-09-21T07:10:54.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.367+0000 7f466e61d640 1 --2- 172.21.15.18:0/2320436718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f466815af70 0x7f4668073960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4658005fd0 tx=0x7f465802a520 comp rx=0 tx=0).stop 2024-09-21T07:10:54.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.368+0000 7ff1d055e640 1 -- 172.21.15.18:0/2223906594 wait complete. 2024-09-21T07:10:54.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.368+0000 7fdd46883640 1 -- 172.21.15.18:0/1833884605 shutdown_connections 2024-09-21T07:10:54.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.368+0000 7fdd46883640 1 -- 172.21.15.18:0/1833884605 wait complete. 2024-09-21T07:10:54.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.368+0000 7f21f8a22640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21ec037520 0x7f21ec031b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.368+0000 7f21f8a22640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f21ec0520f0 0x7f21ec0d6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.368+0000 7f21f8a22640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21ec052b60 0x7f21ec04e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.368+0000 7f21f8a22640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f21ec006160 con 0x7f21ec037520 2024-09-21T07:10:54.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7f21f8a22640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f21ec005fe0 con 0x7f21ec052b60 2024-09-21T07:10:54.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7fd8e6a39640 1 -- 172.21.15.18:0/3711302639 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8e00cf7c0 msgr2=0x7fd8e00b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7fd8e6a39640 1 --2- 172.21.15.18:0/3711302639 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8e00cf7c0 0x7fd8e00b2fb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8005fd0 tx=0x7fd8d802a9f0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7f21f8a22640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f21ec0062e0 con 0x7f21ec0520f0 2024-09-21T07:10:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7fd8e6a39640 1 -- 172.21.15.18:0/3711302639 shutdown_connections 2024-09-21T07:10:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7fd8e6a39640 1 --2- 172.21.15.18:0/3711302639 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8e00cf7c0 0x7fd8e00b2fb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7fd8e6a39640 1 --2- 172.21.15.18:0/3711302639 >> v2:172.21.15.18:3300/0 conn(0x7fd8e01631c0 0x7fd8e00d0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7fd8e6a39640 1 -- 172.21.15.18:0/3711302639 >> 172.21.15.18:0/3711302639 conn(0x7fd8e0073990 msgr2=0x7fd8e006cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7f466e61d640 1 -- 172.21.15.18:0/2320436718 shutdown_connections 2024-09-21T07:10:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7f466e61d640 1 --2- 172.21.15.18:0/2320436718 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f46680b49f0 0x7f46680b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7f466e61d640 1 --2- 172.21.15.18:0/2320436718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f466815af70 0x7f4668073960 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7f21f3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21ec052b60 0x7f21ec04e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7f466e61d640 1 -- 172.21.15.18:0/2320436718 >> 172.21.15.18:0/2320436718 conn(0x7f46680b25e0 msgr2=0x7f46680b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7f466e61d640 1 -- 172.21.15.18:0/2320436718 shutdown_connections 2024-09-21T07:10:54.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7f466e61d640 1 -- 172.21.15.18:0/2320436718 wait complete. 2024-09-21T07:10:54.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7fd8e6a39640 1 -- 172.21.15.18:0/3711302639 shutdown_connections 2024-09-21T07:10:54.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7fd8e6a39640 1 -- 172.21.15.18:0/3711302639 wait complete. 2024-09-21T07:10:54.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7fd8c2d20640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8bc0d30a0 0x7fd8bc15aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7fd8c2d20640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8bc0d34b0 0x7fd8bc0cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7f8652ea9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f864c06f850 0x7f864c147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7fd8c2d20640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8bc162630 0x7fd8bc0ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7f8652ea9640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f864c0d0b20 0x7f864c14d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7fd8c2d20640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd8bc15f590 con 0x7fd8bc0d34b0 2024-09-21T07:10:54.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7f21f3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21ec052b60 0x7f21ec04e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:44574/0 (socket says 172.21.15.18:44574) 2024-09-21T07:10:54.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7f21f3fff640 1 -- 172.21.15.18:0/1268948549 learned_addr learned my addr 172.21.15.18:0/1268948549 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.369+0000 7f21f37fe640 1 --2- 172.21.15.18:0/1268948549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21ec037520 0x7f21ec031b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7f21f2ffd640 1 --2- 172.21.15.18:0/1268948549 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f21ec0520f0 0x7f21ec0d6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7f8650c45640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f864c06f850 0x7f864c147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7f8650c45640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f864c06f850 0x7f864c147630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.18:44576/0 (socket says 172.21.15.18:44576) 2024-09-21T07:10:54.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7f8650c45640 1 -- 172.21.15.18:0/2094429008 learned_addr learned my addr 172.21.15.18:0/2094429008 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7fd8c2d20640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd8bc0d19e0 con 0x7fd8bc162630 2024-09-21T07:10:54.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7fd8c2d20640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fd8bc15f710 con 0x7fd8bc0d30a0 2024-09-21T07:10:54.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7fd8c0abc640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8bc0d30a0 0x7fd8bc15aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7fd8c0abc640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8bc0d30a0 0x7fd8bc15aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.18:40286/0 (socket says 172.21.15.18:40286) 2024-09-21T07:10:54.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7fd8c0abc640 1 -- 172.21.15.18:0/375543776 learned_addr learned my addr 172.21.15.18:0/375543776 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7f864bfff640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f864c0d0b20 0x7f864c14d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7f8652ea9640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f864c15efa0 0x7f864c157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7fd8c12bd640 1 --2- 172.21.15.18:0/375543776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8bc162630 0x7fd8bc0ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.370+0000 7f2454d32640 1 Processor -- start 2024-09-21T07:10:54.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7f2454d32640 1 -- start start 2024-09-21T07:10:54.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7fd8c0abc640 1 -- 172.21.15.18:0/375543776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8bc162630 msgr2=0x7fd8bc0ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7f8651446640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f864c15efa0 0x7f864c157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7fd8c0abc640 1 --2- 172.21.15.18:0/375543776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8bc162630 0x7fd8bc0ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7f8652ea9640 1 -- 172.21.15.18:0/2094429008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f864c15f5c0 con 0x7f864c15efa0 2024-09-21T07:10:54.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7f8652ea9640 1 -- 172.21.15.18:0/2094429008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f864c06e220 con 0x7f864c06f850 2024-09-21T07:10:54.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7f8652ea9640 1 -- 172.21.15.18:0/2094429008 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f864c147fa0 con 0x7f864c0d0b20 2024-09-21T07:10:54.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7fd8c0abc640 1 -- 172.21.15.18:0/375543776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8bc0d34b0 msgr2=0x7fd8bc0cbf70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:10:54.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7fd8c0abc640 1 --2- 172.21.15.18:0/375543776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8bc0d34b0 0x7fd8bc0cbf70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7fd8c0abc640 1 -- 172.21.15.18:0/375543776 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8bc15b3e0 con 0x7fd8bc0d30a0 2024-09-21T07:10:54.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7ff1d055e640 1 Processor -- start 2024-09-21T07:10:54.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7ff1d055e640 1 -- start start 2024-09-21T07:10:54.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7fd8c0abc640 1 --2- 172.21.15.18:0/375543776 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8bc0d30a0 0x7fd8bc15aea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000b3e0 tx=0x7fd8b000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7f21f2ffd640 1 -- 172.21.15.18:0/1268948549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21ec052b60 msgr2=0x7f21ec04e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7f21f2ffd640 1 --2- 172.21.15.18:0/1268948549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21ec052b60 0x7f21ec04e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7f21f2ffd640 1 -- 172.21.15.18:0/1268948549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21ec037520 msgr2=0x7f21ec031b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7f21f2ffd640 1 --2- 172.21.15.18:0/1268948549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21ec037520 0x7f21ec031b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7fdd46883640 1 Processor -- start 2024-09-21T07:10:54.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7fdd46883640 1 -- start start 2024-09-21T07:10:54.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7f21f2ffd640 1 -- 172.21.15.18:0/1268948549 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ec032490 con 0x7f21ec0520f0 2024-09-21T07:10:54.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.371+0000 7fd8b97fa640 1 -- 172.21.15.18:0/375543776 <== mon.2 v2:172.21.15.49:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0015020 con 0x7fd8bc0d30a0 2024-09-21T07:10:54.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.372+0000 7fd8b97fa640 1 -- 172.21.15.18:0/375543776 <== mon.2 v2:172.21.15.49:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8b0011940 con 0x7fd8bc0d30a0 2024-09-21T07:10:54.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.372+0000 7fd8b97fa640 1 -- 172.21.15.18:0/375543776 <== mon.2 v2:172.21.15.49:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0011d90 con 0x7fd8bc0d30a0 2024-09-21T07:10:54.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.372+0000 7fd8c2d20640 1 -- 172.21.15.18:0/375543776 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8bc0caed0 con 0x7fd8bc0d30a0 2024-09-21T07:10:54.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.372+0000 7fd8c2d20640 1 -- 172.21.15.18:0/375543776 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8bc0cb490 con 0x7fd8bc0d30a0 2024-09-21T07:10:54.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.372+0000 7fd8e6a39640 1 Processor -- start 2024-09-21T07:10:54.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.372+0000 7fd8e6a39640 1 -- start start 2024-09-21T07:10:54.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.372+0000 7f864bfff640 1 -- 172.21.15.18:0/2094429008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f864c06f850 msgr2=0x7f864c147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.372+0000 7f864bfff640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f864c06f850 0x7f864c147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.372+0000 7f864bfff640 1 -- 172.21.15.18:0/2094429008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f864c15efa0 msgr2=0x7f864c157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.372+0000 7f864bfff640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f864c15efa0 0x7f864c157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.372+0000 7f864bfff640 1 -- 172.21.15.18:0/2094429008 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864c1f9e90 con 0x7f864c0d0b20 2024-09-21T07:10:54.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.372+0000 7f8651446640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f864c15efa0 0x7f864c157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:10:54.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.372+0000 7f864bfff640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f864c0d0b20 0x7f864c14d3a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8644032000 tx=0x7f8644004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7f466e61d640 1 Processor -- start 2024-09-21T07:10:54.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7f21f2ffd640 1 --2- 172.21.15.18:0/1268948549 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f21ec0520f0 0x7f21ec0d6310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f21e800b410 tx=0x7f21e800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7f466e61d640 1 -- start start 2024-09-21T07:10:54.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7f21dffff640 1 -- 172.21.15.18:0/1268948549 <== mon.2 v2:172.21.15.49:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e8015020 con 0x7f21ec0520f0 2024-09-21T07:10:54.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7f21dffff640 1 -- 172.21.15.18:0/1268948549 <== mon.2 v2:172.21.15.49:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21e8011920 con 0x7f21ec0520f0 2024-09-21T07:10:54.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7f21dffff640 1 -- 172.21.15.18:0/1268948549 <== mon.2 v2:172.21.15.49:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e8011d50 con 0x7f21ec0520f0 2024-09-21T07:10:54.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7f86497fa640 1 -- 172.21.15.18:0/2094429008 <== mon.2 v2:172.21.15.49:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8644045070 con 0x7f864c0d0b20 2024-09-21T07:10:54.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7f86497fa640 1 -- 172.21.15.18:0/2094429008 <== mon.2 v2:172.21.15.49:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8644036400 con 0x7f864c0d0b20 2024-09-21T07:10:54.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7f86497fa640 1 -- 172.21.15.18:0/2094429008 <== mon.2 v2:172.21.15.49:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8644036810 con 0x7f864c0d0b20 2024-09-21T07:10:54.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7f2454d32640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f244804ff40 0x7f24480d9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7ff1d055e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1c0009f60 0x7ff1c00217a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7ff1d055e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1c0036210 0x7ff1c00dcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7ff1d055e640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff1c00e4590 0x7ff1c002dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7ff1d055e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c001c990 con 0x7ff1c0036210 2024-09-21T07:10:54.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7ff1d055e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c001c810 con 0x7ff1c0009f60 2024-09-21T07:10:54.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7ff1d055e640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c001cb10 con 0x7ff1c00e4590 2024-09-21T07:10:54.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7f2454d32640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2448052a80 0x7f24480de9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.373+0000 7f2454d32640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f24480534c0 0x7f244804df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7f21f8a22640 1 -- 172.21.15.18:0/1268948549 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21ec032770 con 0x7f21ec0520f0 2024-09-21T07:10:54.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7f21f8a22640 1 -- 172.21.15.18:0/1268948549 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f21ec033b30 con 0x7f21ec0520f0 2024-09-21T07:10:54.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7f8652ea9640 1 -- 172.21.15.18:0/2094429008 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f864c14d8e0 con 0x7f864c0d0b20 2024-09-21T07:10:54.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7f8652ea9640 1 -- 172.21.15.18:0/2094429008 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f864c157080 con 0x7f864c0d0b20 2024-09-21T07:10:54.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7fd8e6a39640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8e00cf7c0 0x7fd8e01fe290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fd8e6a39640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8e00d13e0 0x7fd8e00c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fd8e6a39640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8e01631c0 0x7fd8e00c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7ff1ceafb640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff1c00e4590 0x7ff1c002dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7ff1ceafb640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff1c00e4590 0x7ff1c002dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.18:40300/0 (socket says 172.21.15.18:40300) 2024-09-21T07:10:54.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7ff1ceafb640 1 -- 172.21.15.18:0/1959695742 learned_addr learned my addr 172.21.15.18:0/1959695742 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7ff1ce2fa640 1 --2- 172.21.15.18:0/1959695742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1c0009f60 0x7ff1c00217a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7ff1cdaf9640 1 --2- 172.21.15.18:0/1959695742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1c0036210 0x7ff1c00dcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7ff1ceafb640 1 -- 172.21.15.18:0/1959695742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1c0009f60 msgr2=0x7ff1c00217a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7ff1ceafb640 1 --2- 172.21.15.18:0/1959695742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1c0009f60 0x7ff1c00217a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7ff1ceafb640 1 -- 172.21.15.18:0/1959695742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1c0036210 msgr2=0x7ff1c00dcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7ff1ceafb640 1 --2- 172.21.15.18:0/1959695742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1c0036210 0x7ff1c00dcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7ff1ceafb640 1 -- 172.21.15.18:0/1959695742 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c00dd880 con 0x7ff1c00e4590 2024-09-21T07:10:54.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7fdd46883640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd40157200 0x7fdd40156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.374+0000 7fdd46883640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdd40157610 0x7fdd400aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fdd46883640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd401568d0 0x7fdd40153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fdd45080640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdd40157610 0x7fdd400aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fdd45080640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdd40157610 0x7fdd400aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3301/0 says I am v2:172.21.15.18:40308/0 (socket says 172.21.15.18:40308) 2024-09-21T07:10:54.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fdd45080640 1 -- 172.21.15.18:0/2831082670 learned_addr learned my addr 172.21.15.18:0/2831082670 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fdd46082640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd401568d0 0x7fdd40153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fdd45881640 1 --2- 172.21.15.18:0/2831082670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd40157200 0x7fdd40156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fdd46883640 1 -- 172.21.15.18:0/2831082670 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdd400b5d50 con 0x7fdd401568d0 2024-09-21T07:10:54.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fd8c2d20640 1 -- 172.21.15.18:0/375543776 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8bc0d1100 con 0x7fd8bc0d30a0 2024-09-21T07:10:54.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fd8e6a39640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e00b3880 con 0x7fd8e00d13e0 2024-09-21T07:10:54.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fd8e6a39640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e00b3700 con 0x7fd8e00cf7c0 2024-09-21T07:10:54.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fd8e6a39640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e00b3a00 con 0x7fd8e01631c0 2024-09-21T07:10:54.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fd8e5236640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8e00d13e0 0x7fd8e00c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fd8e5236640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8e00d13e0 0x7fd8e00c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50300/0 (socket says 172.21.15.18:50300) 2024-09-21T07:10:54.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fd8e5236640 1 -- 172.21.15.18:0/81724910 learned_addr learned my addr 172.21.15.18:0/81724910 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fdd46883640 1 -- 172.21.15.18:0/2831082670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fdd400cd950 con 0x7fdd40157200 2024-09-21T07:10:54.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fdd46883640 1 -- 172.21.15.18:0/2831082670 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fdd400b5ed0 con 0x7fdd40157610 2024-09-21T07:10:54.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fd8b97fa640 1 -- 172.21.15.18:0/375543776 <== mon.2 v2:172.21.15.49:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd8b0018020 con 0x7fd8bc0d30a0 2024-09-21T07:10:54.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fd8e5a37640 1 --2- 172.21.15.18:0/81724910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8e00cf7c0 0x7fd8e01fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7ff1ceafb640 1 --2- 172.21.15.18:0/1959695742 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff1c00e4590 0x7ff1c002dc00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400e6d0 tx=0x7ff1c400eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7ff1beffd640 1 -- 172.21.15.18:0/1959695742 <== mon.2 v2:172.21.15.49:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400cab0 con 0x7ff1c00e4590 2024-09-21T07:10:54.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7ff1beffd640 1 -- 172.21.15.18:0/1959695742 <== mon.2 v2:172.21.15.49:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1c400cc50 con 0x7ff1c00e4590 2024-09-21T07:10:54.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7ff1beffd640 1 -- 172.21.15.18:0/1959695742 <== mon.2 v2:172.21.15.49:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4005280 con 0x7ff1c00e4590 2024-09-21T07:10:54.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7ff1d055e640 1 -- 172.21.15.18:0/1959695742 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c00ddb60 con 0x7ff1c00e4590 2024-09-21T07:10:54.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.375+0000 7fd8e6238640 1 --2- 172.21.15.18:0/81724910 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8e01631c0 0x7fd8e00c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7fdd45080640 1 -- 172.21.15.18:0/2831082670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd40157200 msgr2=0x7fdd40156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7fdd45080640 1 --2- 172.21.15.18:0/2831082670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd40157200 0x7fdd40156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7fdd45080640 1 -- 172.21.15.18:0/2831082670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd401568d0 msgr2=0x7fdd40153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7fdd45080640 1 --2- 172.21.15.18:0/2831082670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd401568d0 0x7fdd40153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7fdd45080640 1 -- 172.21.15.18:0/2831082670 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd401f1ae0 con 0x7fdd40157610 2024-09-21T07:10:54.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7fd8e5236640 1 -- 172.21.15.18:0/81724910 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8e01631c0 msgr2=0x7fd8e00c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7fd8e5236640 1 --2- 172.21.15.18:0/81724910 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8e01631c0 0x7fd8e00c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7fd8e5236640 1 -- 172.21.15.18:0/81724910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8e00cf7c0 msgr2=0x7fd8e01fe290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7f8652ea9640 1 -- 172.21.15.18:0/2094429008 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f864c15ea60 con 0x7f864c0d0b20 2024-09-21T07:10:54.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7ff1d055e640 1 -- 172.21.15.18:0/1959695742 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c00de3c0 con 0x7ff1c00e4590 2024-09-21T07:10:54.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7fd8e5236640 1 --2- 172.21.15.18:0/81724910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8e00cf7c0 0x7fd8e01fe290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7fd8e5236640 1 -- 172.21.15.18:0/81724910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e01fa980 con 0x7fd8e00d13e0 2024-09-21T07:10:54.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7f2454d32640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f24480093d0 con 0x7f2448052a80 2024-09-21T07:10:54.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7f2454d32640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2448009250 con 0x7f244804ff40 2024-09-21T07:10:54.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7f2454d32640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f24480080d0 con 0x7f24480534c0 2024-09-21T07:10:54.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7f244dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2448052a80 0x7f24480de9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7f244dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2448052a80 0x7f24480de9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50324/0 (socket says 172.21.15.18:50324) 2024-09-21T07:10:54.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7f244dd9b640 1 -- 172.21.15.18:0/2191227320 learned_addr learned my addr 172.21.15.18:0/2191227320 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7f244ed9d640 1 --2- 172.21.15.18:0/2191227320 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f24480534c0 0x7f244804df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7fd8b97fa640 1 --2- 172.21.15.18:0/375543776 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd8a8078c90 0x7fd8a807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7fd8b97fa640 1 -- 172.21.15.18:0/375543776 <== mon.2 v2:172.21.15.49:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd8b009ab70 con 0x7fd8bc0d30a0 2024-09-21T07:10:54.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.376+0000 7fd8bbfff640 1 --2- 172.21.15.18:0/375543776 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd8a8078c90 0x7fd8a807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f466e61d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4668072710 0x7f4668149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f244e59c640 1 --2- 172.21.15.18:0/2191227320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f244804ff40 0x7f24480d9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f466e61d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46680b49f0 0x7f466814f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f21dffff640 1 -- 172.21.15.18:0/1268948549 <== mon.2 v2:172.21.15.49:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f21e8018020 con 0x7f21ec0520f0 2024-09-21T07:10:54.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7fdd45080640 1 --2- 172.21.15.18:0/2831082670 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdd40157610 0x7fdd400aff60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdd34000c00 tx=0x7fdd34006c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f244dd9b640 1 -- 172.21.15.18:0/2191227320 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f24480534c0 msgr2=0x7f244804df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f244dd9b640 1 --2- 172.21.15.18:0/2191227320 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f24480534c0 0x7f244804df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f244dd9b640 1 -- 172.21.15.18:0/2191227320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f244804ff40 msgr2=0x7f24480d9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f244dd9b640 1 --2- 172.21.15.18:0/2191227320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f244804ff40 0x7f24480d9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f244dd9b640 1 -- 172.21.15.18:0/2191227320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244817a270 con 0x7f2448052a80 2024-09-21T07:10:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7fd8e5236640 1 --2- 172.21.15.18:0/81724910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8e00d13e0 0x7fd8e00c9a40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00b3e0 tx=0x7fd8dc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f4667fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4668072710 0x7f4668149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f4667fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4668072710 0x7f4668149ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50326/0 (socket says 172.21.15.18:50326) 2024-09-21T07:10:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f4667fff640 1 -- 172.21.15.18:0/1295996990 learned_addr learned my addr 172.21.15.18:0/1295996990 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f244dd9b640 1 --2- 172.21.15.18:0/2191227320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2448052a80 0x7f24480de9d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2440009950 tx=0x7f24400045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f466e61d640 1 --2- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f466815af70 0x7f466814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f46677fe640 1 --2- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46680b49f0 0x7f466814f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f86497fa640 1 -- 172.21.15.18:0/2094429008 <== mon.2 v2:172.21.15.49:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8644048070 con 0x7f864c0d0b20 2024-09-21T07:10:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7f21ddffb640 1 -- 172.21.15.18:0/1268948549 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21ec032200 con 0x7f21ec0520f0 2024-09-21T07:10:54.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7ff1d055e640 1 -- 172.21.15.18:0/1959695742 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c0036620 con 0x7ff1c00e4590 2024-09-21T07:10:54.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.377+0000 7fd8d67fc640 1 -- 172.21.15.18:0/81724910 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc015020 con 0x7fd8e00d13e0 2024-09-21T07:10:54.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.378+0000 7fd8d67fc640 1 -- 172.21.15.18:0/81724910 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8dc011940 con 0x7fd8e00d13e0 2024-09-21T07:10:54.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.378+0000 7fd8e6a39640 1 -- 172.21.15.18:0/81724910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e01fac60 con 0x7fd8e00d13e0 2024-09-21T07:10:54.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.378+0000 7f466e61d640 1 -- 172.21.15.18:0/1295996990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f466806a550 con 0x7f4668072710 2024-09-21T07:10:54.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.378+0000 7f466cbba640 1 --2- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f466815af70 0x7f466814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.378+0000 7f2446ffd640 1 -- 172.21.15.18:0/2191227320 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2440031600 con 0x7f2448052a80 2024-09-21T07:10:54.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.378+0000 7f2446ffd640 1 -- 172.21.15.18:0/2191227320 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2440031c90 con 0x7f2448052a80 2024-09-21T07:10:54.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.378+0000 7f2446ffd640 1 -- 172.21.15.18:0/2191227320 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2440031e60 con 0x7f2448052a80 2024-09-21T07:10:54.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.378+0000 7f466e61d640 1 -- 172.21.15.18:0/1295996990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f466806a3d0 con 0x7f46680b49f0 2024-09-21T07:10:54.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.378+0000 7f2454d32640 1 -- 172.21.15.18:0/2191227320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24480d9ec0 con 0x7f2448052a80 2024-09-21T07:10:54.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.378+0000 7f21dffff640 1 --2- 172.21.15.18:0/1268948549 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f21d8078bc0 0x7f21d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.378+0000 7f21dffff640 1 -- 172.21.15.18:0/1268948549 <== mon.2 v2:172.21.15.49:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f21e809a4d0 con 0x7f21ec0520f0 2024-09-21T07:10:54.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.378+0000 7f2454d32640 1 -- 172.21.15.18:0/2191227320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f244817e010 con 0x7f2448052a80 2024-09-21T07:10:54.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.378+0000 7f466e61d640 1 -- 172.21.15.18:0/1295996990 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f466806fbd0 con 0x7f466815af70 2024-09-21T07:10:54.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.378+0000 7f21f37fe640 1 --2- 172.21.15.18:0/1268948549 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f21d8078bc0 0x7f21d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.378+0000 7fd8e6a39640 1 -- 172.21.15.18:0/81724910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e00cceb0 con 0x7fd8e00d13e0 2024-09-21T07:10:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.379+0000 7fd8d67fc640 1 -- 172.21.15.18:0/81724910 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc011d90 con 0x7fd8e00d13e0 2024-09-21T07:10:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.379+0000 7fd8bbfff640 1 --2- 172.21.15.18:0/375543776 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd8a8078c90 0x7fd8a807b1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4035000 tx=0x7fd8b4004ab0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.379+0000 7f46677fe640 1 -- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f466815af70 msgr2=0x7f466814f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.379+0000 7f46677fe640 1 --2- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f466815af70 0x7f466814f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.379+0000 7f86497fa640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8638078c60 0x7f863807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.379+0000 7f46677fe640 1 -- 172.21.15.18:0/1295996990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4668072710 msgr2=0x7f4668149ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.379+0000 7f46677fe640 1 --2- 172.21.15.18:0/1295996990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4668072710 0x7f4668149ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.379+0000 7f46677fe640 1 -- 172.21.15.18:0/1295996990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46680cefa0 con 0x7f46680b49f0 2024-09-21T07:10:54.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.379+0000 7f8650c45640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8638078c60 0x7f863807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.379+0000 7f21f37fe640 1 --2- 172.21.15.18:0/1268948549 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f21d8078bc0 0x7f21d807b0d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f21ec04f760 tx=0x7f21f406bd70 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.379+0000 7f86497fa640 1 -- 172.21.15.18:0/2094429008 <== mon.2 v2:172.21.15.49:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f86440bc210 con 0x7f864c0d0b20 2024-09-21T07:10:54.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.380+0000 7f2454d32640 1 -- 172.21.15.18:0/2191227320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f244817daa0 con 0x7f2448052a80 2024-09-21T07:10:54.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.379+0000 7f46677fe640 1 --2- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46680b49f0 0x7f466814f040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f465c009510 tx=0x7f465c0099d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.379+0000 7f4664ff9640 1 -- 172.21.15.18:0/1295996990 <== mon.1 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c018020 con 0x7f46680b49f0 2024-09-21T07:10:54.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.380+0000 7f4664ff9640 1 -- 172.21.15.18:0/1295996990 <== mon.1 v2:172.21.15.49:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f465c014910 con 0x7f46680b49f0 2024-09-21T07:10:54.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.380+0000 7f4664ff9640 1 -- 172.21.15.18:0/1295996990 <== mon.1 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c014d60 con 0x7f46680b49f0 2024-09-21T07:10:54.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.380+0000 7f466e61d640 1 -- 172.21.15.18:0/1295996990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46680cf280 con 0x7f46680b49f0 2024-09-21T07:10:54.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.380+0000 7f466e61d640 1 -- 172.21.15.18:0/1295996990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46680cf840 con 0x7f46680b49f0 2024-09-21T07:10:54.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.380+0000 7f8650c45640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8638078c60 0x7f863807b170 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f863c009670 tx=0x7f863c005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.380+0000 7fd8d67fc640 1 -- 172.21.15.18:0/81724910 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd8dc018020 con 0x7fd8e00d13e0 2024-09-21T07:10:54.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.381+0000 7fd8e6a39640 1 -- 172.21.15.18:0/81724910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8e00b2fb0 con 0x7fd8e00d13e0 2024-09-21T07:10:54.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.381+0000 7fd8d67fc640 1 --2- 172.21.15.18:0/81724910 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd8c4078c60 0x7fd8c407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.381+0000 7fd8d67fc640 1 -- 172.21.15.18:0/81724910 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd8dc09ac40 con 0x7fd8e00d13e0 2024-09-21T07:10:54.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.381+0000 7f466e61d640 1 -- 172.21.15.18:0/1295996990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46680ced10 con 0x7f46680b49f0 2024-09-21T07:10:54.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.381+0000 7f2446ffd640 1 -- 172.21.15.18:0/2191227320 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2440033330 con 0x7f2448052a80 2024-09-21T07:10:54.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.382+0000 7fd8e5a37640 1 --2- 172.21.15.18:0/81724910 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd8c4078c60 0x7fd8c407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.382+0000 7f4664ff9640 1 -- 172.21.15.18:0/1295996990 <== mon.1 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f465c01b020 con 0x7f46680b49f0 2024-09-21T07:10:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.382+0000 7fd8b97fa640 1 -- 172.21.15.18:0/375543776 <== mon.2 v2:172.21.15.49:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd8b001f020 con 0x7fd8bc0d30a0 2024-09-21T07:10:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.382+0000 7fd8e5a37640 1 --2- 172.21.15.18:0/81724910 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd8c4078c60 0x7fd8c407b170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00098e0 tx=0x7fd8d0009060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.382+0000 7f2446ffd640 1 --2- 172.21.15.18:0/2191227320 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2430078c90 0x7f243007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.382+0000 7fdd3e7fc640 1 -- 172.21.15.18:0/2831082670 <== mon.2 v2:172.21.15.49:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34031070 con 0x7fdd40157610 2024-09-21T07:10:54.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.382+0000 7f2446ffd640 1 -- 172.21.15.18:0/2191227320 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f24400bc580 con 0x7f2448052a80 2024-09-21T07:10:54.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.382+0000 7fdd46883640 1 -- 172.21.15.18:0/2831082670 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd401558b0 con 0x7fdd40157610 2024-09-21T07:10:54.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.382+0000 7f244e59c640 1 --2- 172.21.15.18:0/2191227320 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2430078c90 0x7f243007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.383+0000 7fdd46883640 1 -- 172.21.15.18:0/2831082670 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd40155e70 con 0x7fdd40157610 2024-09-21T07:10:54.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.383+0000 7f4664ff9640 1 --2- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4654078be0 0x7f465407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.383+0000 7f4664ff9640 1 -- 172.21.15.18:0/1295996990 <== mon.1 v2:172.21.15.49:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f465c09aef0 con 0x7f46680b49f0 2024-09-21T07:10:54.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.383+0000 7f4667fff640 1 --2- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4654078be0 0x7f465407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.383+0000 7f244e59c640 1 --2- 172.21.15.18:0/2191227320 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2430078c90 0x7f243007b1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f244800de80 tx=0x7f2438007e30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.384+0000 7f4667fff640 1 --2- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4654078be0 0x7f465407b0f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4658009230 tx=0x7f4658004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.384+0000 7fdd46883640 1 -- 172.21.15.18:0/2831082670 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd40160bc0 con 0x7fdd40157610 2024-09-21T07:10:54.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.384+0000 7ff1beffd640 1 -- 172.21.15.18:0/1959695742 <== mon.2 v2:172.21.15.49:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff1c4005420 con 0x7ff1c00e4590 2024-09-21T07:10:54.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.384+0000 7ff1beffd640 1 --2- 172.21.15.18:0/1959695742 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff1ac078be0 0x7ff1ac07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.385+0000 7ff1ce2fa640 1 --2- 172.21.15.18:0/1959695742 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff1ac078be0 0x7ff1ac07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.385+0000 7ff1ce2fa640 1 --2- 172.21.15.18:0/1959695742 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff1ac078be0 0x7ff1ac07b0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8034000 tx=0x7ff1b8004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.388+0000 7f21dffff640 1 -- 172.21.15.18:0/1268948549 <== mon.2 v2:172.21.15.49:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f21e801f070 con 0x7f21ec0520f0 2024-09-21T07:10:54.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.388+0000 7f4664ff9640 1 -- 172.21.15.18:0/1295996990 <== mon.1 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f465c022020 con 0x7f46680b49f0 2024-09-21T07:10:54.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.389+0000 7f2446ffd640 1 -- 172.21.15.18:0/2191227320 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2440052080 con 0x7f2448052a80 2024-09-21T07:10:54.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.393+0000 7fdd3e7fc640 1 -- 172.21.15.18:0/2831082670 <== mon.2 v2:172.21.15.49:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd34006290 con 0x7fdd40157610 2024-09-21T07:10:54.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.393+0000 7fdd3e7fc640 1 -- 172.21.15.18:0/2831082670 <== mon.2 v2:172.21.15.49:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34003a60 con 0x7fdd40157610 2024-09-21T07:10:54.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.393+0000 7f86497fa640 1 -- 172.21.15.18:0/2094429008 <== mon.2 v2:172.21.15.49:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8644032030 con 0x7f864c0d0b20 2024-09-21T07:10:54.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.394+0000 7ff1beffd640 1 -- 172.21.15.18:0/1959695742 <== mon.2 v2:172.21.15.49:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff1c405fa00 con 0x7ff1c00e4590 2024-09-21T07:10:54.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.398+0000 7ff1beffd640 1 -- 172.21.15.18:0/1959695742 <== mon.2 v2:172.21.15.49:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff1c400ce20 con 0x7ff1c00e4590 2024-09-21T07:10:54.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.399+0000 7fd8d67fc640 1 -- 172.21.15.18:0/81724910 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd8dc01f020 con 0x7fd8e00d13e0 2024-09-21T07:10:54.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.400+0000 7fdd3e7fc640 1 -- 172.21.15.18:0/2831082670 <== mon.2 v2:172.21.15.49:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdd34034070 con 0x7fdd40157610 2024-09-21T07:10:54.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.401+0000 7fdd3e7fc640 1 --2- 172.21.15.18:0/2831082670 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fdd2c078b90 0x7fdd2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:54.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.401+0000 7fdd3e7fc640 1 -- 172.21.15.18:0/2831082670 <== mon.2 v2:172.21.15.49:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdd340bb460 con 0x7fdd40157610 2024-09-21T07:10:54.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.401+0000 7fdd45881640 1 --2- 172.21.15.18:0/2831082670 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fdd2c078b90 0x7fdd2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:54.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.403+0000 7fdd3e7fc640 1 -- 172.21.15.18:0/2831082670 <== mon.2 v2:172.21.15.49:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdd340839a0 con 0x7fdd40157610 2024-09-21T07:10:54.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.409+0000 7fdd45881640 1 --2- 172.21.15.18:0/2831082670 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fdd2c078b90 0x7fdd2c07b0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdd38005e00 tx=0x7fdd38009560 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:54.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.820+0000 7f466e61d640 1 -- 172.21.15.18:0/1295996990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f46680b4e00 con 0x7f46680b49f0 2024-09-21T07:10:54.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.820+0000 7f4664ff9640 1 -- 172.21.15.18:0/1295996990 <== mon.1 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f465c011070 con 0x7f46680b49f0 2024-09-21T07:10:54.823 INFO:teuthology.orchestra.run.smithi018.stdout:60129542152 2024-09-21T07:10:54.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.822+0000 7f8652ea9640 1 -- 172.21.15.18:0/2094429008 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f864c0b1030 con 0x7f864c0d0b20 2024-09-21T07:10:54.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.822+0000 7f86497fa640 1 -- 172.21.15.18:0/2094429008 <== mon.2 v2:172.21.15.49:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8644083fe0 con 0x7f864c0d0b20 2024-09-21T07:10:54.825 INFO:teuthology.orchestra.run.smithi018.stdout:64424509447 2024-09-21T07:10:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.824+0000 7f466e61d640 1 -- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4654078be0 msgr2=0x7f465407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.824+0000 7f466e61d640 1 --2- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4654078be0 0x7f465407b0f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4658009230 tx=0x7f4658004730 comp rx=0 tx=0).stop 2024-09-21T07:10:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.825+0000 7f466e61d640 1 -- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46680b49f0 msgr2=0x7f466814f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.825+0000 7f466e61d640 1 --2- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46680b49f0 0x7f466814f040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f465c009510 tx=0x7f465c0099d0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.825+0000 7f466e61d640 1 -- 172.21.15.18:0/1295996990 shutdown_connections 2024-09-21T07:10:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.825+0000 7f466e61d640 1 --2- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4654078be0 0x7f465407b0f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.825+0000 7f466e61d640 1 --2- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f466815af70 0x7f466814f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.825+0000 7f466e61d640 1 --2- 172.21.15.18:0/1295996990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46680b49f0 0x7f466814f040 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.825+0000 7f466e61d640 1 --2- 172.21.15.18:0/1295996990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4668072710 0x7f4668149ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.825+0000 7f466e61d640 1 -- 172.21.15.18:0/1295996990 >> 172.21.15.18:0/1295996990 conn(0x7f46680b25e0 msgr2=0x7f46681593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.826+0000 7f466e61d640 1 -- 172.21.15.18:0/1295996990 shutdown_connections 2024-09-21T07:10:54.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.826+0000 7f466e61d640 1 -- 172.21.15.18:0/1295996990 wait complete. 2024-09-21T07:10:54.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.826+0000 7f8632ffd640 1 -- 172.21.15.18:0/2094429008 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8638078c60 msgr2=0x7f863807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.826+0000 7f8632ffd640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8638078c60 0x7f863807b170 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f863c009670 tx=0x7f863c005f90 comp rx=0 tx=0).stop 2024-09-21T07:10:54.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.826+0000 7f8632ffd640 1 -- 172.21.15.18:0/2094429008 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f864c0d0b20 msgr2=0x7f864c14d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.826+0000 7f8632ffd640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f864c0d0b20 0x7f864c14d3a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8644032000 tx=0x7f8644004270 comp rx=0 tx=0).stop 2024-09-21T07:10:54.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.826+0000 7f8632ffd640 1 -- 172.21.15.18:0/2094429008 shutdown_connections 2024-09-21T07:10:54.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.827+0000 7f8632ffd640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f864c15efa0 0x7f864c157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.827+0000 7f8632ffd640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8638078c60 0x7f863807b170 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.827+0000 7f8632ffd640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f864c0d0b20 0x7f864c14d3a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.827+0000 7f8632ffd640 1 --2- 172.21.15.18:0/2094429008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f864c06f850 0x7f864c147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.827+0000 7f8632ffd640 1 -- 172.21.15.18:0/2094429008 >> 172.21.15.18:0/2094429008 conn(0x7f864c0b1fe0 msgr2=0x7f864c06e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.827+0000 7f8632ffd640 1 -- 172.21.15.18:0/2094429008 shutdown_connections 2024-09-21T07:10:54.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.827+0000 7f8632ffd640 1 -- 172.21.15.18:0/2094429008 wait complete. 2024-09-21T07:10:54.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.829+0000 7f21ddffb640 1 -- 172.21.15.18:0/1268948549 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f21ec0511e0 con 0x7f21ec0520f0 2024-09-21T07:10:54.834 INFO:teuthology.orchestra.run.smithi018.stdout:64424509447 2024-09-21T07:10:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.830+0000 7f21dffff640 1 -- 172.21.15.18:0/1268948549 <== mon.2 v2:172.21.15.49:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f21e8062350 con 0x7f21ec0520f0 2024-09-21T07:10:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.831+0000 7f2454d32640 1 -- 172.21.15.18:0/2191227320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2448008600 con 0x7f2448052a80 2024-09-21T07:10:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.832+0000 7f2446ffd640 1 -- 172.21.15.18:0/2191227320 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f244003f030 con 0x7f2448052a80 2024-09-21T07:10:54.836 INFO:teuthology.orchestra.run.smithi018.stdout:60129542150 2024-09-21T07:10:54.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.833+0000 7ff1d055e640 1 -- 172.21.15.18:0/1959695742 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff1c00dd610 con 0x7ff1c00e4590 2024-09-21T07:10:54.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.833+0000 7ff1beffd640 1 -- 172.21.15.18:0/1959695742 <== mon.2 v2:172.21.15.49:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff1c4063e90 con 0x7ff1c00e4590 2024-09-21T07:10:54.837 INFO:teuthology.orchestra.run.smithi018.stdout:64424509448 2024-09-21T07:10:54.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.835+0000 7fd8c2d20640 1 -- 172.21.15.18:0/375543776 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd8bc069870 con 0x7fd8bc0d30a0 2024-09-21T07:10:54.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.835+0000 7fd8b97fa640 1 -- 172.21.15.18:0/375543776 <== mon.2 v2:172.21.15.49:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd8b001f020 con 0x7fd8bc0d30a0 2024-09-21T07:10:54.838 INFO:teuthology.orchestra.run.smithi018.stdout:64424509447 2024-09-21T07:10:54.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.835+0000 7f21ddffb640 1 -- 172.21.15.18:0/1268948549 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f21d8078bc0 msgr2=0x7f21d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f21ddffb640 1 --2- 172.21.15.18:0/1268948549 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f21d8078bc0 0x7f21d807b0d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f21ec04f760 tx=0x7f21f406bd70 comp rx=0 tx=0).stop 2024-09-21T07:10:54.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f21ddffb640 1 -- 172.21.15.18:0/1268948549 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f21ec0520f0 msgr2=0x7f21ec0d6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f21ddffb640 1 --2- 172.21.15.18:0/1268948549 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f21ec0520f0 0x7f21ec0d6310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f21e800b410 tx=0x7f21e800b8d0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f21ddffb640 1 -- 172.21.15.18:0/1268948549 shutdown_connections 2024-09-21T07:10:54.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f21ddffb640 1 --2- 172.21.15.18:0/1268948549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21ec052b60 0x7f21ec04e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f21ddffb640 1 --2- 172.21.15.18:0/1268948549 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f21d8078bc0 0x7f21d807b0d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f21ddffb640 1 --2- 172.21.15.18:0/1268948549 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f21ec0520f0 0x7f21ec0d6310 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f21ddffb640 1 --2- 172.21.15.18:0/1268948549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21ec037520 0x7f21ec031b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f21ddffb640 1 -- 172.21.15.18:0/1268948549 >> 172.21.15.18:0/1268948549 conn(0x7f21ec01e230 msgr2=0x7f21ec04ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f2454d32640 1 -- 172.21.15.18:0/2191227320 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2430078c90 msgr2=0x7f243007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f2454d32640 1 --2- 172.21.15.18:0/2191227320 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2430078c90 0x7f243007b1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f244800de80 tx=0x7f2438007e30 comp rx=0 tx=0).stop 2024-09-21T07:10:54.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f2454d32640 1 -- 172.21.15.18:0/2191227320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2448052a80 msgr2=0x7f24480de9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f2454d32640 1 --2- 172.21.15.18:0/2191227320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2448052a80 0x7f24480de9d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2440009950 tx=0x7f24400045e0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f2454d32640 1 -- 172.21.15.18:0/2191227320 shutdown_connections 2024-09-21T07:10:54.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f2454d32640 1 --2- 172.21.15.18:0/2191227320 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2430078c90 0x7f243007b1a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f2454d32640 1 --2- 172.21.15.18:0/2191227320 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f24480534c0 0x7f244804df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f2454d32640 1 --2- 172.21.15.18:0/2191227320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2448052a80 0x7f24480de9d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f2454d32640 1 --2- 172.21.15.18:0/2191227320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f244804ff40 0x7f24480d9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f21ddffb640 1 -- 172.21.15.18:0/1268948549 shutdown_connections 2024-09-21T07:10:54.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f21ddffb640 1 -- 172.21.15.18:0/1268948549 wait complete. 2024-09-21T07:10:54.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f2454d32640 1 -- 172.21.15.18:0/2191227320 >> 172.21.15.18:0/2191227320 conn(0x7f244801ead0 msgr2=0x7f244800be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f2454d32640 1 -- 172.21.15.18:0/2191227320 shutdown_connections 2024-09-21T07:10:54.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.836+0000 7f2454d32640 1 -- 172.21.15.18:0/2191227320 wait complete. 2024-09-21T07:10:54.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.837+0000 7fd8e6a39640 1 -- 172.21.15.18:0/81724910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd8e00c7d10 con 0x7fd8e00d13e0 2024-09-21T07:10:54.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.837+0000 7fd8d67fc640 1 -- 172.21.15.18:0/81724910 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd8dc063060 con 0x7fd8e00d13e0 2024-09-21T07:10:54.842 INFO:teuthology.orchestra.run.smithi018.stdout:64424509447 2024-09-21T07:10:54.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.838+0000 7ff1d055e640 1 -- 172.21.15.18:0/1959695742 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff1ac078be0 msgr2=0x7ff1ac07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.838+0000 7ff1d055e640 1 --2- 172.21.15.18:0/1959695742 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff1ac078be0 0x7ff1ac07b0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8034000 tx=0x7ff1b8004730 comp rx=0 tx=0).stop 2024-09-21T07:10:54.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.838+0000 7ff1d055e640 1 -- 172.21.15.18:0/1959695742 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff1c00e4590 msgr2=0x7ff1c002dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.838+0000 7ff1d055e640 1 --2- 172.21.15.18:0/1959695742 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff1c00e4590 0x7ff1c002dc00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400e6d0 tx=0x7ff1c400eb90 comp rx=0 tx=0).stop 2024-09-21T07:10:54.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.838+0000 7ff1d055e640 1 -- 172.21.15.18:0/1959695742 shutdown_connections 2024-09-21T07:10:54.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.838+0000 7ff1d055e640 1 --2- 172.21.15.18:0/1959695742 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff1ac078be0 0x7ff1ac07b0f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.838+0000 7fdd46883640 1 -- 172.21.15.18:0/2831082670 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fdd4015c6d0 con 0x7fdd40157610 2024-09-21T07:10:54.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.838+0000 7ff1d055e640 1 --2- 172.21.15.18:0/1959695742 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff1c00e4590 0x7ff1c002dc00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.838+0000 7ff1d055e640 1 --2- 172.21.15.18:0/1959695742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1c0036210 0x7ff1c00dcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.838+0000 7ff1d055e640 1 --2- 172.21.15.18:0/1959695742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1c0009f60 0x7ff1c00217a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.838+0000 7ff1d055e640 1 -- 172.21.15.18:0/1959695742 >> 172.21.15.18:0/1959695742 conn(0x7ff1c0051420 msgr2=0x7ff1c00302b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.839+0000 7ff1d055e640 1 -- 172.21.15.18:0/1959695742 shutdown_connections 2024-09-21T07:10:54.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.839+0000 7ff1d055e640 1 -- 172.21.15.18:0/1959695742 wait complete. 2024-09-21T07:10:54.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.839+0000 7fdd3e7fc640 1 -- 172.21.15.18:0/2831082670 <== mon.2 v2:172.21.15.49:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdd340832a0 con 0x7fdd40157610 2024-09-21T07:10:54.845 INFO:teuthology.orchestra.run.smithi018.stdout:60129542151 2024-09-21T07:10:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.840+0000 7fd8c2d20640 1 -- 172.21.15.18:0/375543776 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd8a8078c90 msgr2=0x7fd8a807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.840+0000 7fd8c2d20640 1 --2- 172.21.15.18:0/375543776 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd8a8078c90 0x7fd8a807b1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4035000 tx=0x7fd8b4004ab0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.840+0000 7fd8c2d20640 1 -- 172.21.15.18:0/375543776 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8bc0d30a0 msgr2=0x7fd8bc15aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.840+0000 7fd8c2d20640 1 --2- 172.21.15.18:0/375543776 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8bc0d30a0 0x7fd8bc15aea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000b3e0 tx=0x7fd8b000b8a0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.840+0000 7fd8c2d20640 1 -- 172.21.15.18:0/375543776 shutdown_connections 2024-09-21T07:10:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.840+0000 7fd8c2d20640 1 --2- 172.21.15.18:0/375543776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8bc162630 0x7fd8bc0ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.841+0000 7fd8c2d20640 1 --2- 172.21.15.18:0/375543776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8bc0d34b0 0x7fd8bc0cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.841+0000 7fd8c2d20640 1 --2- 172.21.15.18:0/375543776 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd8a8078c90 0x7fd8a807b1a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.841+0000 7fd8c2d20640 1 --2- 172.21.15.18:0/375543776 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8bc0d30a0 0x7fd8bc15aea0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.841+0000 7fd8c2d20640 1 -- 172.21.15.18:0/375543776 >> 172.21.15.18:0/375543776 conn(0x7fd8bc073e20 msgr2=0x7fd8bc0b6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.841+0000 7fd8c2d20640 1 -- 172.21.15.18:0/375543776 shutdown_connections 2024-09-21T07:10:54.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.841+0000 7fd8c2d20640 1 -- 172.21.15.18:0/375543776 wait complete. 2024-09-21T07:10:54.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.842+0000 7fd8e6a39640 1 -- 172.21.15.18:0/81724910 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd8c4078c60 msgr2=0x7fd8c407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.842+0000 7fd8e6a39640 1 --2- 172.21.15.18:0/81724910 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd8c4078c60 0x7fd8c407b170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00098e0 tx=0x7fd8d0009060 comp rx=0 tx=0).stop 2024-09-21T07:10:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.842+0000 7fd8e6a39640 1 -- 172.21.15.18:0/81724910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8e00d13e0 msgr2=0x7fd8e00c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.842+0000 7fd8e6a39640 1 --2- 172.21.15.18:0/81724910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8e00d13e0 0x7fd8e00c9a40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00b3e0 tx=0x7fd8dc00b8a0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.842+0000 7fd8e6a39640 1 -- 172.21.15.18:0/81724910 shutdown_connections 2024-09-21T07:10:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.842+0000 7fd8e6a39640 1 --2- 172.21.15.18:0/81724910 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd8c4078c60 0x7fd8c407b170 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.842+0000 7fd8e6a39640 1 --2- 172.21.15.18:0/81724910 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd8e01631c0 0x7fd8e00c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.842+0000 7fd8e6a39640 1 --2- 172.21.15.18:0/81724910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8e00d13e0 0x7fd8e00c9a40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.842+0000 7fd8e6a39640 1 --2- 172.21.15.18:0/81724910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8e00cf7c0 0x7fd8e01fe290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.842+0000 7fd8e6a39640 1 -- 172.21.15.18:0/81724910 >> 172.21.15.18:0/81724910 conn(0x7fd8e0073990 msgr2=0x7fd8e0076060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.843+0000 7fd8e6a39640 1 -- 172.21.15.18:0/81724910 shutdown_connections 2024-09-21T07:10:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.843+0000 7fd8e6a39640 1 -- 172.21.15.18:0/81724910 wait complete. 2024-09-21T07:10:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.844+0000 7fdd46883640 1 -- 172.21.15.18:0/2831082670 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fdd2c078b90 msgr2=0x7fdd2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.844+0000 7fdd46883640 1 --2- 172.21.15.18:0/2831082670 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fdd2c078b90 0x7fdd2c07b0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdd38005e00 tx=0x7fdd38009560 comp rx=0 tx=0).stop 2024-09-21T07:10:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.844+0000 7fdd46883640 1 -- 172.21.15.18:0/2831082670 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdd40157610 msgr2=0x7fdd400aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.844+0000 7fdd46883640 1 --2- 172.21.15.18:0/2831082670 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdd40157610 0x7fdd400aff60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdd34000c00 tx=0x7fdd34006c60 comp rx=0 tx=0).stop 2024-09-21T07:10:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.844+0000 7fdd46883640 1 -- 172.21.15.18:0/2831082670 shutdown_connections 2024-09-21T07:10:54.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.844+0000 7fdd46883640 1 --2- 172.21.15.18:0/2831082670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd401568d0 0x7fdd40153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.844+0000 7fdd46883640 1 --2- 172.21.15.18:0/2831082670 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fdd2c078b90 0x7fdd2c07b0a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.844+0000 7fdd46883640 1 --2- 172.21.15.18:0/2831082670 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdd40157610 0x7fdd400aff60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.844+0000 7fdd46883640 1 --2- 172.21.15.18:0/2831082670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd40157200 0x7fdd40156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:54.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.844+0000 7fdd46883640 1 -- 172.21.15.18:0/2831082670 >> 172.21.15.18:0/2831082670 conn(0x7fdd4006eda0 msgr2=0x7fdd4015f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:54.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.845+0000 7fdd46883640 1 -- 172.21.15.18:0/2831082670 shutdown_connections 2024-09-21T07:10:54.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:54.845+0000 7fdd46883640 1 -- 172.21.15.18:0/2831082670 wait complete. 2024-09-21T07:10:54.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.0 2024-09-21T07:10:54.851 DEBUG:teuthology.parallel:result is None 2024-09-21T07:10:54.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.7 2024-09-21T07:10:54.854 DEBUG:teuthology.parallel:result is None 2024-09-21T07:10:54.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-09-21T07:10:54.862 DEBUG:teuthology.parallel:result is None 2024-09-21T07:10:54.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.5 2024-09-21T07:10:54.862 DEBUG:teuthology.parallel:result is None 2024-09-21T07:10:54.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.4 2024-09-21T07:10:54.864 DEBUG:teuthology.parallel:result is None 2024-09-21T07:10:54.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-09-21T07:10:54.866 DEBUG:teuthology.parallel:result is None 2024-09-21T07:10:54.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-09-21T07:10:54.868 DEBUG:teuthology.parallel:result is None 2024-09-21T07:10:54.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.1 2024-09-21T07:10:54.869 DEBUG:teuthology.parallel:result is None 2024-09-21T07:10:54.869 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:10:54.869 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:10:55.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.022+0000 7f0db72a9640 1 -- 172.21.15.18:0/1648993775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db015ef50 msgr2=0x7f0db015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:55.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.022+0000 7f0db72a9640 1 --2- 172.21.15.18:0/1648993775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db015ef50 0x7f0db015c520 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0da0005fd0 tx=0x7f0da002aa90 comp rx=0 tx=0).stop 2024-09-21T07:10:55.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.022+0000 7f0db72a9640 1 -- 172.21.15.18:0/1648993775 shutdown_connections 2024-09-21T07:10:55.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.022+0000 7f0db72a9640 1 --2- 172.21.15.18:0/1648993775 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0db00cef70 0x7f0db00d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.022+0000 7f0db72a9640 1 --2- 172.21.15.18:0/1648993775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db015ef50 0x7f0db015c520 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.022+0000 7f0db72a9640 1 -- 172.21.15.18:0/1648993775 >> 172.21.15.18:0/1648993775 conn(0x7f0db0073f30 msgr2=0x7f0db00b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:55.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.022+0000 7f0db72a9640 1 -- 172.21.15.18:0/1648993775 shutdown_connections 2024-09-21T07:10:55.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.022+0000 7f0db72a9640 1 -- 172.21.15.18:0/1648993775 wait complete. 2024-09-21T07:10:55.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.023+0000 7f0db72a9640 1 Processor -- start 2024-09-21T07:10:55.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.024+0000 7f0db72a9640 1 -- start start 2024-09-21T07:10:55.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db72a9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0db00cef70 0x7f0db00cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:55.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db72a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db00d3580 0x7f0db015ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:55.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db72a9640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0db015ef50 0x7f0db00b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:55.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db72a9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0db00d11a0 con 0x7f0db00d3580 2024-09-21T07:10:55.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db72a9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0db00d1020 con 0x7f0db00cef70 2024-09-21T07:10:55.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db72a9640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f0db00d1320 con 0x7f0db015ef50 2024-09-21T07:10:55.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db4844640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db00d3580 0x7f0db015ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:55.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db4844640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db00d3580 0x7f0db015ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50336/0 (socket says 172.21.15.18:50336) 2024-09-21T07:10:55.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db4844640 1 -- 172.21.15.18:0/1479491219 learned_addr learned my addr 172.21.15.18:0/1479491219 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:55.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db5045640 1 --2- 172.21.15.18:0/1479491219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0db00cef70 0x7f0db00cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:55.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db5846640 1 --2- 172.21.15.18:0/1479491219 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0db015ef50 0x7f0db00b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:55.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db4844640 1 -- 172.21.15.18:0/1479491219 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0db015ef50 msgr2=0x7f0db00b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:55.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db4844640 1 --2- 172.21.15.18:0/1479491219 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0db015ef50 0x7f0db00b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db4844640 1 -- 172.21.15.18:0/1479491219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0db00cef70 msgr2=0x7f0db00cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:55.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db4844640 1 --2- 172.21.15.18:0/1479491219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0db00cef70 0x7f0db00cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db4844640 1 -- 172.21.15.18:0/1479491219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db00ce460 con 0x7f0db00d3580 2024-09-21T07:10:55.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.025+0000 7f0db4844640 1 --2- 172.21.15.18:0/1479491219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db00d3580 0x7f0db015ac80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0da400d720 tx=0x7f0da400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:55.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.026+0000 7f0dadffb640 1 -- 172.21.15.18:0/1479491219 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da4017070 con 0x7f0db00d3580 2024-09-21T07:10:55.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.026+0000 7f0dadffb640 1 -- 172.21.15.18:0/1479491219 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0da4004310 con 0x7f0db00d3580 2024-09-21T07:10:55.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.026+0000 7f0db72a9640 1 -- 172.21.15.18:0/1479491219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db00ce740 con 0x7f0db00d3580 2024-09-21T07:10:55.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.026+0000 7f0dadffb640 1 -- 172.21.15.18:0/1479491219 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da4009a80 con 0x7f0db00d3580 2024-09-21T07:10:55.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.026+0000 7f0db72a9640 1 -- 172.21.15.18:0/1479491219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db00ced00 con 0x7f0db00d3580 2024-09-21T07:10:55.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.027+0000 7f0db72a9640 1 -- 172.21.15.18:0/1479491219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db00ce1d0 con 0x7f0db00d3580 2024-09-21T07:10:55.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.028+0000 7f0dadffb640 1 -- 172.21.15.18:0/1479491219 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0da4009c20 con 0x7f0db00d3580 2024-09-21T07:10:55.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.028+0000 7f0dadffb640 1 --2- 172.21.15.18:0/1479491219 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0d9c078b90 0x7f0d9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:55.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.028+0000 7f0dadffb640 1 -- 172.21.15.18:0/1479491219 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0da409acf0 con 0x7f0db00d3580 2024-09-21T07:10:55.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.028+0000 7f0db5045640 1 --2- 172.21.15.18:0/1479491219 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0d9c078b90 0x7f0d9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:55.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.029+0000 7f0db5045640 1 --2- 172.21.15.18:0/1479491219 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0d9c078b90 0x7f0d9c07b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0da0035000 tx=0x7f0da0038040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:55.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.033+0000 7f0dadffb640 1 -- 172.21.15.18:0/1479491219 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0da409f070 con 0x7f0db00d3580 2024-09-21T07:10:55.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.220+0000 7f0db72a9640 1 -- 172.21.15.18:0/1479491219 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0db00d17d0 con 0x7f0d9c078b90 2024-09-21T07:10:55.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.225+0000 7f0dadffb640 1 -- 172.21.15.18:0/1479491219 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f0db00d17d0 con 0x7f0d9c078b90 2024-09-21T07:10:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:55.231 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-21T07:10:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.228+0000 7f0db72a9640 1 -- 172.21.15.18:0/1479491219 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0d9c078b90 msgr2=0x7f0d9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.228+0000 7f0db72a9640 1 --2- 172.21.15.18:0/1479491219 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0d9c078b90 0x7f0d9c07b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0da0035000 tx=0x7f0da0038040 comp rx=0 tx=0).stop 2024-09-21T07:10:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.228+0000 7f0db72a9640 1 -- 172.21.15.18:0/1479491219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db00d3580 msgr2=0x7f0db015ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.228+0000 7f0db72a9640 1 --2- 172.21.15.18:0/1479491219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db00d3580 0x7f0db015ac80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0da400d720 tx=0x7f0da400dbe0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.228+0000 7f0db72a9640 1 -- 172.21.15.18:0/1479491219 shutdown_connections 2024-09-21T07:10:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.228+0000 7f0db72a9640 1 --2- 172.21.15.18:0/1479491219 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0d9c078b90 0x7f0d9c07b0a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.228+0000 7f0db72a9640 1 --2- 172.21.15.18:0/1479491219 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0db015ef50 0x7f0db00b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.228+0000 7f0db72a9640 1 --2- 172.21.15.18:0/1479491219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db00d3580 0x7f0db015ac80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.228+0000 7f0db72a9640 1 --2- 172.21.15.18:0/1479491219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0db00cef70 0x7f0db00cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.228+0000 7f0db72a9640 1 -- 172.21.15.18:0/1479491219 >> 172.21.15.18:0/1479491219 conn(0x7f0db0073f30 msgr2=0x7f0db015cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.228+0000 7f0db72a9640 1 -- 172.21.15.18:0/1479491219 shutdown_connections 2024-09-21T07:10:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.228+0000 7f0db72a9640 1 -- 172.21.15.18:0/1479491219 wait complete. 2024-09-21T07:10:55.242 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-21T07:10:54.316654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":269012,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754705708,"statfs":{"total":773094113280,"available":772818644992,"internally_reserved":0,"allocated":2924544,"data_stored":1770508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002620"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380397+0000","last_change":"2024-09-21T07:10:43.418758+0000","last_active":"2024-09-21T07:10:47.380397+0000","last_peered":"2024-09-21T07:10:47.380397+0000","last_clean":"2024-09-21T07:10:47.380397+0000","last_became_active":"2024-09-21T07:10:43.413221+0000","last_became_peered":"2024-09-21T07:10:43.413221+0000","last_unstale":"2024-09-21T07:10:47.380397+0000","last_undegraded":"2024-09-21T07:10:47.380397+0000","last_fullsized":"2024-09-21T07:10:47.380397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:15.423169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404706+0000","last_change":"2024-09-21T07:10:43.425911+0000","last_active":"2024-09-21T07:10:44.404706+0000","last_peered":"2024-09-21T07:10:44.404706+0000","last_clean":"2024-09-21T07:10:44.404706+0000","last_became_active":"2024-09-21T07:10:43.424831+0000","last_became_peered":"2024-09-21T07:10:43.424831+0000","last_unstale":"2024-09-21T07:10:44.404706+0000","last_undegraded":"2024-09-21T07:10:44.404706+0000","last_fullsized":"2024-09-21T07:10:44.404706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:52.852007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378570+0000","last_change":"2024-09-21T07:10:43.402987+0000","last_active":"2024-09-21T07:10:47.378570+0000","last_peered":"2024-09-21T07:10:47.378570+0000","last_clean":"2024-09-21T07:10:47.378570+0000","last_became_active":"2024-09-21T07:10:43.402600+0000","last_became_peered":"2024-09-21T07:10:43.402600+0000","last_unstale":"2024-09-21T07:10:47.378570+0000","last_undegraded":"2024-09-21T07:10:47.378570+0000","last_fullsized":"2024-09-21T07:10:47.378570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:27.607737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405847+0000","last_change":"2024-09-21T07:10:43.418498+0000","last_active":"2024-09-21T07:10:44.405847+0000","last_peered":"2024-09-21T07:10:44.405847+0000","last_clean":"2024-09-21T07:10:44.405847+0000","last_became_active":"2024-09-21T07:10:43.418075+0000","last_became_peered":"2024-09-21T07:10:43.418075+0000","last_unstale":"2024-09-21T07:10:44.405847+0000","last_undegraded":"2024-09-21T07:10:44.405847+0000","last_fullsized":"2024-09-21T07:10:44.405847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:39.715349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379099+0000","last_change":"2024-09-21T07:10:43.409859+0000","last_active":"2024-09-21T07:10:47.379099+0000","last_peered":"2024-09-21T07:10:47.379099+0000","last_clean":"2024-09-21T07:10:47.379099+0000","last_became_active":"2024-09-21T07:10:43.409171+0000","last_became_peered":"2024-09-21T07:10:43.409171+0000","last_unstale":"2024-09-21T07:10:47.379099+0000","last_undegraded":"2024-09-21T07:10:47.379099+0000","last_fullsized":"2024-09-21T07:10:47.379099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:28.893883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405635+0000","last_change":"2024-09-21T07:10:43.408895+0000","last_active":"2024-09-21T07:10:44.405635+0000","last_peered":"2024-09-21T07:10:44.405635+0000","last_clean":"2024-09-21T07:10:44.405635+0000","last_became_active":"2024-09-21T07:10:43.408402+0000","last_became_peered":"2024-09-21T07:10:43.408402+0000","last_unstale":"2024-09-21T07:10:44.405635+0000","last_undegraded":"2024-09-21T07:10:44.405635+0000","last_fullsized":"2024-09-21T07:10:44.405635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:28.893883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379333+0000","last_change":"2024-09-21T07:10:43.404599+0000","last_active":"2024-09-21T07:10:47.379333+0000","last_peered":"2024-09-21T07:10:47.379333+0000","last_clean":"2024-09-21T07:10:47.379333+0000","last_became_active":"2024-09-21T07:10:43.404288+0000","last_became_peered":"2024-09-21T07:10:43.404288+0000","last_unstale":"2024-09-21T07:10:47.379333+0000","last_undegraded":"2024-09-21T07:10:47.379333+0000","last_fullsized":"2024-09-21T07:10:47.379333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:03.491744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378441+0000","last_change":"2024-09-21T07:10:43.412128+0000","last_active":"2024-09-21T07:10:47.378441+0000","last_peered":"2024-09-21T07:10:47.378441+0000","last_clean":"2024-09-21T07:10:47.378441+0000","last_became_active":"2024-09-21T07:10:43.410969+0000","last_became_peered":"2024-09-21T07:10:43.410969+0000","last_unstale":"2024-09-21T07:10:47.378441+0000","last_undegraded":"2024-09-21T07:10:47.378441+0000","last_fullsized":"2024-09-21T07:10:47.378441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:38.675519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380450+0000","last_change":"2024-09-21T07:10:43.420504+0000","last_active":"2024-09-21T07:10:47.380450+0000","last_peered":"2024-09-21T07:10:47.380450+0000","last_clean":"2024-09-21T07:10:47.380450+0000","last_became_active":"2024-09-21T07:10:43.418716+0000","last_became_peered":"2024-09-21T07:10:43.418716+0000","last_unstale":"2024-09-21T07:10:47.380450+0000","last_undegraded":"2024-09-21T07:10:47.380450+0000","last_fullsized":"2024-09-21T07:10:47.380450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:39.695264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423623+0000","last_change":"2024-09-21T07:10:43.414160+0000","last_active":"2024-09-21T07:10:44.423623+0000","last_peered":"2024-09-21T07:10:44.423623+0000","last_clean":"2024-09-21T07:10:44.423623+0000","last_became_active":"2024-09-21T07:10:43.413651+0000","last_became_peered":"2024-09-21T07:10:43.413651+0000","last_unstale":"2024-09-21T07:10:44.423623+0000","last_undegraded":"2024-09-21T07:10:44.423623+0000","last_fullsized":"2024-09-21T07:10:44.423623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:36.925353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423522+0000","last_change":"2024-09-21T07:10:43.414383+0000","last_active":"2024-09-21T07:10:44.423522+0000","last_peered":"2024-09-21T07:10:44.423522+0000","last_clean":"2024-09-21T07:10:44.423522+0000","last_became_active":"2024-09-21T07:10:43.413520+0000","last_became_peered":"2024-09-21T07:10:43.413520+0000","last_unstale":"2024-09-21T07:10:44.423522+0000","last_undegraded":"2024-09-21T07:10:44.423522+0000","last_fullsized":"2024-09-21T07:10:44.423522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:58.082249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379251+0000","last_change":"2024-09-21T07:10:43.417909+0000","last_active":"2024-09-21T07:10:47.379251+0000","last_peered":"2024-09-21T07:10:47.379251+0000","last_clean":"2024-09-21T07:10:47.379251+0000","last_became_active":"2024-09-21T07:10:43.417587+0000","last_became_peered":"2024-09-21T07:10:43.417587+0000","last_unstale":"2024-09-21T07:10:47.379251+0000","last_undegraded":"2024-09-21T07:10:47.379251+0000","last_fullsized":"2024-09-21T07:10:47.379251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:16.951261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378633+0000","last_change":"2024-09-21T07:10:43.412277+0000","last_active":"2024-09-21T07:10:47.378633+0000","last_peered":"2024-09-21T07:10:47.378633+0000","last_clean":"2024-09-21T07:10:47.378633+0000","last_became_active":"2024-09-21T07:10:43.411507+0000","last_became_peered":"2024-09-21T07:10:43.411507+0000","last_unstale":"2024-09-21T07:10:47.378633+0000","last_undegraded":"2024-09-21T07:10:47.378633+0000","last_fullsized":"2024-09-21T07:10:47.378633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:28.683802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379022+0000","last_change":"2024-09-21T07:10:43.418752+0000","last_active":"2024-09-21T07:10:47.379022+0000","last_peered":"2024-09-21T07:10:47.379022+0000","last_clean":"2024-09-21T07:10:47.379022+0000","last_became_active":"2024-09-21T07:10:43.418424+0000","last_became_peered":"2024-09-21T07:10:43.418424+0000","last_unstale":"2024-09-21T07:10:47.379022+0000","last_undegraded":"2024-09-21T07:10:47.379022+0000","last_fullsized":"2024-09-21T07:10:47.379022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:27.138072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404284+0000","last_change":"2024-09-21T07:10:43.415461+0000","last_active":"2024-09-21T07:10:44.404284+0000","last_peered":"2024-09-21T07:10:44.404284+0000","last_clean":"2024-09-21T07:10:44.404284+0000","last_became_active":"2024-09-21T07:10:43.410697+0000","last_became_peered":"2024-09-21T07:10:43.410697+0000","last_unstale":"2024-09-21T07:10:44.404284+0000","last_undegraded":"2024-09-21T07:10:44.404284+0000","last_fullsized":"2024-09-21T07:10:44.404284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:14.665635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405475+0000","last_change":"2024-09-21T07:10:43.413220+0000","last_active":"2024-09-21T07:10:44.405475+0000","last_peered":"2024-09-21T07:10:44.405475+0000","last_clean":"2024-09-21T07:10:44.405475+0000","last_became_active":"2024-09-21T07:10:43.412892+0000","last_became_peered":"2024-09-21T07:10:43.412892+0000","last_unstale":"2024-09-21T07:10:44.405475+0000","last_undegraded":"2024-09-21T07:10:44.405475+0000","last_fullsized":"2024-09-21T07:10:44.405475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:55.242127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406808+0000","last_change":"2024-09-21T07:10:43.409834+0000","last_active":"2024-09-21T07:10:44.406808+0000","last_peered":"2024-09-21T07:10:44.406808+0000","last_clean":"2024-09-21T07:10:44.406808+0000","last_became_active":"2024-09-21T07:10:43.409533+0000","last_became_peered":"2024-09-21T07:10:43.409533+0000","last_unstale":"2024-09-21T07:10:44.406808+0000","last_undegraded":"2024-09-21T07:10:44.406808+0000","last_fullsized":"2024-09-21T07:10:44.406808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:26.185434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405326+0000","last_change":"2024-09-21T07:10:43.414453+0000","last_active":"2024-09-21T07:10:44.405326+0000","last_peered":"2024-09-21T07:10:44.405326+0000","last_clean":"2024-09-21T07:10:44.405326+0000","last_became_active":"2024-09-21T07:10:43.414138+0000","last_became_peered":"2024-09-21T07:10:43.414138+0000","last_unstale":"2024-09-21T07:10:44.405326+0000","last_undegraded":"2024-09-21T07:10:44.405326+0000","last_fullsized":"2024-09-21T07:10:44.405326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:26.960157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380386+0000","last_change":"2024-09-21T07:10:43.408892+0000","last_active":"2024-09-21T07:10:47.380386+0000","last_peered":"2024-09-21T07:10:47.380386+0000","last_clean":"2024-09-21T07:10:47.380386+0000","last_became_active":"2024-09-21T07:10:43.408554+0000","last_became_peered":"2024-09-21T07:10:43.408554+0000","last_unstale":"2024-09-21T07:10:47.380386+0000","last_undegraded":"2024-09-21T07:10:47.380386+0000","last_fullsized":"2024-09-21T07:10:47.380386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:18.068383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423355+0000","last_change":"2024-09-21T07:10:43.418255+0000","last_active":"2024-09-21T07:10:44.423355+0000","last_peered":"2024-09-21T07:10:44.423355+0000","last_clean":"2024-09-21T07:10:44.423355+0000","last_became_active":"2024-09-21T07:10:43.417893+0000","last_became_peered":"2024-09-21T07:10:43.417893+0000","last_unstale":"2024-09-21T07:10:44.423355+0000","last_undegraded":"2024-09-21T07:10:44.423355+0000","last_fullsized":"2024-09-21T07:10:44.423355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:28.683802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379786+0000","last_change":"2024-09-21T07:10:43.414479+0000","last_active":"2024-09-21T07:10:47.379786+0000","last_peered":"2024-09-21T07:10:47.379786+0000","last_clean":"2024-09-21T07:10:47.379786+0000","last_became_active":"2024-09-21T07:10:43.414121+0000","last_became_peered":"2024-09-21T07:10:43.414121+0000","last_unstale":"2024-09-21T07:10:47.379786+0000","last_undegraded":"2024-09-21T07:10:47.379786+0000","last_fullsized":"2024-09-21T07:10:47.379786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:23.952801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405904+0000","last_change":"2024-09-21T07:10:43.409741+0000","last_active":"2024-09-21T07:10:44.405904+0000","last_peered":"2024-09-21T07:10:44.405904+0000","last_clean":"2024-09-21T07:10:44.405904+0000","last_became_active":"2024-09-21T07:10:43.408139+0000","last_became_peered":"2024-09-21T07:10:43.408139+0000","last_unstale":"2024-09-21T07:10:44.405904+0000","last_undegraded":"2024-09-21T07:10:44.405904+0000","last_fullsized":"2024-09-21T07:10:44.405904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:03.311605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379526+0000","last_change":"2024-09-21T07:10:43.416414+0000","last_active":"2024-09-21T07:10:47.379526+0000","last_peered":"2024-09-21T07:10:47.379526+0000","last_clean":"2024-09-21T07:10:47.379526+0000","last_became_active":"2024-09-21T07:10:43.415380+0000","last_became_peered":"2024-09-21T07:10:43.415380+0000","last_unstale":"2024-09-21T07:10:47.379526+0000","last_undegraded":"2024-09-21T07:10:47.379526+0000","last_fullsized":"2024-09-21T07:10:47.379526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:34:29.882522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405523+0000","last_change":"2024-09-21T07:10:43.407135+0000","last_active":"2024-09-21T07:10:44.405523+0000","last_peered":"2024-09-21T07:10:44.405523+0000","last_clean":"2024-09-21T07:10:44.405523+0000","last_became_active":"2024-09-21T07:10:43.406562+0000","last_became_peered":"2024-09-21T07:10:43.406562+0000","last_unstale":"2024-09-21T07:10:44.405523+0000","last_undegraded":"2024-09-21T07:10:44.405523+0000","last_fullsized":"2024-09-21T07:10:44.405523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:45.271471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379360+0000","last_change":"2024-09-21T07:10:43.415169+0000","last_active":"2024-09-21T07:10:47.379360+0000","last_peered":"2024-09-21T07:10:47.379360+0000","last_clean":"2024-09-21T07:10:47.379360+0000","last_became_active":"2024-09-21T07:10:43.414845+0000","last_became_peered":"2024-09-21T07:10:43.414845+0000","last_unstale":"2024-09-21T07:10:47.379360+0000","last_undegraded":"2024-09-21T07:10:47.379360+0000","last_fullsized":"2024-09-21T07:10:47.379360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:14.930286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423654+0000","last_change":"2024-09-21T07:10:43.410604+0000","last_active":"2024-09-21T07:10:44.423654+0000","last_peered":"2024-09-21T07:10:44.423654+0000","last_clean":"2024-09-21T07:10:44.423654+0000","last_became_active":"2024-09-21T07:10:43.410225+0000","last_became_peered":"2024-09-21T07:10:43.410225+0000","last_unstale":"2024-09-21T07:10:44.423654+0000","last_undegraded":"2024-09-21T07:10:44.423654+0000","last_fullsized":"2024-09-21T07:10:44.423654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:04.920178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404615+0000","last_change":"2024-09-21T07:10:43.425050+0000","last_active":"2024-09-21T07:10:44.404615+0000","last_peered":"2024-09-21T07:10:44.404615+0000","last_clean":"2024-09-21T07:10:44.404615+0000","last_became_active":"2024-09-21T07:10:43.424686+0000","last_became_peered":"2024-09-21T07:10:43.424686+0000","last_unstale":"2024-09-21T07:10:44.404615+0000","last_undegraded":"2024-09-21T07:10:44.404615+0000","last_fullsized":"2024-09-21T07:10:44.404615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:11.009112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379756+0000","last_change":"2024-09-21T07:10:43.415955+0000","last_active":"2024-09-21T07:10:47.379756+0000","last_peered":"2024-09-21T07:10:47.379756+0000","last_clean":"2024-09-21T07:10:47.379756+0000","last_became_active":"2024-09-21T07:10:43.415633+0000","last_became_peered":"2024-09-21T07:10:43.415633+0000","last_unstale":"2024-09-21T07:10:47.379756+0000","last_undegraded":"2024-09-21T07:10:47.379756+0000","last_fullsized":"2024-09-21T07:10:47.379756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:08.696212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379956+0000","last_change":"2024-09-21T07:10:43.417820+0000","last_active":"2024-09-21T07:10:47.379956+0000","last_peered":"2024-09-21T07:10:47.379956+0000","last_clean":"2024-09-21T07:10:47.379956+0000","last_became_active":"2024-09-21T07:10:43.417482+0000","last_became_peered":"2024-09-21T07:10:43.417482+0000","last_unstale":"2024-09-21T07:10:47.379956+0000","last_undegraded":"2024-09-21T07:10:47.379956+0000","last_fullsized":"2024-09-21T07:10:47.379956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:11.009112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406171+0000","last_change":"2024-09-21T07:10:43.416076+0000","last_active":"2024-09-21T07:10:44.406171+0000","last_peered":"2024-09-21T07:10:44.406171+0000","last_clean":"2024-09-21T07:10:44.406171+0000","last_became_active":"2024-09-21T07:10:43.415727+0000","last_became_peered":"2024-09-21T07:10:43.415727+0000","last_unstale":"2024-09-21T07:10:44.406171+0000","last_undegraded":"2024-09-21T07:10:44.406171+0000","last_fullsized":"2024-09-21T07:10:44.406171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:30.034257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405184+0000","last_change":"2024-09-21T07:10:43.411355+0000","last_active":"2024-09-21T07:10:44.405184+0000","last_peered":"2024-09-21T07:10:44.405184+0000","last_clean":"2024-09-21T07:10:44.405184+0000","last_became_active":"2024-09-21T07:10:43.408638+0000","last_became_peered":"2024-09-21T07:10:43.408638+0000","last_unstale":"2024-09-21T07:10:44.405184+0000","last_undegraded":"2024-09-21T07:10:44.405184+0000","last_fullsized":"2024-09-21T07:10:44.405184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:34.237185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423340+0000","last_change":"2024-09-21T07:10:43.422509+0000","last_active":"2024-09-21T07:10:44.423340+0000","last_peered":"2024-09-21T07:10:44.423340+0000","last_clean":"2024-09-21T07:10:44.423340+0000","last_became_active":"2024-09-21T07:10:43.422122+0000","last_became_peered":"2024-09-21T07:10:43.422122+0000","last_unstale":"2024-09-21T07:10:44.423340+0000","last_undegraded":"2024-09-21T07:10:44.423340+0000","last_fullsized":"2024-09-21T07:10:44.423340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:38.675519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379436+0000","last_change":"2024-09-21T07:10:43.411295+0000","last_active":"2024-09-21T07:10:47.379436+0000","last_peered":"2024-09-21T07:10:47.379436+0000","last_clean":"2024-09-21T07:10:47.379436+0000","last_became_active":"2024-09-21T07:10:43.410963+0000","last_became_peered":"2024-09-21T07:10:43.410963+0000","last_unstale":"2024-09-21T07:10:47.379436+0000","last_undegraded":"2024-09-21T07:10:47.379436+0000","last_fullsized":"2024-09-21T07:10:47.379436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:02.068200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379059+0000","last_change":"2024-09-21T07:10:42.407850+0000","last_active":"2024-09-21T07:10:47.379059+0000","last_peered":"2024-09-21T07:10:47.379059+0000","last_clean":"2024-09-21T07:10:47.379059+0000","last_became_active":"2024-09-21T07:10:42.407497+0000","last_became_peered":"2024-09-21T07:10:42.407497+0000","last_unstale":"2024-09-21T07:10:47.379059+0000","last_undegraded":"2024-09-21T07:10:47.379059+0000","last_fullsized":"2024-09-21T07:10:47.379059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:34.583545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379982+0000","last_change":"2024-09-21T07:10:43.398164+0000","last_active":"2024-09-21T07:10:47.379982+0000","last_peered":"2024-09-21T07:10:47.379982+0000","last_clean":"2024-09-21T07:10:47.379982+0000","last_became_active":"2024-09-21T07:10:43.397191+0000","last_became_peered":"2024-09-21T07:10:43.397191+0000","last_unstale":"2024-09-21T07:10:47.379982+0000","last_undegraded":"2024-09-21T07:10:47.379982+0000","last_fullsized":"2024-09-21T07:10:47.379982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:52.852007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423132+0000","last_change":"2024-09-21T07:10:42.403613+0000","last_active":"2024-09-21T07:10:44.423132+0000","last_peered":"2024-09-21T07:10:44.423132+0000","last_clean":"2024-09-21T07:10:44.423132+0000","last_became_active":"2024-09-21T07:10:42.402543+0000","last_became_peered":"2024-09-21T07:10:42.402543+0000","last_unstale":"2024-09-21T07:10:44.423132+0000","last_undegraded":"2024-09-21T07:10:44.423132+0000","last_fullsized":"2024-09-21T07:10:44.423132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:15.945210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379738+0000","last_change":"2024-09-21T07:10:42.405878+0000","last_active":"2024-09-21T07:10:47.379738+0000","last_peered":"2024-09-21T07:10:47.379738+0000","last_clean":"2024-09-21T07:10:47.379738+0000","last_became_active":"2024-09-21T07:10:42.404760+0000","last_became_peered":"2024-09-21T07:10:42.404760+0000","last_unstale":"2024-09-21T07:10:47.379738+0000","last_undegraded":"2024-09-21T07:10:47.379738+0000","last_fullsized":"2024-09-21T07:10:47.379738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:24.910811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378702+0000","last_change":"2024-09-21T07:10:43.421622+0000","last_active":"2024-09-21T07:10:47.378702+0000","last_peered":"2024-09-21T07:10:47.378702+0000","last_clean":"2024-09-21T07:10:47.378702+0000","last_became_active":"2024-09-21T07:10:43.421299+0000","last_became_peered":"2024-09-21T07:10:43.421299+0000","last_unstale":"2024-09-21T07:10:47.378702+0000","last_undegraded":"2024-09-21T07:10:47.378702+0000","last_fullsized":"2024-09-21T07:10:47.378702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:32.944402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405639+0000","last_change":"2024-09-21T07:10:42.401842+0000","last_active":"2024-09-21T07:10:44.405639+0000","last_peered":"2024-09-21T07:10:44.405639+0000","last_clean":"2024-09-21T07:10:44.405639+0000","last_became_active":"2024-09-21T07:10:42.401304+0000","last_became_peered":"2024-09-21T07:10:42.401304+0000","last_unstale":"2024-09-21T07:10:44.405639+0000","last_undegraded":"2024-09-21T07:10:44.405639+0000","last_fullsized":"2024-09-21T07:10:44.405639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:31.113600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404237+0000","last_change":"2024-09-21T07:10:43.424849+0000","last_active":"2024-09-21T07:10:44.404237+0000","last_peered":"2024-09-21T07:10:44.404237+0000","last_clean":"2024-09-21T07:10:44.404237+0000","last_became_active":"2024-09-21T07:10:43.424491+0000","last_became_peered":"2024-09-21T07:10:43.424491+0000","last_unstale":"2024-09-21T07:10:44.404237+0000","last_undegraded":"2024-09-21T07:10:44.404237+0000","last_fullsized":"2024-09-21T07:10:44.404237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:15.151519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423579+0000","last_change":"2024-09-21T07:10:42.404454+0000","last_active":"2024-09-21T07:10:44.423579+0000","last_peered":"2024-09-21T07:10:44.423579+0000","last_clean":"2024-09-21T07:10:44.423579+0000","last_became_active":"2024-09-21T07:10:42.404062+0000","last_became_peered":"2024-09-21T07:10:42.404062+0000","last_unstale":"2024-09-21T07:10:44.423579+0000","last_undegraded":"2024-09-21T07:10:44.423579+0000","last_fullsized":"2024-09-21T07:10:44.423579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:33.377412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406705+0000","last_change":"2024-09-21T07:10:43.409200+0000","last_active":"2024-09-21T07:10:44.406705+0000","last_peered":"2024-09-21T07:10:44.406705+0000","last_clean":"2024-09-21T07:10:44.406705+0000","last_became_active":"2024-09-21T07:10:43.408864+0000","last_became_peered":"2024-09-21T07:10:43.408864+0000","last_unstale":"2024-09-21T07:10:44.406705+0000","last_undegraded":"2024-09-21T07:10:44.406705+0000","last_fullsized":"2024-09-21T07:10:44.406705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:39.695264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406436+0000","last_change":"2024-09-21T07:10:42.406774+0000","last_active":"2024-09-21T07:10:44.406436+0000","last_peered":"2024-09-21T07:10:44.406436+0000","last_clean":"2024-09-21T07:10:44.406436+0000","last_became_active":"2024-09-21T07:10:42.404461+0000","last_became_peered":"2024-09-21T07:10:42.404461+0000","last_unstale":"2024-09-21T07:10:44.406436+0000","last_undegraded":"2024-09-21T07:10:44.406436+0000","last_fullsized":"2024-09-21T07:10:44.406436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:38.533867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379345+0000","last_change":"2024-09-21T07:10:43.408995+0000","last_active":"2024-09-21T07:10:47.379345+0000","last_peered":"2024-09-21T07:10:47.379345+0000","last_clean":"2024-09-21T07:10:47.379345+0000","last_became_active":"2024-09-21T07:10:43.408670+0000","last_became_peered":"2024-09-21T07:10:43.408670+0000","last_unstale":"2024-09-21T07:10:47.379345+0000","last_undegraded":"2024-09-21T07:10:47.379345+0000","last_fullsized":"2024-09-21T07:10:47.379345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:08.183794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404702+0000","last_change":"2024-09-21T07:10:42.412327+0000","last_active":"2024-09-21T07:10:44.404702+0000","last_peered":"2024-09-21T07:10:44.404702+0000","last_clean":"2024-09-21T07:10:44.404702+0000","last_became_active":"2024-09-21T07:10:42.411992+0000","last_became_peered":"2024-09-21T07:10:42.411992+0000","last_unstale":"2024-09-21T07:10:44.404702+0000","last_undegraded":"2024-09-21T07:10:44.404702+0000","last_fullsized":"2024-09-21T07:10:44.404702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:12.534169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379508+0000","last_change":"2024-09-21T07:10:43.408223+0000","last_active":"2024-09-21T07:10:47.379508+0000","last_peered":"2024-09-21T07:10:47.379508+0000","last_clean":"2024-09-21T07:10:47.379508+0000","last_became_active":"2024-09-21T07:10:43.407894+0000","last_became_peered":"2024-09-21T07:10:43.407894+0000","last_unstale":"2024-09-21T07:10:47.379508+0000","last_undegraded":"2024-09-21T07:10:47.379508+0000","last_fullsized":"2024-09-21T07:10:47.379508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:26.991092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423435+0000","last_change":"2024-09-21T07:10:42.399128+0000","last_active":"2024-09-21T07:10:44.423435+0000","last_peered":"2024-09-21T07:10:44.423435+0000","last_clean":"2024-09-21T07:10:44.423435+0000","last_became_active":"2024-09-21T07:10:42.398772+0000","last_became_peered":"2024-09-21T07:10:42.398772+0000","last_unstale":"2024-09-21T07:10:44.423435+0000","last_undegraded":"2024-09-21T07:10:44.423435+0000","last_fullsized":"2024-09-21T07:10:44.423435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:01.062149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379989+0000","last_change":"2024-09-21T07:10:43.415524+0000","last_active":"2024-09-21T07:10:47.379989+0000","last_peered":"2024-09-21T07:10:47.379989+0000","last_clean":"2024-09-21T07:10:47.379989+0000","last_became_active":"2024-09-21T07:10:43.415196+0000","last_became_peered":"2024-09-21T07:10:43.415196+0000","last_unstale":"2024-09-21T07:10:47.379989+0000","last_undegraded":"2024-09-21T07:10:47.379989+0000","last_fullsized":"2024-09-21T07:10:47.379989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:30.034257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380068+0000","last_change":"2024-09-21T07:10:42.402240+0000","last_active":"2024-09-21T07:10:47.380068+0000","last_peered":"2024-09-21T07:10:47.380068+0000","last_clean":"2024-09-21T07:10:47.380068+0000","last_became_active":"2024-09-21T07:10:42.401874+0000","last_became_peered":"2024-09-21T07:10:42.401874+0000","last_unstale":"2024-09-21T07:10:47.380068+0000","last_undegraded":"2024-09-21T07:10:47.380068+0000","last_fullsized":"2024-09-21T07:10:47.380068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:57.539687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379271+0000","last_change":"2024-09-21T07:10:43.411598+0000","last_active":"2024-09-21T07:10:47.379271+0000","last_peered":"2024-09-21T07:10:47.379271+0000","last_clean":"2024-09-21T07:10:47.379271+0000","last_became_active":"2024-09-21T07:10:43.411274+0000","last_became_peered":"2024-09-21T07:10:43.411274+0000","last_unstale":"2024-09-21T07:10:47.379271+0000","last_undegraded":"2024-09-21T07:10:47.379271+0000","last_fullsized":"2024-09-21T07:10:47.379271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:15.151519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406106+0000","last_change":"2024-09-21T07:10:42.401021+0000","last_active":"2024-09-21T07:10:44.406106+0000","last_peered":"2024-09-21T07:10:44.406106+0000","last_clean":"2024-09-21T07:10:44.406106+0000","last_became_active":"2024-09-21T07:10:42.400700+0000","last_became_peered":"2024-09-21T07:10:42.400700+0000","last_unstale":"2024-09-21T07:10:44.406106+0000","last_undegraded":"2024-09-21T07:10:44.406106+0000","last_fullsized":"2024-09-21T07:10:44.406106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:05.347695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379844+0000","last_change":"2024-09-21T07:10:43.410354+0000","last_active":"2024-09-21T07:10:47.379844+0000","last_peered":"2024-09-21T07:10:47.379844+0000","last_clean":"2024-09-21T07:10:47.379844+0000","last_became_active":"2024-09-21T07:10:43.409526+0000","last_became_peered":"2024-09-21T07:10:43.409526+0000","last_unstale":"2024-09-21T07:10:47.379844+0000","last_undegraded":"2024-09-21T07:10:47.379844+0000","last_fullsized":"2024-09-21T07:10:47.379844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:39.715349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423098+0000","last_change":"2024-09-21T07:10:42.402010+0000","last_active":"2024-09-21T07:10:44.423098+0000","last_peered":"2024-09-21T07:10:44.423098+0000","last_clean":"2024-09-21T07:10:44.423098+0000","last_became_active":"2024-09-21T07:10:42.401682+0000","last_became_peered":"2024-09-21T07:10:42.401682+0000","last_unstale":"2024-09-21T07:10:44.423098+0000","last_undegraded":"2024-09-21T07:10:44.423098+0000","last_fullsized":"2024-09-21T07:10:44.423098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:15.662211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423495+0000","last_change":"2024-09-21T07:10:43.412631+0000","last_active":"2024-09-21T07:10:44.423495+0000","last_peered":"2024-09-21T07:10:44.423495+0000","last_clean":"2024-09-21T07:10:44.423495+0000","last_became_active":"2024-09-21T07:10:43.412250+0000","last_became_peered":"2024-09-21T07:10:43.412250+0000","last_unstale":"2024-09-21T07:10:44.423495+0000","last_undegraded":"2024-09-21T07:10:44.423495+0000","last_fullsized":"2024-09-21T07:10:44.423495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:40.609307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405073+0000","last_change":"2024-09-21T07:10:42.405955+0000","last_active":"2024-09-21T07:10:44.405073+0000","last_peered":"2024-09-21T07:10:44.405073+0000","last_clean":"2024-09-21T07:10:44.405073+0000","last_became_active":"2024-09-21T07:10:42.405499+0000","last_became_peered":"2024-09-21T07:10:42.405499+0000","last_unstale":"2024-09-21T07:10:44.405073+0000","last_undegraded":"2024-09-21T07:10:44.405073+0000","last_fullsized":"2024-09-21T07:10:44.405073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:11.896704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379646+0000","last_change":"2024-09-21T07:10:43.408372+0000","last_active":"2024-09-21T07:10:47.379646+0000","last_peered":"2024-09-21T07:10:47.379646+0000","last_clean":"2024-09-21T07:10:47.379646+0000","last_became_active":"2024-09-21T07:10:43.407452+0000","last_became_peered":"2024-09-21T07:10:43.407452+0000","last_unstale":"2024-09-21T07:10:47.379646+0000","last_undegraded":"2024-09-21T07:10:47.379646+0000","last_fullsized":"2024-09-21T07:10:47.379646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:08.696212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379139+0000","last_change":"2024-09-21T07:10:42.406082+0000","last_active":"2024-09-21T07:10:47.379139+0000","last_peered":"2024-09-21T07:10:47.379139+0000","last_clean":"2024-09-21T07:10:47.379139+0000","last_became_active":"2024-09-21T07:10:42.405726+0000","last_became_peered":"2024-09-21T07:10:42.405726+0000","last_unstale":"2024-09-21T07:10:47.379139+0000","last_undegraded":"2024-09-21T07:10:47.379139+0000","last_fullsized":"2024-09-21T07:10:47.379139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:21.349501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380329+0000","last_change":"2024-09-21T07:10:43.412104+0000","last_active":"2024-09-21T07:10:47.380329+0000","last_peered":"2024-09-21T07:10:47.380329+0000","last_clean":"2024-09-21T07:10:47.380329+0000","last_became_active":"2024-09-21T07:10:43.411622+0000","last_became_peered":"2024-09-21T07:10:43.411622+0000","last_unstale":"2024-09-21T07:10:47.380329+0000","last_undegraded":"2024-09-21T07:10:47.380329+0000","last_fullsized":"2024-09-21T07:10:47.380329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:37.114753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405248+0000","last_change":"2024-09-21T07:10:42.391724+0000","last_active":"2024-09-21T07:10:44.405248+0000","last_peered":"2024-09-21T07:10:44.405248+0000","last_clean":"2024-09-21T07:10:44.405248+0000","last_became_active":"2024-09-21T07:10:42.391190+0000","last_became_peered":"2024-09-21T07:10:42.391190+0000","last_unstale":"2024-09-21T07:10:44.405248+0000","last_undegraded":"2024-09-21T07:10:44.405248+0000","last_fullsized":"2024-09-21T07:10:44.405248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:04.908220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380620+0000","last_change":"2024-09-21T07:10:43.420199+0000","last_active":"2024-09-21T07:10:47.380620+0000","last_peered":"2024-09-21T07:10:47.380620+0000","last_clean":"2024-09-21T07:10:47.380620+0000","last_became_active":"2024-09-21T07:10:43.418363+0000","last_became_peered":"2024-09-21T07:10:43.418363+0000","last_unstale":"2024-09-21T07:10:47.380620+0000","last_undegraded":"2024-09-21T07:10:47.380620+0000","last_fullsized":"2024-09-21T07:10:47.380620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:05.987550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404730+0000","last_change":"2024-09-21T07:10:42.410464+0000","last_active":"2024-09-21T07:10:44.404730+0000","last_peered":"2024-09-21T07:10:44.404730+0000","last_clean":"2024-09-21T07:10:44.404730+0000","last_became_active":"2024-09-21T07:10:42.410107+0000","last_became_peered":"2024-09-21T07:10:42.410107+0000","last_unstale":"2024-09-21T07:10:44.404730+0000","last_undegraded":"2024-09-21T07:10:44.404730+0000","last_fullsized":"2024-09-21T07:10:44.404730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:31.991591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406480+0000","last_change":"2024-09-21T07:10:43.418911+0000","last_active":"2024-09-21T07:10:44.406480+0000","last_peered":"2024-09-21T07:10:44.406480+0000","last_clean":"2024-09-21T07:10:44.406480+0000","last_became_active":"2024-09-21T07:10:43.418563+0000","last_became_peered":"2024-09-21T07:10:43.418563+0000","last_unstale":"2024-09-21T07:10:44.406480+0000","last_undegraded":"2024-09-21T07:10:44.406480+0000","last_fullsized":"2024-09-21T07:10:44.406480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:18.068383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405257+0000","last_change":"2024-09-21T07:10:42.402258+0000","last_active":"2024-09-21T07:10:44.405257+0000","last_peered":"2024-09-21T07:10:44.405257+0000","last_clean":"2024-09-21T07:10:44.405257+0000","last_became_active":"2024-09-21T07:10:42.401789+0000","last_became_peered":"2024-09-21T07:10:42.401789+0000","last_unstale":"2024-09-21T07:10:44.405257+0000","last_undegraded":"2024-09-21T07:10:44.405257+0000","last_fullsized":"2024-09-21T07:10:44.405257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:21.657184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380075+0000","last_change":"2024-09-21T07:10:43.415279+0000","last_active":"2024-09-21T07:10:47.380075+0000","last_peered":"2024-09-21T07:10:47.380075+0000","last_clean":"2024-09-21T07:10:47.380075+0000","last_became_active":"2024-09-21T07:10:43.414955+0000","last_became_peered":"2024-09-21T07:10:43.414955+0000","last_unstale":"2024-09-21T07:10:47.380075+0000","last_undegraded":"2024-09-21T07:10:47.380075+0000","last_fullsized":"2024-09-21T07:10:47.380075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:26.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379230+0000","last_change":"2024-09-21T07:10:32.034091+0000","last_active":"2024-09-21T07:10:47.379230+0000","last_peered":"2024-09-21T07:10:47.379230+0000","last_clean":"2024-09-21T07:10:47.379230+0000","last_became_active":"2024-09-21T07:10:32.033005+0000","last_became_peered":"2024-09-21T07:10:32.033005+0000","last_unstale":"2024-09-21T07:10:47.379230+0000","last_undegraded":"2024-09-21T07:10:47.379230+0000","last_fullsized":"2024-09-21T07:10:47.379230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_clean_scrub_stamp":"2024-09-21T07:10:31.011167+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:10.064019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406044+0000","last_change":"2024-09-21T07:10:42.402630+0000","last_active":"2024-09-21T07:10:44.406044+0000","last_peered":"2024-09-21T07:10:44.406044+0000","last_clean":"2024-09-21T07:10:44.406044+0000","last_became_active":"2024-09-21T07:10:42.402315+0000","last_became_peered":"2024-09-21T07:10:42.402315+0000","last_unstale":"2024-09-21T07:10:44.406044+0000","last_undegraded":"2024-09-21T07:10:44.406044+0000","last_fullsized":"2024-09-21T07:10:44.406044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:33.518055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378828+0000","last_change":"2024-09-21T07:10:43.414223+0000","last_active":"2024-09-21T07:10:47.378828+0000","last_peered":"2024-09-21T07:10:47.378828+0000","last_clean":"2024-09-21T07:10:47.378828+0000","last_became_active":"2024-09-21T07:10:43.413923+0000","last_became_peered":"2024-09-21T07:10:43.413923+0000","last_unstale":"2024-09-21T07:10:47.378828+0000","last_undegraded":"2024-09-21T07:10:47.378828+0000","last_fullsized":"2024-09-21T07:10:47.378828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:40.609307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378700+0000","last_change":"2024-09-21T07:10:42.411409+0000","last_active":"2024-09-21T07:10:47.378700+0000","last_peered":"2024-09-21T07:10:47.378700+0000","last_clean":"2024-09-21T07:10:47.378700+0000","last_became_active":"2024-09-21T07:10:42.411018+0000","last_became_peered":"2024-09-21T07:10:42.411018+0000","last_unstale":"2024-09-21T07:10:47.378700+0000","last_undegraded":"2024-09-21T07:10:47.378700+0000","last_fullsized":"2024-09-21T07:10:47.378700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:47.174619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378665+0000","last_change":"2024-09-21T07:10:43.396425+0000","last_active":"2024-09-21T07:10:47.378665+0000","last_peered":"2024-09-21T07:10:47.378665+0000","last_clean":"2024-09-21T07:10:47.378665+0000","last_became_active":"2024-09-21T07:10:43.396080+0000","last_became_peered":"2024-09-21T07:10:43.396080+0000","last_unstale":"2024-09-21T07:10:47.378665+0000","last_undegraded":"2024-09-21T07:10:47.378665+0000","last_fullsized":"2024-09-21T07:10:47.378665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:55.907463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405149+0000","last_change":"2024-09-21T07:10:42.391433+0000","last_active":"2024-09-21T07:10:44.405149+0000","last_peered":"2024-09-21T07:10:44.405149+0000","last_clean":"2024-09-21T07:10:44.405149+0000","last_became_active":"2024-09-21T07:10:42.391123+0000","last_became_peered":"2024-09-21T07:10:42.391123+0000","last_unstale":"2024-09-21T07:10:44.405149+0000","last_undegraded":"2024-09-21T07:10:44.405149+0000","last_fullsized":"2024-09-21T07:10:44.405149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:25.948155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404277+0000","last_change":"2024-09-21T07:10:43.419811+0000","last_active":"2024-09-21T07:10:44.404277+0000","last_peered":"2024-09-21T07:10:44.404277+0000","last_clean":"2024-09-21T07:10:44.404277+0000","last_became_active":"2024-09-21T07:10:43.419490+0000","last_became_peered":"2024-09-21T07:10:43.419490+0000","last_unstale":"2024-09-21T07:10:44.404277+0000","last_undegraded":"2024-09-21T07:10:44.404277+0000","last_fullsized":"2024-09-21T07:10:44.404277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:08.183794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406254+0000","last_change":"2024-09-21T07:10:42.407863+0000","last_active":"2024-09-21T07:10:44.406254+0000","last_peered":"2024-09-21T07:10:44.406254+0000","last_clean":"2024-09-21T07:10:44.406254+0000","last_became_active":"2024-09-21T07:10:42.407458+0000","last_became_peered":"2024-09-21T07:10:42.407458+0000","last_unstale":"2024-09-21T07:10:44.406254+0000","last_undegraded":"2024-09-21T07:10:44.406254+0000","last_fullsized":"2024-09-21T07:10:44.406254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:49.720067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379751+0000","last_change":"2024-09-21T07:10:43.404989+0000","last_active":"2024-09-21T07:10:47.379751+0000","last_peered":"2024-09-21T07:10:47.379751+0000","last_clean":"2024-09-21T07:10:47.379751+0000","last_became_active":"2024-09-21T07:10:43.404366+0000","last_became_peered":"2024-09-21T07:10:43.404366+0000","last_unstale":"2024-09-21T07:10:47.379751+0000","last_undegraded":"2024-09-21T07:10:47.379751+0000","last_fullsized":"2024-09-21T07:10:47.379751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:47.584490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404434+0000","last_change":"2024-09-21T07:10:42.407164+0000","last_active":"2024-09-21T07:10:44.404434+0000","last_peered":"2024-09-21T07:10:44.404434+0000","last_clean":"2024-09-21T07:10:44.404434+0000","last_became_active":"2024-09-21T07:10:42.406833+0000","last_became_peered":"2024-09-21T07:10:42.406833+0000","last_unstale":"2024-09-21T07:10:44.404434+0000","last_undegraded":"2024-09-21T07:10:44.404434+0000","last_fullsized":"2024-09-21T07:10:44.404434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:50.661135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406462+0000","last_change":"2024-09-21T07:10:43.415076+0000","last_active":"2024-09-21T07:10:44.406462+0000","last_peered":"2024-09-21T07:10:44.406462+0000","last_clean":"2024-09-21T07:10:44.406462+0000","last_became_active":"2024-09-21T07:10:43.414738+0000","last_became_peered":"2024-09-21T07:10:43.414738+0000","last_unstale":"2024-09-21T07:10:44.406462+0000","last_undegraded":"2024-09-21T07:10:44.406462+0000","last_fullsized":"2024-09-21T07:10:44.406462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:37.114753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380363+0000","last_change":"2024-09-21T07:10:42.411427+0000","last_active":"2024-09-21T07:10:47.380363+0000","last_peered":"2024-09-21T07:10:47.380363+0000","last_clean":"2024-09-21T07:10:47.380363+0000","last_became_active":"2024-09-21T07:10:42.411048+0000","last_became_peered":"2024-09-21T07:10:42.411048+0000","last_unstale":"2024-09-21T07:10:47.380363+0000","last_undegraded":"2024-09-21T07:10:47.380363+0000","last_fullsized":"2024-09-21T07:10:47.380363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:55.046653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404296+0000","last_change":"2024-09-21T07:10:43.416948+0000","last_active":"2024-09-21T07:10:44.404296+0000","last_peered":"2024-09-21T07:10:44.404296+0000","last_clean":"2024-09-21T07:10:44.404296+0000","last_became_active":"2024-09-21T07:10:43.416515+0000","last_became_peered":"2024-09-21T07:10:43.416515+0000","last_unstale":"2024-09-21T07:10:44.404296+0000","last_undegraded":"2024-09-21T07:10:44.404296+0000","last_fullsized":"2024-09-21T07:10:44.404296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:23.952801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:45.334427+0000","last_change":"2024-09-21T07:10:42.408894+0000","last_active":"2024-09-21T07:10:45.334427+0000","last_peered":"2024-09-21T07:10:45.334427+0000","last_clean":"2024-09-21T07:10:45.334427+0000","last_became_active":"2024-09-21T07:10:42.408392+0000","last_became_peered":"2024-09-21T07:10:42.408392+0000","last_unstale":"2024-09-21T07:10:45.334427+0000","last_undegraded":"2024-09-21T07:10:45.334427+0000","last_fullsized":"2024-09-21T07:10:45.334427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:22.386244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379581+0000","last_change":"2024-09-21T07:10:43.413469+0000","last_active":"2024-09-21T07:10:47.379581+0000","last_peered":"2024-09-21T07:10:47.379581+0000","last_clean":"2024-09-21T07:10:47.379581+0000","last_became_active":"2024-09-21T07:10:43.413144+0000","last_became_peered":"2024-09-21T07:10:43.413144+0000","last_unstale":"2024-09-21T07:10:47.379581+0000","last_undegraded":"2024-09-21T07:10:47.379581+0000","last_fullsized":"2024-09-21T07:10:47.379581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:42.566546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423623+0000","last_change":"2024-09-21T07:10:42.408673+0000","last_active":"2024-09-21T07:10:44.423623+0000","last_peered":"2024-09-21T07:10:44.423623+0000","last_clean":"2024-09-21T07:10:44.423623+0000","last_became_active":"2024-09-21T07:10:42.408275+0000","last_became_peered":"2024-09-21T07:10:42.408275+0000","last_unstale":"2024-09-21T07:10:44.423623+0000","last_undegraded":"2024-09-21T07:10:44.423623+0000","last_fullsized":"2024-09-21T07:10:44.423623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:53.210856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379385+0000","last_change":"2024-09-21T07:10:43.419670+0000","last_active":"2024-09-21T07:10:47.379385+0000","last_peered":"2024-09-21T07:10:47.379385+0000","last_clean":"2024-09-21T07:10:47.379385+0000","last_became_active":"2024-09-21T07:10:43.419363+0000","last_became_peered":"2024-09-21T07:10:43.419363+0000","last_unstale":"2024-09-21T07:10:47.379385+0000","last_undegraded":"2024-09-21T07:10:47.379385+0000","last_fullsized":"2024-09-21T07:10:47.379385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:05.776799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378700+0000","last_change":"2024-09-21T07:10:42.412541+0000","last_active":"2024-09-21T07:10:47.378700+0000","last_peered":"2024-09-21T07:10:47.378700+0000","last_clean":"2024-09-21T07:10:47.378700+0000","last_became_active":"2024-09-21T07:10:42.412026+0000","last_became_peered":"2024-09-21T07:10:42.412026+0000","last_unstale":"2024-09-21T07:10:47.378700+0000","last_undegraded":"2024-09-21T07:10:47.378700+0000","last_fullsized":"2024-09-21T07:10:47.378700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:46.578438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379684+0000","last_change":"2024-09-21T07:10:43.414157+0000","last_active":"2024-09-21T07:10:47.379684+0000","last_peered":"2024-09-21T07:10:47.379684+0000","last_clean":"2024-09-21T07:10:47.379684+0000","last_became_active":"2024-09-21T07:10:43.413820+0000","last_became_peered":"2024-09-21T07:10:43.413820+0000","last_unstale":"2024-09-21T07:10:47.379684+0000","last_undegraded":"2024-09-21T07:10:47.379684+0000","last_fullsized":"2024-09-21T07:10:47.379684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:56.052704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404360+0000","last_change":"2024-09-21T07:10:42.412473+0000","last_active":"2024-09-21T07:10:44.404360+0000","last_peered":"2024-09-21T07:10:44.404360+0000","last_clean":"2024-09-21T07:10:44.404360+0000","last_became_active":"2024-09-21T07:10:42.412072+0000","last_became_peered":"2024-09-21T07:10:42.412072+0000","last_unstale":"2024-09-21T07:10:44.404360+0000","last_undegraded":"2024-09-21T07:10:44.404360+0000","last_fullsized":"2024-09-21T07:10:44.404360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:38.817344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378949+0000","last_change":"2024-09-21T07:10:43.413781+0000","last_active":"2024-09-21T07:10:47.378949+0000","last_peered":"2024-09-21T07:10:47.378949+0000","last_clean":"2024-09-21T07:10:47.378949+0000","last_became_active":"2024-09-21T07:10:43.413312+0000","last_became_peered":"2024-09-21T07:10:43.413312+0000","last_unstale":"2024-09-21T07:10:47.378949+0000","last_undegraded":"2024-09-21T07:10:47.378949+0000","last_fullsized":"2024-09-21T07:10:47.378949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:36.925353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404554+0000","last_change":"2024-09-21T07:10:42.409241+0000","last_active":"2024-09-21T07:10:44.404554+0000","last_peered":"2024-09-21T07:10:44.404554+0000","last_clean":"2024-09-21T07:10:44.404554+0000","last_became_active":"2024-09-21T07:10:42.408948+0000","last_became_peered":"2024-09-21T07:10:42.408948+0000","last_unstale":"2024-09-21T07:10:44.404554+0000","last_undegraded":"2024-09-21T07:10:44.404554+0000","last_fullsized":"2024-09-21T07:10:44.404554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:10.457714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378889+0000","last_change":"2024-09-21T07:10:43.410463+0000","last_active":"2024-09-21T07:10:47.378889+0000","last_peered":"2024-09-21T07:10:47.378889+0000","last_clean":"2024-09-21T07:10:47.378889+0000","last_became_active":"2024-09-21T07:10:43.410089+0000","last_became_peered":"2024-09-21T07:10:43.410089+0000","last_unstale":"2024-09-21T07:10:47.378889+0000","last_undegraded":"2024-09-21T07:10:47.378889+0000","last_fullsized":"2024-09-21T07:10:47.378889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:58.082249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380087+0000","last_change":"2024-09-21T07:10:42.408618+0000","last_active":"2024-09-21T07:10:47.380087+0000","last_peered":"2024-09-21T07:10:47.380087+0000","last_clean":"2024-09-21T07:10:47.380087+0000","last_became_active":"2024-09-21T07:10:42.408144+0000","last_became_peered":"2024-09-21T07:10:42.408144+0000","last_unstale":"2024-09-21T07:10:47.380087+0000","last_undegraded":"2024-09-21T07:10:47.380087+0000","last_fullsized":"2024-09-21T07:10:47.380087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:25.985040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423370+0000","last_change":"2024-09-21T07:10:43.404982+0000","last_active":"2024-09-21T07:10:44.423370+0000","last_peered":"2024-09-21T07:10:44.423370+0000","last_clean":"2024-09-21T07:10:44.423370+0000","last_became_active":"2024-09-21T07:10:43.404649+0000","last_became_peered":"2024-09-21T07:10:43.404649+0000","last_unstale":"2024-09-21T07:10:44.423370+0000","last_undegraded":"2024-09-21T07:10:44.423370+0000","last_fullsized":"2024-09-21T07:10:44.423370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:32.944402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406445+0000","last_change":"2024-09-21T07:10:43.410758+0000","last_active":"2024-09-21T07:10:44.406445+0000","last_peered":"2024-09-21T07:10:44.406445+0000","last_clean":"2024-09-21T07:10:44.406445+0000","last_became_active":"2024-09-21T07:10:43.410445+0000","last_became_peered":"2024-09-21T07:10:43.410445+0000","last_unstale":"2024-09-21T07:10:44.406445+0000","last_undegraded":"2024-09-21T07:10:44.406445+0000","last_fullsized":"2024-09-21T07:10:44.406445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:26.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380220+0000","last_change":"2024-09-21T07:10:42.410865+0000","last_active":"2024-09-21T07:10:47.380220+0000","last_peered":"2024-09-21T07:10:47.380220+0000","last_clean":"2024-09-21T07:10:47.380220+0000","last_became_active":"2024-09-21T07:10:42.410458+0000","last_became_peered":"2024-09-21T07:10:42.410458+0000","last_unstale":"2024-09-21T07:10:47.380220+0000","last_undegraded":"2024-09-21T07:10:47.380220+0000","last_fullsized":"2024-09-21T07:10:47.380220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:15.945210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405825+0000","last_change":"2024-09-21T07:10:43.406733+0000","last_active":"2024-09-21T07:10:44.405825+0000","last_peered":"2024-09-21T07:10:44.405825+0000","last_clean":"2024-09-21T07:10:44.405825+0000","last_became_active":"2024-09-21T07:10:43.406364+0000","last_became_peered":"2024-09-21T07:10:43.406364+0000","last_unstale":"2024-09-21T07:10:44.405825+0000","last_undegraded":"2024-09-21T07:10:44.405825+0000","last_fullsized":"2024-09-21T07:10:44.405825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:03.491744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380217+0000","last_change":"2024-09-21T07:10:42.409936+0000","last_active":"2024-09-21T07:10:47.380217+0000","last_peered":"2024-09-21T07:10:47.380217+0000","last_clean":"2024-09-21T07:10:47.380217+0000","last_became_active":"2024-09-21T07:10:42.409492+0000","last_became_peered":"2024-09-21T07:10:42.409492+0000","last_unstale":"2024-09-21T07:10:47.380217+0000","last_undegraded":"2024-09-21T07:10:47.380217+0000","last_fullsized":"2024-09-21T07:10:47.380217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:01.062149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378931+0000","last_change":"2024-09-21T07:10:43.408059+0000","last_active":"2024-09-21T07:10:47.378931+0000","last_peered":"2024-09-21T07:10:47.378931+0000","last_clean":"2024-09-21T07:10:47.378931+0000","last_became_active":"2024-09-21T07:10:43.407707+0000","last_became_peered":"2024-09-21T07:10:43.407707+0000","last_unstale":"2024-09-21T07:10:47.378931+0000","last_undegraded":"2024-09-21T07:10:47.378931+0000","last_fullsized":"2024-09-21T07:10:47.378931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:43.156733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379423+0000","last_change":"2024-09-21T07:10:42.403998+0000","last_active":"2024-09-21T07:10:47.379423+0000","last_peered":"2024-09-21T07:10:47.379423+0000","last_clean":"2024-09-21T07:10:47.379423+0000","last_became_active":"2024-09-21T07:10:42.403552+0000","last_became_peered":"2024-09-21T07:10:42.403552+0000","last_unstale":"2024-09-21T07:10:47.379423+0000","last_undegraded":"2024-09-21T07:10:47.379423+0000","last_fullsized":"2024-09-21T07:10:47.379423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:33.377412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379176+0000","last_change":"2024-09-21T07:10:43.411885+0000","last_active":"2024-09-21T07:10:47.379176+0000","last_peered":"2024-09-21T07:10:47.379176+0000","last_clean":"2024-09-21T07:10:47.379176+0000","last_became_active":"2024-09-21T07:10:43.410907+0000","last_became_peered":"2024-09-21T07:10:43.410907+0000","last_unstale":"2024-09-21T07:10:47.379176+0000","last_undegraded":"2024-09-21T07:10:47.379176+0000","last_fullsized":"2024-09-21T07:10:47.379176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:04.920178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379513+0000","last_change":"2024-09-21T07:10:42.408992+0000","last_active":"2024-09-21T07:10:47.379513+0000","last_peered":"2024-09-21T07:10:47.379513+0000","last_clean":"2024-09-21T07:10:47.379513+0000","last_became_active":"2024-09-21T07:10:42.408041+0000","last_became_peered":"2024-09-21T07:10:42.408041+0000","last_unstale":"2024-09-21T07:10:47.379513+0000","last_undegraded":"2024-09-21T07:10:47.379513+0000","last_fullsized":"2024-09-21T07:10:47.379513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:36.986751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":664069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":74731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":212992,"data_stored":73209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":73245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":73119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":221184,"data_stored":74731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":217088,"data_stored":73279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36144,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335696,"statfs":{"total":96636764160,"available":96599752704,"internally_reserved":0,"allocated":815104,"data_stored":664125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:10:55.249 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:10:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.396+0000 7fd82225c640 1 -- 172.21.15.18:0/2746072733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd81c0d3580 msgr2=0x7fd81c162a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.396+0000 7fd82225c640 1 --2- 172.21.15.18:0/2746072733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd81c0d3580 0x7fd81c162a40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0d1fb0 tx=0x7fd81402a8b0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.396+0000 7fd82225c640 1 -- 172.21.15.18:0/2746072733 shutdown_connections 2024-09-21T07:10:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.396+0000 7fd82225c640 1 --2- 172.21.15.18:0/2746072733 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd81c0d3580 0x7fd81c162a40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.396+0000 7fd82225c640 1 --2- 172.21.15.18:0/2746072733 >> v2:172.21.15.49:3300/0 conn(0x7fd81c15c520 0x7fd81c0d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.396+0000 7fd82225c640 1 -- 172.21.15.18:0/2746072733 >> 172.21.15.18:0/2746072733 conn(0x7fd81c073f30 msgr2=0x7fd81c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.396+0000 7fd82225c640 1 -- 172.21.15.18:0/2746072733 shutdown_connections 2024-09-21T07:10:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.396+0000 7fd82225c640 1 -- 172.21.15.18:0/2746072733 wait complete. 2024-09-21T07:10:55.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.398+0000 7fd82225c640 1 Processor -- start 2024-09-21T07:10:55.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.398+0000 7fd82225c640 1 -- start start 2024-09-21T07:10:55.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.399+0000 7fd82225c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd81c0d3580 0x7fd81c0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:55.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.399+0000 7fd82225c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd81c15c520 0x7fd81c15b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:55.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.399+0000 7fd82225c640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd81c15ef50 0x7fd81c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:55.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.399+0000 7fd82225c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c0d1020 con 0x7fd81c0d3580 2024-09-21T07:10:55.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.399+0000 7fd82225c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c163380 con 0x7fd81c15c520 2024-09-21T07:10:55.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.399+0000 7fd82225c640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fd81c0d11a0 con 0x7fd81c15ef50 2024-09-21T07:10:55.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.399+0000 7fd81b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd81c0d3580 0x7fd81c0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.399+0000 7fd81b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd81c0d3580 0x7fd81c0cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50350/0 (socket says 172.21.15.18:50350) 2024-09-21T07:10:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.399+0000 7fd81b7fe640 1 -- 172.21.15.18:0/4217496225 learned_addr learned my addr 172.21.15.18:0/4217496225 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.399+0000 7fd81affd640 1 --2- 172.21.15.18:0/4217496225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd81c15c520 0x7fd81c15b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.399+0000 7fd81bfff640 1 --2- 172.21.15.18:0/4217496225 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd81c15ef50 0x7fd81c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.400+0000 7fd81b7fe640 1 -- 172.21.15.18:0/4217496225 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd81c15ef50 msgr2=0x7fd81c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.400+0000 7fd81b7fe640 1 --2- 172.21.15.18:0/4217496225 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd81c15ef50 0x7fd81c0cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.400+0000 7fd81b7fe640 1 -- 172.21.15.18:0/4217496225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd81c15c520 msgr2=0x7fd81c15b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.400+0000 7fd81b7fe640 1 --2- 172.21.15.18:0/4217496225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd81c15c520 0x7fd81c15b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.400+0000 7fd81b7fe640 1 -- 172.21.15.18:0/4217496225 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd81c0cbd80 con 0x7fd81c0d3580 2024-09-21T07:10:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.400+0000 7fd81b7fe640 1 --2- 172.21.15.18:0/4217496225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd81c0d3580 0x7fd81c0cce20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00c3a0 tx=0x7fd80c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.400+0000 7fd803fff640 1 -- 172.21.15.18:0/4217496225 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c011790 con 0x7fd81c0d3580 2024-09-21T07:10:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.400+0000 7fd803fff640 1 -- 172.21.15.18:0/4217496225 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd80c017070 con 0x7fd81c0d3580 2024-09-21T07:10:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.400+0000 7fd82225c640 1 -- 172.21.15.18:0/4217496225 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd81c0cc060 con 0x7fd81c0d3580 2024-09-21T07:10:55.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.400+0000 7fd803fff640 1 -- 172.21.15.18:0/4217496225 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c011cc0 con 0x7fd81c0d3580 2024-09-21T07:10:55.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.400+0000 7fd82225c640 1 -- 172.21.15.18:0/4217496225 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd81c0cc620 con 0x7fd81c0d3580 2024-09-21T07:10:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.401+0000 7fd82225c640 1 -- 172.21.15.18:0/4217496225 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd81c162a40 con 0x7fd81c0d3580 2024-09-21T07:10:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.402+0000 7fd803fff640 1 -- 172.21.15.18:0/4217496225 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd80c01c460 con 0x7fd81c0d3580 2024-09-21T07:10:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.402+0000 7fd803fff640 1 --2- 172.21.15.18:0/4217496225 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd808078b90 0x7fd80807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.402+0000 7fd803fff640 1 -- 172.21.15.18:0/4217496225 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd80c09a940 con 0x7fd81c0d3580 2024-09-21T07:10:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.403+0000 7fd81affd640 1 --2- 172.21.15.18:0/4217496225 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd808078b90 0x7fd80807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.403+0000 7fd81affd640 1 --2- 172.21.15.18:0/4217496225 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd808078b90 0x7fd80807b0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0cb410 tx=0x7fd810005f70 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:55.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.407+0000 7fd803fff640 1 -- 172.21.15.18:0/4217496225 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd80c0627c0 con 0x7fd81c0d3580 2024-09-21T07:10:55.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.589+0000 7fd82225c640 1 -- 172.21.15.18:0/4217496225 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd81c06b490 con 0x7fd808078b90 2024-09-21T07:10:55.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.594+0000 7fd803fff640 1 -- 172.21.15.18:0/4217496225 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7fd81000fad0 con 0x7fd808078b90 2024-09-21T07:10:55.599 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:55.600 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-21T07:10:55.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.598+0000 7fd82225c640 1 -- 172.21.15.18:0/4217496225 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd808078b90 msgr2=0x7fd80807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:55.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.598+0000 7fd82225c640 1 --2- 172.21.15.18:0/4217496225 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd808078b90 0x7fd80807b0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0cb410 tx=0x7fd810005f70 comp rx=0 tx=0).stop 2024-09-21T07:10:55.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.598+0000 7fd82225c640 1 -- 172.21.15.18:0/4217496225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd81c0d3580 msgr2=0x7fd81c0cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:55.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.598+0000 7fd82225c640 1 --2- 172.21.15.18:0/4217496225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd81c0d3580 0x7fd81c0cce20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00c3a0 tx=0x7fd80c00c860 comp rx=0 tx=0).stop 2024-09-21T07:10:55.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.598+0000 7fd82225c640 1 -- 172.21.15.18:0/4217496225 shutdown_connections 2024-09-21T07:10:55.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.598+0000 7fd82225c640 1 --2- 172.21.15.18:0/4217496225 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd808078b90 0x7fd80807b0a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.598+0000 7fd82225c640 1 --2- 172.21.15.18:0/4217496225 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd81c15ef50 0x7fd81c0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.598+0000 7fd82225c640 1 --2- 172.21.15.18:0/4217496225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd81c15c520 0x7fd81c15b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.598+0000 7fd82225c640 1 --2- 172.21.15.18:0/4217496225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd81c0d3580 0x7fd81c0cce20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.598+0000 7fd82225c640 1 -- 172.21.15.18:0/4217496225 >> 172.21.15.18:0/4217496225 conn(0x7fd81c073f30 msgr2=0x7fd81c0b5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:55.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.598+0000 7fd82225c640 1 -- 172.21.15.18:0/4217496225 shutdown_connections 2024-09-21T07:10:55.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.598+0000 7fd82225c640 1 -- 172.21.15.18:0/4217496225 wait complete. 2024-09-21T07:10:55.612 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-21T07:10:54.316654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":269012,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754705708,"statfs":{"total":773094113280,"available":772818644992,"internally_reserved":0,"allocated":2924544,"data_stored":1770508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002620"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380397+0000","last_change":"2024-09-21T07:10:43.418758+0000","last_active":"2024-09-21T07:10:47.380397+0000","last_peered":"2024-09-21T07:10:47.380397+0000","last_clean":"2024-09-21T07:10:47.380397+0000","last_became_active":"2024-09-21T07:10:43.413221+0000","last_became_peered":"2024-09-21T07:10:43.413221+0000","last_unstale":"2024-09-21T07:10:47.380397+0000","last_undegraded":"2024-09-21T07:10:47.380397+0000","last_fullsized":"2024-09-21T07:10:47.380397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:15.423169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404706+0000","last_change":"2024-09-21T07:10:43.425911+0000","last_active":"2024-09-21T07:10:44.404706+0000","last_peered":"2024-09-21T07:10:44.404706+0000","last_clean":"2024-09-21T07:10:44.404706+0000","last_became_active":"2024-09-21T07:10:43.424831+0000","last_became_peered":"2024-09-21T07:10:43.424831+0000","last_unstale":"2024-09-21T07:10:44.404706+0000","last_undegraded":"2024-09-21T07:10:44.404706+0000","last_fullsized":"2024-09-21T07:10:44.404706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:52.852007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378570+0000","last_change":"2024-09-21T07:10:43.402987+0000","last_active":"2024-09-21T07:10:47.378570+0000","last_peered":"2024-09-21T07:10:47.378570+0000","last_clean":"2024-09-21T07:10:47.378570+0000","last_became_active":"2024-09-21T07:10:43.402600+0000","last_became_peered":"2024-09-21T07:10:43.402600+0000","last_unstale":"2024-09-21T07:10:47.378570+0000","last_undegraded":"2024-09-21T07:10:47.378570+0000","last_fullsized":"2024-09-21T07:10:47.378570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:27.607737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405847+0000","last_change":"2024-09-21T07:10:43.418498+0000","last_active":"2024-09-21T07:10:44.405847+0000","last_peered":"2024-09-21T07:10:44.405847+0000","last_clean":"2024-09-21T07:10:44.405847+0000","last_became_active":"2024-09-21T07:10:43.418075+0000","last_became_peered":"2024-09-21T07:10:43.418075+0000","last_unstale":"2024-09-21T07:10:44.405847+0000","last_undegraded":"2024-09-21T07:10:44.405847+0000","last_fullsized":"2024-09-21T07:10:44.405847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:39.715349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379099+0000","last_change":"2024-09-21T07:10:43.409859+0000","last_active":"2024-09-21T07:10:47.379099+0000","last_peered":"2024-09-21T07:10:47.379099+0000","last_clean":"2024-09-21T07:10:47.379099+0000","last_became_active":"2024-09-21T07:10:43.409171+0000","last_became_peered":"2024-09-21T07:10:43.409171+0000","last_unstale":"2024-09-21T07:10:47.379099+0000","last_undegraded":"2024-09-21T07:10:47.379099+0000","last_fullsized":"2024-09-21T07:10:47.379099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:28.893883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405635+0000","last_change":"2024-09-21T07:10:43.408895+0000","last_active":"2024-09-21T07:10:44.405635+0000","last_peered":"2024-09-21T07:10:44.405635+0000","last_clean":"2024-09-21T07:10:44.405635+0000","last_became_active":"2024-09-21T07:10:43.408402+0000","last_became_peered":"2024-09-21T07:10:43.408402+0000","last_unstale":"2024-09-21T07:10:44.405635+0000","last_undegraded":"2024-09-21T07:10:44.405635+0000","last_fullsized":"2024-09-21T07:10:44.405635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:28.893883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379333+0000","last_change":"2024-09-21T07:10:43.404599+0000","last_active":"2024-09-21T07:10:47.379333+0000","last_peered":"2024-09-21T07:10:47.379333+0000","last_clean":"2024-09-21T07:10:47.379333+0000","last_became_active":"2024-09-21T07:10:43.404288+0000","last_became_peered":"2024-09-21T07:10:43.404288+0000","last_unstale":"2024-09-21T07:10:47.379333+0000","last_undegraded":"2024-09-21T07:10:47.379333+0000","last_fullsized":"2024-09-21T07:10:47.379333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:03.491744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378441+0000","last_change":"2024-09-21T07:10:43.412128+0000","last_active":"2024-09-21T07:10:47.378441+0000","last_peered":"2024-09-21T07:10:47.378441+0000","last_clean":"2024-09-21T07:10:47.378441+0000","last_became_active":"2024-09-21T07:10:43.410969+0000","last_became_peered":"2024-09-21T07:10:43.410969+0000","last_unstale":"2024-09-21T07:10:47.378441+0000","last_undegraded":"2024-09-21T07:10:47.378441+0000","last_fullsized":"2024-09-21T07:10:47.378441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:38.675519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380450+0000","last_change":"2024-09-21T07:10:43.420504+0000","last_active":"2024-09-21T07:10:47.380450+0000","last_peered":"2024-09-21T07:10:47.380450+0000","last_clean":"2024-09-21T07:10:47.380450+0000","last_became_active":"2024-09-21T07:10:43.418716+0000","last_became_peered":"2024-09-21T07:10:43.418716+0000","last_unstale":"2024-09-21T07:10:47.380450+0000","last_undegraded":"2024-09-21T07:10:47.380450+0000","last_fullsized":"2024-09-21T07:10:47.380450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:39.695264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423623+0000","last_change":"2024-09-21T07:10:43.414160+0000","last_active":"2024-09-21T07:10:44.423623+0000","last_peered":"2024-09-21T07:10:44.423623+0000","last_clean":"2024-09-21T07:10:44.423623+0000","last_became_active":"2024-09-21T07:10:43.413651+0000","last_became_peered":"2024-09-21T07:10:43.413651+0000","last_unstale":"2024-09-21T07:10:44.423623+0000","last_undegraded":"2024-09-21T07:10:44.423623+0000","last_fullsized":"2024-09-21T07:10:44.423623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:36.925353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423522+0000","last_change":"2024-09-21T07:10:43.414383+0000","last_active":"2024-09-21T07:10:44.423522+0000","last_peered":"2024-09-21T07:10:44.423522+0000","last_clean":"2024-09-21T07:10:44.423522+0000","last_became_active":"2024-09-21T07:10:43.413520+0000","last_became_peered":"2024-09-21T07:10:43.413520+0000","last_unstale":"2024-09-21T07:10:44.423522+0000","last_undegraded":"2024-09-21T07:10:44.423522+0000","last_fullsized":"2024-09-21T07:10:44.423522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:58.082249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379251+0000","last_change":"2024-09-21T07:10:43.417909+0000","last_active":"2024-09-21T07:10:47.379251+0000","last_peered":"2024-09-21T07:10:47.379251+0000","last_clean":"2024-09-21T07:10:47.379251+0000","last_became_active":"2024-09-21T07:10:43.417587+0000","last_became_peered":"2024-09-21T07:10:43.417587+0000","last_unstale":"2024-09-21T07:10:47.379251+0000","last_undegraded":"2024-09-21T07:10:47.379251+0000","last_fullsized":"2024-09-21T07:10:47.379251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:16.951261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378633+0000","last_change":"2024-09-21T07:10:43.412277+0000","last_active":"2024-09-21T07:10:47.378633+0000","last_peered":"2024-09-21T07:10:47.378633+0000","last_clean":"2024-09-21T07:10:47.378633+0000","last_became_active":"2024-09-21T07:10:43.411507+0000","last_became_peered":"2024-09-21T07:10:43.411507+0000","last_unstale":"2024-09-21T07:10:47.378633+0000","last_undegraded":"2024-09-21T07:10:47.378633+0000","last_fullsized":"2024-09-21T07:10:47.378633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:28.683802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379022+0000","last_change":"2024-09-21T07:10:43.418752+0000","last_active":"2024-09-21T07:10:47.379022+0000","last_peered":"2024-09-21T07:10:47.379022+0000","last_clean":"2024-09-21T07:10:47.379022+0000","last_became_active":"2024-09-21T07:10:43.418424+0000","last_became_peered":"2024-09-21T07:10:43.418424+0000","last_unstale":"2024-09-21T07:10:47.379022+0000","last_undegraded":"2024-09-21T07:10:47.379022+0000","last_fullsized":"2024-09-21T07:10:47.379022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:27.138072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404284+0000","last_change":"2024-09-21T07:10:43.415461+0000","last_active":"2024-09-21T07:10:44.404284+0000","last_peered":"2024-09-21T07:10:44.404284+0000","last_clean":"2024-09-21T07:10:44.404284+0000","last_became_active":"2024-09-21T07:10:43.410697+0000","last_became_peered":"2024-09-21T07:10:43.410697+0000","last_unstale":"2024-09-21T07:10:44.404284+0000","last_undegraded":"2024-09-21T07:10:44.404284+0000","last_fullsized":"2024-09-21T07:10:44.404284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:14.665635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405475+0000","last_change":"2024-09-21T07:10:43.413220+0000","last_active":"2024-09-21T07:10:44.405475+0000","last_peered":"2024-09-21T07:10:44.405475+0000","last_clean":"2024-09-21T07:10:44.405475+0000","last_became_active":"2024-09-21T07:10:43.412892+0000","last_became_peered":"2024-09-21T07:10:43.412892+0000","last_unstale":"2024-09-21T07:10:44.405475+0000","last_undegraded":"2024-09-21T07:10:44.405475+0000","last_fullsized":"2024-09-21T07:10:44.405475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:55.242127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406808+0000","last_change":"2024-09-21T07:10:43.409834+0000","last_active":"2024-09-21T07:10:44.406808+0000","last_peered":"2024-09-21T07:10:44.406808+0000","last_clean":"2024-09-21T07:10:44.406808+0000","last_became_active":"2024-09-21T07:10:43.409533+0000","last_became_peered":"2024-09-21T07:10:43.409533+0000","last_unstale":"2024-09-21T07:10:44.406808+0000","last_undegraded":"2024-09-21T07:10:44.406808+0000","last_fullsized":"2024-09-21T07:10:44.406808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:26.185434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405326+0000","last_change":"2024-09-21T07:10:43.414453+0000","last_active":"2024-09-21T07:10:44.405326+0000","last_peered":"2024-09-21T07:10:44.405326+0000","last_clean":"2024-09-21T07:10:44.405326+0000","last_became_active":"2024-09-21T07:10:43.414138+0000","last_became_peered":"2024-09-21T07:10:43.414138+0000","last_unstale":"2024-09-21T07:10:44.405326+0000","last_undegraded":"2024-09-21T07:10:44.405326+0000","last_fullsized":"2024-09-21T07:10:44.405326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:26.960157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380386+0000","last_change":"2024-09-21T07:10:43.408892+0000","last_active":"2024-09-21T07:10:47.380386+0000","last_peered":"2024-09-21T07:10:47.380386+0000","last_clean":"2024-09-21T07:10:47.380386+0000","last_became_active":"2024-09-21T07:10:43.408554+0000","last_became_peered":"2024-09-21T07:10:43.408554+0000","last_unstale":"2024-09-21T07:10:47.380386+0000","last_undegraded":"2024-09-21T07:10:47.380386+0000","last_fullsized":"2024-09-21T07:10:47.380386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:18.068383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423355+0000","last_change":"2024-09-21T07:10:43.418255+0000","last_active":"2024-09-21T07:10:44.423355+0000","last_peered":"2024-09-21T07:10:44.423355+0000","last_clean":"2024-09-21T07:10:44.423355+0000","last_became_active":"2024-09-21T07:10:43.417893+0000","last_became_peered":"2024-09-21T07:10:43.417893+0000","last_unstale":"2024-09-21T07:10:44.423355+0000","last_undegraded":"2024-09-21T07:10:44.423355+0000","last_fullsized":"2024-09-21T07:10:44.423355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:28.683802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379786+0000","last_change":"2024-09-21T07:10:43.414479+0000","last_active":"2024-09-21T07:10:47.379786+0000","last_peered":"2024-09-21T07:10:47.379786+0000","last_clean":"2024-09-21T07:10:47.379786+0000","last_became_active":"2024-09-21T07:10:43.414121+0000","last_became_peered":"2024-09-21T07:10:43.414121+0000","last_unstale":"2024-09-21T07:10:47.379786+0000","last_undegraded":"2024-09-21T07:10:47.379786+0000","last_fullsized":"2024-09-21T07:10:47.379786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:23.952801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405904+0000","last_change":"2024-09-21T07:10:43.409741+0000","last_active":"2024-09-21T07:10:44.405904+0000","last_peered":"2024-09-21T07:10:44.405904+0000","last_clean":"2024-09-21T07:10:44.405904+0000","last_became_active":"2024-09-21T07:10:43.408139+0000","last_became_peered":"2024-09-21T07:10:43.408139+0000","last_unstale":"2024-09-21T07:10:44.405904+0000","last_undegraded":"2024-09-21T07:10:44.405904+0000","last_fullsized":"2024-09-21T07:10:44.405904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:03.311605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379526+0000","last_change":"2024-09-21T07:10:43.416414+0000","last_active":"2024-09-21T07:10:47.379526+0000","last_peered":"2024-09-21T07:10:47.379526+0000","last_clean":"2024-09-21T07:10:47.379526+0000","last_became_active":"2024-09-21T07:10:43.415380+0000","last_became_peered":"2024-09-21T07:10:43.415380+0000","last_unstale":"2024-09-21T07:10:47.379526+0000","last_undegraded":"2024-09-21T07:10:47.379526+0000","last_fullsized":"2024-09-21T07:10:47.379526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:34:29.882522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405523+0000","last_change":"2024-09-21T07:10:43.407135+0000","last_active":"2024-09-21T07:10:44.405523+0000","last_peered":"2024-09-21T07:10:44.405523+0000","last_clean":"2024-09-21T07:10:44.405523+0000","last_became_active":"2024-09-21T07:10:43.406562+0000","last_became_peered":"2024-09-21T07:10:43.406562+0000","last_unstale":"2024-09-21T07:10:44.405523+0000","last_undegraded":"2024-09-21T07:10:44.405523+0000","last_fullsized":"2024-09-21T07:10:44.405523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:45.271471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379360+0000","last_change":"2024-09-21T07:10:43.415169+0000","last_active":"2024-09-21T07:10:47.379360+0000","last_peered":"2024-09-21T07:10:47.379360+0000","last_clean":"2024-09-21T07:10:47.379360+0000","last_became_active":"2024-09-21T07:10:43.414845+0000","last_became_peered":"2024-09-21T07:10:43.414845+0000","last_unstale":"2024-09-21T07:10:47.379360+0000","last_undegraded":"2024-09-21T07:10:47.379360+0000","last_fullsized":"2024-09-21T07:10:47.379360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:14.930286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423654+0000","last_change":"2024-09-21T07:10:43.410604+0000","last_active":"2024-09-21T07:10:44.423654+0000","last_peered":"2024-09-21T07:10:44.423654+0000","last_clean":"2024-09-21T07:10:44.423654+0000","last_became_active":"2024-09-21T07:10:43.410225+0000","last_became_peered":"2024-09-21T07:10:43.410225+0000","last_unstale":"2024-09-21T07:10:44.423654+0000","last_undegraded":"2024-09-21T07:10:44.423654+0000","last_fullsized":"2024-09-21T07:10:44.423654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:04.920178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404615+0000","last_change":"2024-09-21T07:10:43.425050+0000","last_active":"2024-09-21T07:10:44.404615+0000","last_peered":"2024-09-21T07:10:44.404615+0000","last_clean":"2024-09-21T07:10:44.404615+0000","last_became_active":"2024-09-21T07:10:43.424686+0000","last_became_peered":"2024-09-21T07:10:43.424686+0000","last_unstale":"2024-09-21T07:10:44.404615+0000","last_undegraded":"2024-09-21T07:10:44.404615+0000","last_fullsized":"2024-09-21T07:10:44.404615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:11.009112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379756+0000","last_change":"2024-09-21T07:10:43.415955+0000","last_active":"2024-09-21T07:10:47.379756+0000","last_peered":"2024-09-21T07:10:47.379756+0000","last_clean":"2024-09-21T07:10:47.379756+0000","last_became_active":"2024-09-21T07:10:43.415633+0000","last_became_peered":"2024-09-21T07:10:43.415633+0000","last_unstale":"2024-09-21T07:10:47.379756+0000","last_undegraded":"2024-09-21T07:10:47.379756+0000","last_fullsized":"2024-09-21T07:10:47.379756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:08.696212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379956+0000","last_change":"2024-09-21T07:10:43.417820+0000","last_active":"2024-09-21T07:10:47.379956+0000","last_peered":"2024-09-21T07:10:47.379956+0000","last_clean":"2024-09-21T07:10:47.379956+0000","last_became_active":"2024-09-21T07:10:43.417482+0000","last_became_peered":"2024-09-21T07:10:43.417482+0000","last_unstale":"2024-09-21T07:10:47.379956+0000","last_undegraded":"2024-09-21T07:10:47.379956+0000","last_fullsized":"2024-09-21T07:10:47.379956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:11.009112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406171+0000","last_change":"2024-09-21T07:10:43.416076+0000","last_active":"2024-09-21T07:10:44.406171+0000","last_peered":"2024-09-21T07:10:44.406171+0000","last_clean":"2024-09-21T07:10:44.406171+0000","last_became_active":"2024-09-21T07:10:43.415727+0000","last_became_peered":"2024-09-21T07:10:43.415727+0000","last_unstale":"2024-09-21T07:10:44.406171+0000","last_undegraded":"2024-09-21T07:10:44.406171+0000","last_fullsized":"2024-09-21T07:10:44.406171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:30.034257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405184+0000","last_change":"2024-09-21T07:10:43.411355+0000","last_active":"2024-09-21T07:10:44.405184+0000","last_peered":"2024-09-21T07:10:44.405184+0000","last_clean":"2024-09-21T07:10:44.405184+0000","last_became_active":"2024-09-21T07:10:43.408638+0000","last_became_peered":"2024-09-21T07:10:43.408638+0000","last_unstale":"2024-09-21T07:10:44.405184+0000","last_undegraded":"2024-09-21T07:10:44.405184+0000","last_fullsized":"2024-09-21T07:10:44.405184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:34.237185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423340+0000","last_change":"2024-09-21T07:10:43.422509+0000","last_active":"2024-09-21T07:10:44.423340+0000","last_peered":"2024-09-21T07:10:44.423340+0000","last_clean":"2024-09-21T07:10:44.423340+0000","last_became_active":"2024-09-21T07:10:43.422122+0000","last_became_peered":"2024-09-21T07:10:43.422122+0000","last_unstale":"2024-09-21T07:10:44.423340+0000","last_undegraded":"2024-09-21T07:10:44.423340+0000","last_fullsized":"2024-09-21T07:10:44.423340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:38.675519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379436+0000","last_change":"2024-09-21T07:10:43.411295+0000","last_active":"2024-09-21T07:10:47.379436+0000","last_peered":"2024-09-21T07:10:47.379436+0000","last_clean":"2024-09-21T07:10:47.379436+0000","last_became_active":"2024-09-21T07:10:43.410963+0000","last_became_peered":"2024-09-21T07:10:43.410963+0000","last_unstale":"2024-09-21T07:10:47.379436+0000","last_undegraded":"2024-09-21T07:10:47.379436+0000","last_fullsized":"2024-09-21T07:10:47.379436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:02.068200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379059+0000","last_change":"2024-09-21T07:10:42.407850+0000","last_active":"2024-09-21T07:10:47.379059+0000","last_peered":"2024-09-21T07:10:47.379059+0000","last_clean":"2024-09-21T07:10:47.379059+0000","last_became_active":"2024-09-21T07:10:42.407497+0000","last_became_peered":"2024-09-21T07:10:42.407497+0000","last_unstale":"2024-09-21T07:10:47.379059+0000","last_undegraded":"2024-09-21T07:10:47.379059+0000","last_fullsized":"2024-09-21T07:10:47.379059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:34.583545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379982+0000","last_change":"2024-09-21T07:10:43.398164+0000","last_active":"2024-09-21T07:10:47.379982+0000","last_peered":"2024-09-21T07:10:47.379982+0000","last_clean":"2024-09-21T07:10:47.379982+0000","last_became_active":"2024-09-21T07:10:43.397191+0000","last_became_peered":"2024-09-21T07:10:43.397191+0000","last_unstale":"2024-09-21T07:10:47.379982+0000","last_undegraded":"2024-09-21T07:10:47.379982+0000","last_fullsized":"2024-09-21T07:10:47.379982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:52.852007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423132+0000","last_change":"2024-09-21T07:10:42.403613+0000","last_active":"2024-09-21T07:10:44.423132+0000","last_peered":"2024-09-21T07:10:44.423132+0000","last_clean":"2024-09-21T07:10:44.423132+0000","last_became_active":"2024-09-21T07:10:42.402543+0000","last_became_peered":"2024-09-21T07:10:42.402543+0000","last_unstale":"2024-09-21T07:10:44.423132+0000","last_undegraded":"2024-09-21T07:10:44.423132+0000","last_fullsized":"2024-09-21T07:10:44.423132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:15.945210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379738+0000","last_change":"2024-09-21T07:10:42.405878+0000","last_active":"2024-09-21T07:10:47.379738+0000","last_peered":"2024-09-21T07:10:47.379738+0000","last_clean":"2024-09-21T07:10:47.379738+0000","last_became_active":"2024-09-21T07:10:42.404760+0000","last_became_peered":"2024-09-21T07:10:42.404760+0000","last_unstale":"2024-09-21T07:10:47.379738+0000","last_undegraded":"2024-09-21T07:10:47.379738+0000","last_fullsized":"2024-09-21T07:10:47.379738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:24.910811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378702+0000","last_change":"2024-09-21T07:10:43.421622+0000","last_active":"2024-09-21T07:10:47.378702+0000","last_peered":"2024-09-21T07:10:47.378702+0000","last_clean":"2024-09-21T07:10:47.378702+0000","last_became_active":"2024-09-21T07:10:43.421299+0000","last_became_peered":"2024-09-21T07:10:43.421299+0000","last_unstale":"2024-09-21T07:10:47.378702+0000","last_undegraded":"2024-09-21T07:10:47.378702+0000","last_fullsized":"2024-09-21T07:10:47.378702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:32.944402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405639+0000","last_change":"2024-09-21T07:10:42.401842+0000","last_active":"2024-09-21T07:10:44.405639+0000","last_peered":"2024-09-21T07:10:44.405639+0000","last_clean":"2024-09-21T07:10:44.405639+0000","last_became_active":"2024-09-21T07:10:42.401304+0000","last_became_peered":"2024-09-21T07:10:42.401304+0000","last_unstale":"2024-09-21T07:10:44.405639+0000","last_undegraded":"2024-09-21T07:10:44.405639+0000","last_fullsized":"2024-09-21T07:10:44.405639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:31.113600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404237+0000","last_change":"2024-09-21T07:10:43.424849+0000","last_active":"2024-09-21T07:10:44.404237+0000","last_peered":"2024-09-21T07:10:44.404237+0000","last_clean":"2024-09-21T07:10:44.404237+0000","last_became_active":"2024-09-21T07:10:43.424491+0000","last_became_peered":"2024-09-21T07:10:43.424491+0000","last_unstale":"2024-09-21T07:10:44.404237+0000","last_undegraded":"2024-09-21T07:10:44.404237+0000","last_fullsized":"2024-09-21T07:10:44.404237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:15.151519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423579+0000","last_change":"2024-09-21T07:10:42.404454+0000","last_active":"2024-09-21T07:10:44.423579+0000","last_peered":"2024-09-21T07:10:44.423579+0000","last_clean":"2024-09-21T07:10:44.423579+0000","last_became_active":"2024-09-21T07:10:42.404062+0000","last_became_peered":"2024-09-21T07:10:42.404062+0000","last_unstale":"2024-09-21T07:10:44.423579+0000","last_undegraded":"2024-09-21T07:10:44.423579+0000","last_fullsized":"2024-09-21T07:10:44.423579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:33.377412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406705+0000","last_change":"2024-09-21T07:10:43.409200+0000","last_active":"2024-09-21T07:10:44.406705+0000","last_peered":"2024-09-21T07:10:44.406705+0000","last_clean":"2024-09-21T07:10:44.406705+0000","last_became_active":"2024-09-21T07:10:43.408864+0000","last_became_peered":"2024-09-21T07:10:43.408864+0000","last_unstale":"2024-09-21T07:10:44.406705+0000","last_undegraded":"2024-09-21T07:10:44.406705+0000","last_fullsized":"2024-09-21T07:10:44.406705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:39.695264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406436+0000","last_change":"2024-09-21T07:10:42.406774+0000","last_active":"2024-09-21T07:10:44.406436+0000","last_peered":"2024-09-21T07:10:44.406436+0000","last_clean":"2024-09-21T07:10:44.406436+0000","last_became_active":"2024-09-21T07:10:42.404461+0000","last_became_peered":"2024-09-21T07:10:42.404461+0000","last_unstale":"2024-09-21T07:10:44.406436+0000","last_undegraded":"2024-09-21T07:10:44.406436+0000","last_fullsized":"2024-09-21T07:10:44.406436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:38.533867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379345+0000","last_change":"2024-09-21T07:10:43.408995+0000","last_active":"2024-09-21T07:10:47.379345+0000","last_peered":"2024-09-21T07:10:47.379345+0000","last_clean":"2024-09-21T07:10:47.379345+0000","last_became_active":"2024-09-21T07:10:43.408670+0000","last_became_peered":"2024-09-21T07:10:43.408670+0000","last_unstale":"2024-09-21T07:10:47.379345+0000","last_undegraded":"2024-09-21T07:10:47.379345+0000","last_fullsized":"2024-09-21T07:10:47.379345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:08.183794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404702+0000","last_change":"2024-09-21T07:10:42.412327+0000","last_active":"2024-09-21T07:10:44.404702+0000","last_peered":"2024-09-21T07:10:44.404702+0000","last_clean":"2024-09-21T07:10:44.404702+0000","last_became_active":"2024-09-21T07:10:42.411992+0000","last_became_peered":"2024-09-21T07:10:42.411992+0000","last_unstale":"2024-09-21T07:10:44.404702+0000","last_undegraded":"2024-09-21T07:10:44.404702+0000","last_fullsized":"2024-09-21T07:10:44.404702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:12.534169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379508+0000","last_change":"2024-09-21T07:10:43.408223+0000","last_active":"2024-09-21T07:10:47.379508+0000","last_peered":"2024-09-21T07:10:47.379508+0000","last_clean":"2024-09-21T07:10:47.379508+0000","last_became_active":"2024-09-21T07:10:43.407894+0000","last_became_peered":"2024-09-21T07:10:43.407894+0000","last_unstale":"2024-09-21T07:10:47.379508+0000","last_undegraded":"2024-09-21T07:10:47.379508+0000","last_fullsized":"2024-09-21T07:10:47.379508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:26.991092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423435+0000","last_change":"2024-09-21T07:10:42.399128+0000","last_active":"2024-09-21T07:10:44.423435+0000","last_peered":"2024-09-21T07:10:44.423435+0000","last_clean":"2024-09-21T07:10:44.423435+0000","last_became_active":"2024-09-21T07:10:42.398772+0000","last_became_peered":"2024-09-21T07:10:42.398772+0000","last_unstale":"2024-09-21T07:10:44.423435+0000","last_undegraded":"2024-09-21T07:10:44.423435+0000","last_fullsized":"2024-09-21T07:10:44.423435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:01.062149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379989+0000","last_change":"2024-09-21T07:10:43.415524+0000","last_active":"2024-09-21T07:10:47.379989+0000","last_peered":"2024-09-21T07:10:47.379989+0000","last_clean":"2024-09-21T07:10:47.379989+0000","last_became_active":"2024-09-21T07:10:43.415196+0000","last_became_peered":"2024-09-21T07:10:43.415196+0000","last_unstale":"2024-09-21T07:10:47.379989+0000","last_undegraded":"2024-09-21T07:10:47.379989+0000","last_fullsized":"2024-09-21T07:10:47.379989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:30.034257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380068+0000","last_change":"2024-09-21T07:10:42.402240+0000","last_active":"2024-09-21T07:10:47.380068+0000","last_peered":"2024-09-21T07:10:47.380068+0000","last_clean":"2024-09-21T07:10:47.380068+0000","last_became_active":"2024-09-21T07:10:42.401874+0000","last_became_peered":"2024-09-21T07:10:42.401874+0000","last_unstale":"2024-09-21T07:10:47.380068+0000","last_undegraded":"2024-09-21T07:10:47.380068+0000","last_fullsized":"2024-09-21T07:10:47.380068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:57.539687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379271+0000","last_change":"2024-09-21T07:10:43.411598+0000","last_active":"2024-09-21T07:10:47.379271+0000","last_peered":"2024-09-21T07:10:47.379271+0000","last_clean":"2024-09-21T07:10:47.379271+0000","last_became_active":"2024-09-21T07:10:43.411274+0000","last_became_peered":"2024-09-21T07:10:43.411274+0000","last_unstale":"2024-09-21T07:10:47.379271+0000","last_undegraded":"2024-09-21T07:10:47.379271+0000","last_fullsized":"2024-09-21T07:10:47.379271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:15.151519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406106+0000","last_change":"2024-09-21T07:10:42.401021+0000","last_active":"2024-09-21T07:10:44.406106+0000","last_peered":"2024-09-21T07:10:44.406106+0000","last_clean":"2024-09-21T07:10:44.406106+0000","last_became_active":"2024-09-21T07:10:42.400700+0000","last_became_peered":"2024-09-21T07:10:42.400700+0000","last_unstale":"2024-09-21T07:10:44.406106+0000","last_undegraded":"2024-09-21T07:10:44.406106+0000","last_fullsized":"2024-09-21T07:10:44.406106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:05.347695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379844+0000","last_change":"2024-09-21T07:10:43.410354+0000","last_active":"2024-09-21T07:10:47.379844+0000","last_peered":"2024-09-21T07:10:47.379844+0000","last_clean":"2024-09-21T07:10:47.379844+0000","last_became_active":"2024-09-21T07:10:43.409526+0000","last_became_peered":"2024-09-21T07:10:43.409526+0000","last_unstale":"2024-09-21T07:10:47.379844+0000","last_undegraded":"2024-09-21T07:10:47.379844+0000","last_fullsized":"2024-09-21T07:10:47.379844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:39.715349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423098+0000","last_change":"2024-09-21T07:10:42.402010+0000","last_active":"2024-09-21T07:10:44.423098+0000","last_peered":"2024-09-21T07:10:44.423098+0000","last_clean":"2024-09-21T07:10:44.423098+0000","last_became_active":"2024-09-21T07:10:42.401682+0000","last_became_peered":"2024-09-21T07:10:42.401682+0000","last_unstale":"2024-09-21T07:10:44.423098+0000","last_undegraded":"2024-09-21T07:10:44.423098+0000","last_fullsized":"2024-09-21T07:10:44.423098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:15.662211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423495+0000","last_change":"2024-09-21T07:10:43.412631+0000","last_active":"2024-09-21T07:10:44.423495+0000","last_peered":"2024-09-21T07:10:44.423495+0000","last_clean":"2024-09-21T07:10:44.423495+0000","last_became_active":"2024-09-21T07:10:43.412250+0000","last_became_peered":"2024-09-21T07:10:43.412250+0000","last_unstale":"2024-09-21T07:10:44.423495+0000","last_undegraded":"2024-09-21T07:10:44.423495+0000","last_fullsized":"2024-09-21T07:10:44.423495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:40.609307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405073+0000","last_change":"2024-09-21T07:10:42.405955+0000","last_active":"2024-09-21T07:10:44.405073+0000","last_peered":"2024-09-21T07:10:44.405073+0000","last_clean":"2024-09-21T07:10:44.405073+0000","last_became_active":"2024-09-21T07:10:42.405499+0000","last_became_peered":"2024-09-21T07:10:42.405499+0000","last_unstale":"2024-09-21T07:10:44.405073+0000","last_undegraded":"2024-09-21T07:10:44.405073+0000","last_fullsized":"2024-09-21T07:10:44.405073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:11.896704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379646+0000","last_change":"2024-09-21T07:10:43.408372+0000","last_active":"2024-09-21T07:10:47.379646+0000","last_peered":"2024-09-21T07:10:47.379646+0000","last_clean":"2024-09-21T07:10:47.379646+0000","last_became_active":"2024-09-21T07:10:43.407452+0000","last_became_peered":"2024-09-21T07:10:43.407452+0000","last_unstale":"2024-09-21T07:10:47.379646+0000","last_undegraded":"2024-09-21T07:10:47.379646+0000","last_fullsized":"2024-09-21T07:10:47.379646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:08.696212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379139+0000","last_change":"2024-09-21T07:10:42.406082+0000","last_active":"2024-09-21T07:10:47.379139+0000","last_peered":"2024-09-21T07:10:47.379139+0000","last_clean":"2024-09-21T07:10:47.379139+0000","last_became_active":"2024-09-21T07:10:42.405726+0000","last_became_peered":"2024-09-21T07:10:42.405726+0000","last_unstale":"2024-09-21T07:10:47.379139+0000","last_undegraded":"2024-09-21T07:10:47.379139+0000","last_fullsized":"2024-09-21T07:10:47.379139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:21.349501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380329+0000","last_change":"2024-09-21T07:10:43.412104+0000","last_active":"2024-09-21T07:10:47.380329+0000","last_peered":"2024-09-21T07:10:47.380329+0000","last_clean":"2024-09-21T07:10:47.380329+0000","last_became_active":"2024-09-21T07:10:43.411622+0000","last_became_peered":"2024-09-21T07:10:43.411622+0000","last_unstale":"2024-09-21T07:10:47.380329+0000","last_undegraded":"2024-09-21T07:10:47.380329+0000","last_fullsized":"2024-09-21T07:10:47.380329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:37.114753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405248+0000","last_change":"2024-09-21T07:10:42.391724+0000","last_active":"2024-09-21T07:10:44.405248+0000","last_peered":"2024-09-21T07:10:44.405248+0000","last_clean":"2024-09-21T07:10:44.405248+0000","last_became_active":"2024-09-21T07:10:42.391190+0000","last_became_peered":"2024-09-21T07:10:42.391190+0000","last_unstale":"2024-09-21T07:10:44.405248+0000","last_undegraded":"2024-09-21T07:10:44.405248+0000","last_fullsized":"2024-09-21T07:10:44.405248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:04.908220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380620+0000","last_change":"2024-09-21T07:10:43.420199+0000","last_active":"2024-09-21T07:10:47.380620+0000","last_peered":"2024-09-21T07:10:47.380620+0000","last_clean":"2024-09-21T07:10:47.380620+0000","last_became_active":"2024-09-21T07:10:43.418363+0000","last_became_peered":"2024-09-21T07:10:43.418363+0000","last_unstale":"2024-09-21T07:10:47.380620+0000","last_undegraded":"2024-09-21T07:10:47.380620+0000","last_fullsized":"2024-09-21T07:10:47.380620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:05.987550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404730+0000","last_change":"2024-09-21T07:10:42.410464+0000","last_active":"2024-09-21T07:10:44.404730+0000","last_peered":"2024-09-21T07:10:44.404730+0000","last_clean":"2024-09-21T07:10:44.404730+0000","last_became_active":"2024-09-21T07:10:42.410107+0000","last_became_peered":"2024-09-21T07:10:42.410107+0000","last_unstale":"2024-09-21T07:10:44.404730+0000","last_undegraded":"2024-09-21T07:10:44.404730+0000","last_fullsized":"2024-09-21T07:10:44.404730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:31.991591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406480+0000","last_change":"2024-09-21T07:10:43.418911+0000","last_active":"2024-09-21T07:10:44.406480+0000","last_peered":"2024-09-21T07:10:44.406480+0000","last_clean":"2024-09-21T07:10:44.406480+0000","last_became_active":"2024-09-21T07:10:43.418563+0000","last_became_peered":"2024-09-21T07:10:43.418563+0000","last_unstale":"2024-09-21T07:10:44.406480+0000","last_undegraded":"2024-09-21T07:10:44.406480+0000","last_fullsized":"2024-09-21T07:10:44.406480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:18.068383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405257+0000","last_change":"2024-09-21T07:10:42.402258+0000","last_active":"2024-09-21T07:10:44.405257+0000","last_peered":"2024-09-21T07:10:44.405257+0000","last_clean":"2024-09-21T07:10:44.405257+0000","last_became_active":"2024-09-21T07:10:42.401789+0000","last_became_peered":"2024-09-21T07:10:42.401789+0000","last_unstale":"2024-09-21T07:10:44.405257+0000","last_undegraded":"2024-09-21T07:10:44.405257+0000","last_fullsized":"2024-09-21T07:10:44.405257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:21.657184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380075+0000","last_change":"2024-09-21T07:10:43.415279+0000","last_active":"2024-09-21T07:10:47.380075+0000","last_peered":"2024-09-21T07:10:47.380075+0000","last_clean":"2024-09-21T07:10:47.380075+0000","last_became_active":"2024-09-21T07:10:43.414955+0000","last_became_peered":"2024-09-21T07:10:43.414955+0000","last_unstale":"2024-09-21T07:10:47.380075+0000","last_undegraded":"2024-09-21T07:10:47.380075+0000","last_fullsized":"2024-09-21T07:10:47.380075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:26.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379230+0000","last_change":"2024-09-21T07:10:32.034091+0000","last_active":"2024-09-21T07:10:47.379230+0000","last_peered":"2024-09-21T07:10:47.379230+0000","last_clean":"2024-09-21T07:10:47.379230+0000","last_became_active":"2024-09-21T07:10:32.033005+0000","last_became_peered":"2024-09-21T07:10:32.033005+0000","last_unstale":"2024-09-21T07:10:47.379230+0000","last_undegraded":"2024-09-21T07:10:47.379230+0000","last_fullsized":"2024-09-21T07:10:47.379230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_clean_scrub_stamp":"2024-09-21T07:10:31.011167+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:10.064019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406044+0000","last_change":"2024-09-21T07:10:42.402630+0000","last_active":"2024-09-21T07:10:44.406044+0000","last_peered":"2024-09-21T07:10:44.406044+0000","last_clean":"2024-09-21T07:10:44.406044+0000","last_became_active":"2024-09-21T07:10:42.402315+0000","last_became_peered":"2024-09-21T07:10:42.402315+0000","last_unstale":"2024-09-21T07:10:44.406044+0000","last_undegraded":"2024-09-21T07:10:44.406044+0000","last_fullsized":"2024-09-21T07:10:44.406044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:33.518055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378828+0000","last_change":"2024-09-21T07:10:43.414223+0000","last_active":"2024-09-21T07:10:47.378828+0000","last_peered":"2024-09-21T07:10:47.378828+0000","last_clean":"2024-09-21T07:10:47.378828+0000","last_became_active":"2024-09-21T07:10:43.413923+0000","last_became_peered":"2024-09-21T07:10:43.413923+0000","last_unstale":"2024-09-21T07:10:47.378828+0000","last_undegraded":"2024-09-21T07:10:47.378828+0000","last_fullsized":"2024-09-21T07:10:47.378828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:40.609307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378700+0000","last_change":"2024-09-21T07:10:42.411409+0000","last_active":"2024-09-21T07:10:47.378700+0000","last_peered":"2024-09-21T07:10:47.378700+0000","last_clean":"2024-09-21T07:10:47.378700+0000","last_became_active":"2024-09-21T07:10:42.411018+0000","last_became_peered":"2024-09-21T07:10:42.411018+0000","last_unstale":"2024-09-21T07:10:47.378700+0000","last_undegraded":"2024-09-21T07:10:47.378700+0000","last_fullsized":"2024-09-21T07:10:47.378700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:47.174619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378665+0000","last_change":"2024-09-21T07:10:43.396425+0000","last_active":"2024-09-21T07:10:47.378665+0000","last_peered":"2024-09-21T07:10:47.378665+0000","last_clean":"2024-09-21T07:10:47.378665+0000","last_became_active":"2024-09-21T07:10:43.396080+0000","last_became_peered":"2024-09-21T07:10:43.396080+0000","last_unstale":"2024-09-21T07:10:47.378665+0000","last_undegraded":"2024-09-21T07:10:47.378665+0000","last_fullsized":"2024-09-21T07:10:47.378665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:55.907463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405149+0000","last_change":"2024-09-21T07:10:42.391433+0000","last_active":"2024-09-21T07:10:44.405149+0000","last_peered":"2024-09-21T07:10:44.405149+0000","last_clean":"2024-09-21T07:10:44.405149+0000","last_became_active":"2024-09-21T07:10:42.391123+0000","last_became_peered":"2024-09-21T07:10:42.391123+0000","last_unstale":"2024-09-21T07:10:44.405149+0000","last_undegraded":"2024-09-21T07:10:44.405149+0000","last_fullsized":"2024-09-21T07:10:44.405149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:25.948155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404277+0000","last_change":"2024-09-21T07:10:43.419811+0000","last_active":"2024-09-21T07:10:44.404277+0000","last_peered":"2024-09-21T07:10:44.404277+0000","last_clean":"2024-09-21T07:10:44.404277+0000","last_became_active":"2024-09-21T07:10:43.419490+0000","last_became_peered":"2024-09-21T07:10:43.419490+0000","last_unstale":"2024-09-21T07:10:44.404277+0000","last_undegraded":"2024-09-21T07:10:44.404277+0000","last_fullsized":"2024-09-21T07:10:44.404277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:08.183794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406254+0000","last_change":"2024-09-21T07:10:42.407863+0000","last_active":"2024-09-21T07:10:44.406254+0000","last_peered":"2024-09-21T07:10:44.406254+0000","last_clean":"2024-09-21T07:10:44.406254+0000","last_became_active":"2024-09-21T07:10:42.407458+0000","last_became_peered":"2024-09-21T07:10:42.407458+0000","last_unstale":"2024-09-21T07:10:44.406254+0000","last_undegraded":"2024-09-21T07:10:44.406254+0000","last_fullsized":"2024-09-21T07:10:44.406254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:49.720067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379751+0000","last_change":"2024-09-21T07:10:43.404989+0000","last_active":"2024-09-21T07:10:47.379751+0000","last_peered":"2024-09-21T07:10:47.379751+0000","last_clean":"2024-09-21T07:10:47.379751+0000","last_became_active":"2024-09-21T07:10:43.404366+0000","last_became_peered":"2024-09-21T07:10:43.404366+0000","last_unstale":"2024-09-21T07:10:47.379751+0000","last_undegraded":"2024-09-21T07:10:47.379751+0000","last_fullsized":"2024-09-21T07:10:47.379751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:47.584490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404434+0000","last_change":"2024-09-21T07:10:42.407164+0000","last_active":"2024-09-21T07:10:44.404434+0000","last_peered":"2024-09-21T07:10:44.404434+0000","last_clean":"2024-09-21T07:10:44.404434+0000","last_became_active":"2024-09-21T07:10:42.406833+0000","last_became_peered":"2024-09-21T07:10:42.406833+0000","last_unstale":"2024-09-21T07:10:44.404434+0000","last_undegraded":"2024-09-21T07:10:44.404434+0000","last_fullsized":"2024-09-21T07:10:44.404434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:50.661135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406462+0000","last_change":"2024-09-21T07:10:43.415076+0000","last_active":"2024-09-21T07:10:44.406462+0000","last_peered":"2024-09-21T07:10:44.406462+0000","last_clean":"2024-09-21T07:10:44.406462+0000","last_became_active":"2024-09-21T07:10:43.414738+0000","last_became_peered":"2024-09-21T07:10:43.414738+0000","last_unstale":"2024-09-21T07:10:44.406462+0000","last_undegraded":"2024-09-21T07:10:44.406462+0000","last_fullsized":"2024-09-21T07:10:44.406462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:37.114753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380363+0000","last_change":"2024-09-21T07:10:42.411427+0000","last_active":"2024-09-21T07:10:47.380363+0000","last_peered":"2024-09-21T07:10:47.380363+0000","last_clean":"2024-09-21T07:10:47.380363+0000","last_became_active":"2024-09-21T07:10:42.411048+0000","last_became_peered":"2024-09-21T07:10:42.411048+0000","last_unstale":"2024-09-21T07:10:47.380363+0000","last_undegraded":"2024-09-21T07:10:47.380363+0000","last_fullsized":"2024-09-21T07:10:47.380363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:55.046653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404296+0000","last_change":"2024-09-21T07:10:43.416948+0000","last_active":"2024-09-21T07:10:44.404296+0000","last_peered":"2024-09-21T07:10:44.404296+0000","last_clean":"2024-09-21T07:10:44.404296+0000","last_became_active":"2024-09-21T07:10:43.416515+0000","last_became_peered":"2024-09-21T07:10:43.416515+0000","last_unstale":"2024-09-21T07:10:44.404296+0000","last_undegraded":"2024-09-21T07:10:44.404296+0000","last_fullsized":"2024-09-21T07:10:44.404296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:23.952801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:45.334427+0000","last_change":"2024-09-21T07:10:42.408894+0000","last_active":"2024-09-21T07:10:45.334427+0000","last_peered":"2024-09-21T07:10:45.334427+0000","last_clean":"2024-09-21T07:10:45.334427+0000","last_became_active":"2024-09-21T07:10:42.408392+0000","last_became_peered":"2024-09-21T07:10:42.408392+0000","last_unstale":"2024-09-21T07:10:45.334427+0000","last_undegraded":"2024-09-21T07:10:45.334427+0000","last_fullsized":"2024-09-21T07:10:45.334427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:22.386244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379581+0000","last_change":"2024-09-21T07:10:43.413469+0000","last_active":"2024-09-21T07:10:47.379581+0000","last_peered":"2024-09-21T07:10:47.379581+0000","last_clean":"2024-09-21T07:10:47.379581+0000","last_became_active":"2024-09-21T07:10:43.413144+0000","last_became_peered":"2024-09-21T07:10:43.413144+0000","last_unstale":"2024-09-21T07:10:47.379581+0000","last_undegraded":"2024-09-21T07:10:47.379581+0000","last_fullsized":"2024-09-21T07:10:47.379581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:42.566546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423623+0000","last_change":"2024-09-21T07:10:42.408673+0000","last_active":"2024-09-21T07:10:44.423623+0000","last_peered":"2024-09-21T07:10:44.423623+0000","last_clean":"2024-09-21T07:10:44.423623+0000","last_became_active":"2024-09-21T07:10:42.408275+0000","last_became_peered":"2024-09-21T07:10:42.408275+0000","last_unstale":"2024-09-21T07:10:44.423623+0000","last_undegraded":"2024-09-21T07:10:44.423623+0000","last_fullsized":"2024-09-21T07:10:44.423623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:53.210856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379385+0000","last_change":"2024-09-21T07:10:43.419670+0000","last_active":"2024-09-21T07:10:47.379385+0000","last_peered":"2024-09-21T07:10:47.379385+0000","last_clean":"2024-09-21T07:10:47.379385+0000","last_became_active":"2024-09-21T07:10:43.419363+0000","last_became_peered":"2024-09-21T07:10:43.419363+0000","last_unstale":"2024-09-21T07:10:47.379385+0000","last_undegraded":"2024-09-21T07:10:47.379385+0000","last_fullsized":"2024-09-21T07:10:47.379385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:05.776799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378700+0000","last_change":"2024-09-21T07:10:42.412541+0000","last_active":"2024-09-21T07:10:47.378700+0000","last_peered":"2024-09-21T07:10:47.378700+0000","last_clean":"2024-09-21T07:10:47.378700+0000","last_became_active":"2024-09-21T07:10:42.412026+0000","last_became_peered":"2024-09-21T07:10:42.412026+0000","last_unstale":"2024-09-21T07:10:47.378700+0000","last_undegraded":"2024-09-21T07:10:47.378700+0000","last_fullsized":"2024-09-21T07:10:47.378700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:46.578438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379684+0000","last_change":"2024-09-21T07:10:43.414157+0000","last_active":"2024-09-21T07:10:47.379684+0000","last_peered":"2024-09-21T07:10:47.379684+0000","last_clean":"2024-09-21T07:10:47.379684+0000","last_became_active":"2024-09-21T07:10:43.413820+0000","last_became_peered":"2024-09-21T07:10:43.413820+0000","last_unstale":"2024-09-21T07:10:47.379684+0000","last_undegraded":"2024-09-21T07:10:47.379684+0000","last_fullsized":"2024-09-21T07:10:47.379684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:56.052704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404360+0000","last_change":"2024-09-21T07:10:42.412473+0000","last_active":"2024-09-21T07:10:44.404360+0000","last_peered":"2024-09-21T07:10:44.404360+0000","last_clean":"2024-09-21T07:10:44.404360+0000","last_became_active":"2024-09-21T07:10:42.412072+0000","last_became_peered":"2024-09-21T07:10:42.412072+0000","last_unstale":"2024-09-21T07:10:44.404360+0000","last_undegraded":"2024-09-21T07:10:44.404360+0000","last_fullsized":"2024-09-21T07:10:44.404360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:38.817344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378949+0000","last_change":"2024-09-21T07:10:43.413781+0000","last_active":"2024-09-21T07:10:47.378949+0000","last_peered":"2024-09-21T07:10:47.378949+0000","last_clean":"2024-09-21T07:10:47.378949+0000","last_became_active":"2024-09-21T07:10:43.413312+0000","last_became_peered":"2024-09-21T07:10:43.413312+0000","last_unstale":"2024-09-21T07:10:47.378949+0000","last_undegraded":"2024-09-21T07:10:47.378949+0000","last_fullsized":"2024-09-21T07:10:47.378949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:36.925353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.404554+0000","last_change":"2024-09-21T07:10:42.409241+0000","last_active":"2024-09-21T07:10:44.404554+0000","last_peered":"2024-09-21T07:10:44.404554+0000","last_clean":"2024-09-21T07:10:44.404554+0000","last_became_active":"2024-09-21T07:10:42.408948+0000","last_became_peered":"2024-09-21T07:10:42.408948+0000","last_unstale":"2024-09-21T07:10:44.404554+0000","last_undegraded":"2024-09-21T07:10:44.404554+0000","last_fullsized":"2024-09-21T07:10:44.404554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:10.457714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378889+0000","last_change":"2024-09-21T07:10:43.410463+0000","last_active":"2024-09-21T07:10:47.378889+0000","last_peered":"2024-09-21T07:10:47.378889+0000","last_clean":"2024-09-21T07:10:47.378889+0000","last_became_active":"2024-09-21T07:10:43.410089+0000","last_became_peered":"2024-09-21T07:10:43.410089+0000","last_unstale":"2024-09-21T07:10:47.378889+0000","last_undegraded":"2024-09-21T07:10:47.378889+0000","last_fullsized":"2024-09-21T07:10:47.378889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:58.082249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380087+0000","last_change":"2024-09-21T07:10:42.408618+0000","last_active":"2024-09-21T07:10:47.380087+0000","last_peered":"2024-09-21T07:10:47.380087+0000","last_clean":"2024-09-21T07:10:47.380087+0000","last_became_active":"2024-09-21T07:10:42.408144+0000","last_became_peered":"2024-09-21T07:10:42.408144+0000","last_unstale":"2024-09-21T07:10:47.380087+0000","last_undegraded":"2024-09-21T07:10:47.380087+0000","last_fullsized":"2024-09-21T07:10:47.380087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:25.985040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.423370+0000","last_change":"2024-09-21T07:10:43.404982+0000","last_active":"2024-09-21T07:10:44.423370+0000","last_peered":"2024-09-21T07:10:44.423370+0000","last_clean":"2024-09-21T07:10:44.423370+0000","last_became_active":"2024-09-21T07:10:43.404649+0000","last_became_peered":"2024-09-21T07:10:43.404649+0000","last_unstale":"2024-09-21T07:10:44.423370+0000","last_undegraded":"2024-09-21T07:10:44.423370+0000","last_fullsized":"2024-09-21T07:10:44.423370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:32.944402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.406445+0000","last_change":"2024-09-21T07:10:43.410758+0000","last_active":"2024-09-21T07:10:44.406445+0000","last_peered":"2024-09-21T07:10:44.406445+0000","last_clean":"2024-09-21T07:10:44.406445+0000","last_became_active":"2024-09-21T07:10:43.410445+0000","last_became_peered":"2024-09-21T07:10:43.410445+0000","last_unstale":"2024-09-21T07:10:44.406445+0000","last_undegraded":"2024-09-21T07:10:44.406445+0000","last_fullsized":"2024-09-21T07:10:44.406445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:26.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380220+0000","last_change":"2024-09-21T07:10:42.410865+0000","last_active":"2024-09-21T07:10:47.380220+0000","last_peered":"2024-09-21T07:10:47.380220+0000","last_clean":"2024-09-21T07:10:47.380220+0000","last_became_active":"2024-09-21T07:10:42.410458+0000","last_became_peered":"2024-09-21T07:10:42.410458+0000","last_unstale":"2024-09-21T07:10:47.380220+0000","last_undegraded":"2024-09-21T07:10:47.380220+0000","last_fullsized":"2024-09-21T07:10:47.380220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:15.945210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:44.405825+0000","last_change":"2024-09-21T07:10:43.406733+0000","last_active":"2024-09-21T07:10:44.405825+0000","last_peered":"2024-09-21T07:10:44.405825+0000","last_clean":"2024-09-21T07:10:44.405825+0000","last_became_active":"2024-09-21T07:10:43.406364+0000","last_became_peered":"2024-09-21T07:10:43.406364+0000","last_unstale":"2024-09-21T07:10:44.405825+0000","last_undegraded":"2024-09-21T07:10:44.405825+0000","last_fullsized":"2024-09-21T07:10:44.405825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:03.491744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.380217+0000","last_change":"2024-09-21T07:10:42.409936+0000","last_active":"2024-09-21T07:10:47.380217+0000","last_peered":"2024-09-21T07:10:47.380217+0000","last_clean":"2024-09-21T07:10:47.380217+0000","last_became_active":"2024-09-21T07:10:42.409492+0000","last_became_peered":"2024-09-21T07:10:42.409492+0000","last_unstale":"2024-09-21T07:10:47.380217+0000","last_undegraded":"2024-09-21T07:10:47.380217+0000","last_fullsized":"2024-09-21T07:10:47.380217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:01.062149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.378931+0000","last_change":"2024-09-21T07:10:43.408059+0000","last_active":"2024-09-21T07:10:47.378931+0000","last_peered":"2024-09-21T07:10:47.378931+0000","last_clean":"2024-09-21T07:10:47.378931+0000","last_became_active":"2024-09-21T07:10:43.407707+0000","last_became_peered":"2024-09-21T07:10:43.407707+0000","last_unstale":"2024-09-21T07:10:47.378931+0000","last_undegraded":"2024-09-21T07:10:47.378931+0000","last_fullsized":"2024-09-21T07:10:47.378931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:43.156733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379423+0000","last_change":"2024-09-21T07:10:42.403998+0000","last_active":"2024-09-21T07:10:47.379423+0000","last_peered":"2024-09-21T07:10:47.379423+0000","last_clean":"2024-09-21T07:10:47.379423+0000","last_became_active":"2024-09-21T07:10:42.403552+0000","last_became_peered":"2024-09-21T07:10:42.403552+0000","last_unstale":"2024-09-21T07:10:47.379423+0000","last_undegraded":"2024-09-21T07:10:47.379423+0000","last_fullsized":"2024-09-21T07:10:47.379423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:33.377412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379176+0000","last_change":"2024-09-21T07:10:43.411885+0000","last_active":"2024-09-21T07:10:47.379176+0000","last_peered":"2024-09-21T07:10:47.379176+0000","last_clean":"2024-09-21T07:10:47.379176+0000","last_became_active":"2024-09-21T07:10:43.410907+0000","last_became_peered":"2024-09-21T07:10:43.410907+0000","last_unstale":"2024-09-21T07:10:47.379176+0000","last_undegraded":"2024-09-21T07:10:47.379176+0000","last_fullsized":"2024-09-21T07:10:47.379176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:42.380021+0000","last_clean_scrub_stamp":"2024-09-21T07:10:42.380021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:04.920178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:10:47.379513+0000","last_change":"2024-09-21T07:10:42.408992+0000","last_active":"2024-09-21T07:10:47.379513+0000","last_peered":"2024-09-21T07:10:47.379513+0000","last_clean":"2024-09-21T07:10:47.379513+0000","last_became_active":"2024-09-21T07:10:42.408041+0000","last_became_peered":"2024-09-21T07:10:42.408041+0000","last_unstale":"2024-09-21T07:10:47.379513+0000","last_undegraded":"2024-09-21T07:10:47.379513+0000","last_fullsized":"2024-09-21T07:10:47.379513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:41.373970+0000","last_clean_scrub_stamp":"2024-09-21T07:10:41.373970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:36.986751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":664069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":74731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":212992,"data_stored":73209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":73245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":73119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":221184,"data_stored":74731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":217088,"data_stored":73279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36144,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335696,"statfs":{"total":96636764160,"available":96599752704,"internally_reserved":0,"allocated":815104,"data_stored":664125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:10:55.615 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:10:55.615 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T07:10:55.616 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T07:10:55.616 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T07:10:55.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.765+0000 7f9f70af9640 1 -- 172.21.15.18:0/3230357067 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9f6c162a40 msgr2=0x7f9f6c162e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:55.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.765+0000 7f9f70af9640 1 --2- 172.21.15.18:0/3230357067 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9f6c162a40 0x7f9f6c162e50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9f64005fd0 tx=0x7f9f6402a5d0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.765+0000 7f9f70af9640 1 -- 172.21.15.18:0/3230357067 shutdown_connections 2024-09-21T07:10:55.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.765+0000 7f9f70af9640 1 --2- 172.21.15.18:0/3230357067 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9f6c162a40 0x7f9f6c162e50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.765+0000 7f9f70af9640 1 --2- 172.21.15.18:0/3230357067 >> v2:172.21.15.49:3300/0 conn(0x7f9f6c15ef50 0x7f9f6c15c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.765+0000 7f9f70af9640 1 -- 172.21.15.18:0/3230357067 >> 172.21.15.18:0/3230357067 conn(0x7f9f6c073f30 msgr2=0x7f9f6c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:55.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.765+0000 7f9f70af9640 1 -- 172.21.15.18:0/3230357067 shutdown_connections 2024-09-21T07:10:55.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.765+0000 7f9f70af9640 1 -- 172.21.15.18:0/3230357067 wait complete. 2024-09-21T07:10:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.767+0000 7f9f70af9640 1 Processor -- start 2024-09-21T07:10:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.767+0000 7f9f70af9640 1 -- start start 2024-09-21T07:10:55.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f70af9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f6c0cef70 0x7f9f6c0acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:55.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f70af9640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9f6c15ef50 0x7f9f6c0b9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:55.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f70af9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f6c162a40 0x7f9f6c15b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:55.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f70af9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c0d11a0 con 0x7f9f6c162a40 2024-09-21T07:10:55.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f70af9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c0d1020 con 0x7f9f6c0cef70 2024-09-21T07:10:55.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f70af9640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6c0d1320 con 0x7f9f6c15ef50 2024-09-21T07:10:55.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f6ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f6c162a40 0x7f9f6c15b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:55.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f6ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f6c162a40 0x7f9f6c15b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50354/0 (socket says 172.21.15.18:50354) 2024-09-21T07:10:55.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f6ad9d640 1 -- 172.21.15.18:0/3111615928 learned_addr learned my addr 172.21.15.18:0/3111615928 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:55.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f69d9b640 1 --2- 172.21.15.18:0/3111615928 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9f6c15ef50 0x7f9f6c0b9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:55.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f6a59c640 1 --2- 172.21.15.18:0/3111615928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f6c0cef70 0x7f9f6c0acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:55.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f6ad9d640 1 -- 172.21.15.18:0/3111615928 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9f6c15ef50 msgr2=0x7f9f6c0b9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:55.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f6ad9d640 1 --2- 172.21.15.18:0/3111615928 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9f6c15ef50 0x7f9f6c0b9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f6ad9d640 1 -- 172.21.15.18:0/3111615928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f6c0cef70 msgr2=0x7f9f6c0acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:55.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f6ad9d640 1 --2- 172.21.15.18:0/3111615928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f6c0cef70 0x7f9f6c0acab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:55.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f6ad9d640 1 -- 172.21.15.18:0/3111615928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6c1f5720 con 0x7f9f6c162a40 2024-09-21T07:10:55.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.769+0000 7f9f6ad9d640 1 --2- 172.21.15.18:0/3111615928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f6c162a40 0x7f9f6c15b780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f64006010 tx=0x7f9f64003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:55.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.770+0000 7f9f62ffd640 1 -- 172.21.15.18:0/3111615928 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6403e030 con 0x7f9f6c162a40 2024-09-21T07:10:55.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.770+0000 7f9f62ffd640 1 -- 172.21.15.18:0/3111615928 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f64003c20 con 0x7f9f6c162a40 2024-09-21T07:10:55.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.770+0000 7f9f62ffd640 1 -- 172.21.15.18:0/3111615928 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f64035040 con 0x7f9f6c162a40 2024-09-21T07:10:55.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.770+0000 7f9f70af9640 1 -- 172.21.15.18:0/3111615928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f6c1f8d10 con 0x7f9f6c162a40 2024-09-21T07:10:55.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.770+0000 7f9f70af9640 1 -- 172.21.15.18:0/3111615928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f6c1f9460 con 0x7f9f6c162a40 2024-09-21T07:10:55.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.771+0000 7f9f70af9640 1 -- 172.21.15.18:0/3111615928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f6c0d17d0 con 0x7f9f6c162a40 2024-09-21T07:10:55.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.771+0000 7f9f62ffd640 1 -- 172.21.15.18:0/3111615928 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9f64041030 con 0x7f9f6c162a40 2024-09-21T07:10:55.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.772+0000 7f9f62ffd640 1 --2- 172.21.15.18:0/3111615928 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9f4c078b90 0x7f9f4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.772+0000 7f9f62ffd640 1 -- 172.21.15.18:0/3111615928 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9f640bb190 con 0x7f9f6c162a40 2024-09-21T07:10:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.772+0000 7f9f6a59c640 1 --2- 172.21.15.18:0/3111615928 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9f4c078b90 0x7f9f4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:55.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.773+0000 7f9f6a59c640 1 --2- 172.21.15.18:0/3111615928 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9f4c078b90 0x7f9f4c07b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c005fd0 tx=0x7f9f5c009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:55.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:55.777+0000 7f9f62ffd640 1 -- 172.21.15.18:0/3111615928 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9f6c1f5720 con 0x7f9f6c162a40 2024-09-21T07:10:56.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.003+0000 7f9f70af9640 1 -- 172.21.15.18:0/3111615928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9f6c162ef0 con 0x7f9f6c162a40 2024-09-21T07:10:56.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.003+0000 7f9f62ffd640 1 -- 172.21.15.18:0/3111615928 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9f64083010 con 0x7f9f6c162a40 2024-09-21T07:10:56.006 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:56.006 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T07:10:56.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.005+0000 7f9f70af9640 1 -- 172.21.15.18:0/3111615928 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9f4c078b90 msgr2=0x7f9f4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.005+0000 7f9f70af9640 1 --2- 172.21.15.18:0/3111615928 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9f4c078b90 0x7f9f4c07b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c005fd0 tx=0x7f9f5c009500 comp rx=0 tx=0).stop 2024-09-21T07:10:56.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.005+0000 7f9f70af9640 1 -- 172.21.15.18:0/3111615928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f6c162a40 msgr2=0x7f9f6c15b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.005+0000 7f9f70af9640 1 --2- 172.21.15.18:0/3111615928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f6c162a40 0x7f9f6c15b780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f64006010 tx=0x7f9f64003820 comp rx=0 tx=0).stop 2024-09-21T07:10:56.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.005+0000 7f9f70af9640 1 -- 172.21.15.18:0/3111615928 shutdown_connections 2024-09-21T07:10:56.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.005+0000 7f9f70af9640 1 --2- 172.21.15.18:0/3111615928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f6c162a40 0x7f9f6c15b780 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.005+0000 7f9f70af9640 1 --2- 172.21.15.18:0/3111615928 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9f4c078b90 0x7f9f4c07b0a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.005+0000 7f9f70af9640 1 --2- 172.21.15.18:0/3111615928 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9f6c15ef50 0x7f9f6c0b9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.005+0000 7f9f70af9640 1 --2- 172.21.15.18:0/3111615928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f6c0cef70 0x7f9f6c0acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.005+0000 7f9f70af9640 1 -- 172.21.15.18:0/3111615928 >> 172.21.15.18:0/3111615928 conn(0x7f9f6c073f30 msgr2=0x7f9f6c15df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:56.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.005+0000 7f9f70af9640 1 -- 172.21.15.18:0/3111615928 shutdown_connections 2024-09-21T07:10:56.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.005+0000 7f9f70af9640 1 -- 172.21.15.18:0/3111615928 wait complete. 2024-09-21T07:10:56.019 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T07:10:56.019 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:10:56.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.133+0000 7fd3dae07640 1 -- 172.21.15.18:0/590117791 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd3d406e460 msgr2=0x7fd3d4160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.133+0000 7fd3dae07640 1 --2- 172.21.15.18:0/590117791 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd3d406e460 0x7fd3d4160ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009860 tx=0x7fd3c802a5a0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.133+0000 7fd3dae07640 1 -- 172.21.15.18:0/590117791 shutdown_connections 2024-09-21T07:10:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.133+0000 7fd3dae07640 1 --2- 172.21.15.18:0/590117791 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd3d406e460 0x7fd3d4160ca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.133+0000 7fd3dae07640 1 -- 172.21.15.18:0/590117791 >> 172.21.15.18:0/590117791 conn(0x7fd3d4073340 msgr2=0x7fd3d4073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.133+0000 7fd3dae07640 1 -- 172.21.15.18:0/590117791 shutdown_connections 2024-09-21T07:10:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.133+0000 7fd3dae07640 1 -- 172.21.15.18:0/590117791 wait complete. 2024-09-21T07:10:56.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.135+0000 7fd3dae07640 1 Processor -- start 2024-09-21T07:10:56.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.135+0000 7fd3dae07640 1 -- start start 2024-09-21T07:10:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3dae07640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3d40716d0 0x7fd3d4159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3dae07640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d40cf5b0 0x7fd3d41400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3dae07640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd3d40b1bf0 0x7fd3d40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3dae07640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d40d05a0 con 0x7fd3d40cf5b0 2024-09-21T07:10:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3dae07640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d40d0420 con 0x7fd3d40716d0 2024-09-21T07:10:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3dae07640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fd3d40d0720 con 0x7fd3d40b1bf0 2024-09-21T07:10:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3d3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d40cf5b0 0x7fd3d41400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3d3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d40cf5b0 0x7fd3d41400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50368/0 (socket says 172.21.15.18:50368) 2024-09-21T07:10:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3d3fff640 1 -- 172.21.15.18:0/145909386 learned_addr learned my addr 172.21.15.18:0/145909386 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3d93a4640 1 --2- 172.21.15.18:0/145909386 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd3d40b1bf0 0x7fd3d40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3d8ba3640 1 --2- 172.21.15.18:0/145909386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3d40716d0 0x7fd3d4159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3d3fff640 1 -- 172.21.15.18:0/145909386 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd3d40b1bf0 msgr2=0x7fd3d40b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3d3fff640 1 --2- 172.21.15.18:0/145909386 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd3d40b1bf0 0x7fd3d40b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3d3fff640 1 -- 172.21.15.18:0/145909386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3d40716d0 msgr2=0x7fd3d4159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3d3fff640 1 --2- 172.21.15.18:0/145909386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3d40716d0 0x7fd3d4159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3d3fff640 1 -- 172.21.15.18:0/145909386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d40b2540 con 0x7fd3d40cf5b0 2024-09-21T07:10:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3d3fff640 1 --2- 172.21.15.18:0/145909386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d40cf5b0 0x7fd3d41400f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009980 tx=0x7fd3c8033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3d17fa640 1 -- 172.21.15.18:0/145909386 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8031b50 con 0x7fd3d40cf5b0 2024-09-21T07:10:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3d17fa640 1 -- 172.21.15.18:0/145909386 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3c8031de0 con 0x7fd3d40cf5b0 2024-09-21T07:10:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3d17fa640 1 -- 172.21.15.18:0/145909386 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8033330 con 0x7fd3d40cf5b0 2024-09-21T07:10:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.137+0000 7fd3dae07640 1 -- 172.21.15.18:0/145909386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3d413e930 con 0x7fd3d40cf5b0 2024-09-21T07:10:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.138+0000 7fd3dae07640 1 -- 172.21.15.18:0/145909386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d4141cb0 con 0x7fd3d40cf5b0 2024-09-21T07:10:56.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.138+0000 7fd3dae07640 1 -- 172.21.15.18:0/145909386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3d413e6a0 con 0x7fd3d40cf5b0 2024-09-21T07:10:56.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.139+0000 7fd3d17fa640 1 -- 172.21.15.18:0/145909386 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd3c80334d0 con 0x7fd3d40cf5b0 2024-09-21T07:10:56.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.140+0000 7fd3d17fa640 1 --2- 172.21.15.18:0/145909386 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd3c0078b90 0x7fd3c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.140+0000 7fd3d17fa640 1 -- 172.21.15.18:0/145909386 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd3c80bc1d0 con 0x7fd3d40cf5b0 2024-09-21T07:10:56.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.140+0000 7fd3d8ba3640 1 --2- 172.21.15.18:0/145909386 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd3c0078b90 0x7fd3c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:56.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.141+0000 7fd3d8ba3640 1 --2- 172.21.15.18:0/145909386 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd3c0078b90 0x7fd3c007b0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4001600 tx=0x7fd3c4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:56.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.144+0000 7fd3d17fa640 1 -- 172.21.15.18:0/145909386 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd3d40b2540 con 0x7fd3d40cf5b0 2024-09-21T07:10:56.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.372+0000 7fd3dae07640 1 -- 172.21.15.18:0/145909386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3d4160ca0 con 0x7fd3d40cf5b0 2024-09-21T07:10:56.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.372+0000 7fd3d17fa640 1 -- 172.21.15.18:0/145909386 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5214 (secure 0 0 0) 0x7fd3c803f030 con 0x7fd3d40cf5b0 2024-09-21T07:10:56.375 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:56.375 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"btime":"2024-09-21T07:10:46:409212+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/760501489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":760501489},{"type":"v1","addr":"172.21.15.49:6835","nonce":760501489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2249656343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2249656343},{"type":"v1","addr":"172.21.15.49:6837","nonce":2249656343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2651218421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2651218421},{"type":"v1","addr":"172.21.15.18:6834","nonce":2651218421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:10:42.833958+0000","modified":"2024-09-21T07:10:45.793498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2785506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2785506081},{"type":"v1","addr":"172.21.15.18:6835","nonce":2785506081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":1}]} 2024-09-21T07:10:56.376 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2024-09-21T07:10:56.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.375+0000 7fd3dae07640 1 -- 172.21.15.18:0/145909386 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd3c0078b90 msgr2=0x7fd3c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.375+0000 7fd3dae07640 1 --2- 172.21.15.18:0/145909386 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd3c0078b90 0x7fd3c007b0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4001600 tx=0x7fd3c4009040 comp rx=0 tx=0).stop 2024-09-21T07:10:56.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.375+0000 7fd3dae07640 1 -- 172.21.15.18:0/145909386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d40cf5b0 msgr2=0x7fd3d41400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.375+0000 7fd3dae07640 1 --2- 172.21.15.18:0/145909386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d40cf5b0 0x7fd3d41400f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009980 tx=0x7fd3c8033ba0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.375+0000 7fd3dae07640 1 -- 172.21.15.18:0/145909386 shutdown_connections 2024-09-21T07:10:56.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.375+0000 7fd3dae07640 1 --2- 172.21.15.18:0/145909386 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd3c0078b90 0x7fd3c007b0a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.375+0000 7fd3dae07640 1 --2- 172.21.15.18:0/145909386 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd3d40b1bf0 0x7fd3d40b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.375+0000 7fd3dae07640 1 --2- 172.21.15.18:0/145909386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d40cf5b0 0x7fd3d41400f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.375+0000 7fd3dae07640 1 --2- 172.21.15.18:0/145909386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3d40716d0 0x7fd3d4159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.375+0000 7fd3dae07640 1 -- 172.21.15.18:0/145909386 >> 172.21.15.18:0/145909386 conn(0x7fd3d4073340 msgr2=0x7fd3d4070990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:56.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.375+0000 7fd3dae07640 1 -- 172.21.15.18:0/145909386 shutdown_connections 2024-09-21T07:10:56.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.375+0000 7fd3dae07640 1 -- 172.21.15.18:0/145909386 wait complete. 2024-09-21T07:10:56.389 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:10:56.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.502+0000 7f8423c30640 1 -- 172.21.15.18:0/2835980411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c0d3580 msgr2=0x7f841c162a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.502+0000 7f8423c30640 1 --2- 172.21.15.18:0/2835980411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c0d3580 0x7f841c162a40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f841c0b7020 tx=0x7f841402aa30 comp rx=0 tx=0).stop 2024-09-21T07:10:56.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.503+0000 7f8423c30640 1 -- 172.21.15.18:0/2835980411 shutdown_connections 2024-09-21T07:10:56.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.503+0000 7f8423c30640 1 --2- 172.21.15.18:0/2835980411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c0d3580 0x7f841c162a40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.503+0000 7f8423c30640 1 --2- 172.21.15.18:0/2835980411 >> v2:172.21.15.49:3300/0 conn(0x7f841c0cef70 0x7f841c0d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.503+0000 7f8423c30640 1 --2- 172.21.15.18:0/2835980411 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f841c15ef50 0x7f841c15c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.503+0000 7f8423c30640 1 -- 172.21.15.18:0/2835980411 >> 172.21.15.18:0/2835980411 conn(0x7f841c073f30 msgr2=0x7f841c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:56.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.503+0000 7f8423c30640 1 -- 172.21.15.18:0/2835980411 shutdown_connections 2024-09-21T07:10:56.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.503+0000 7f8423c30640 1 -- 172.21.15.18:0/2835980411 wait complete. 2024-09-21T07:10:56.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.504+0000 7f8423c30640 1 Processor -- start 2024-09-21T07:10:56.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.504+0000 7f8423c30640 1 -- start start 2024-09-21T07:10:56.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f8423c30640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c0cef70 0x7f841c151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f8423c30640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c0d3580 0x7f841c0abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f8423c30640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f841c15ef50 0x7f841c0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f8423c30640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f841c163420 con 0x7f841c0d3580 2024-09-21T07:10:56.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f8423c30640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f841c1632a0 con 0x7f841c0cef70 2024-09-21T07:10:56.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f8423c30640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f841c0d1020 con 0x7f841c15ef50 2024-09-21T07:10:56.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f84211cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c0d3580 0x7f841c0abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:56.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f84211cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c0d3580 0x7f841c0abca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45738/0 (socket says 172.21.15.18:45738) 2024-09-21T07:10:56.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f84211cb640 1 -- 172.21.15.18:0/1843352550 learned_addr learned my addr 172.21.15.18:0/1843352550 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:56.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f84219cc640 1 --2- 172.21.15.18:0/1843352550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c0cef70 0x7f841c151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:56.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f84221cd640 1 --2- 172.21.15.18:0/1843352550 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f841c15ef50 0x7f841c0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:56.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f84211cb640 1 -- 172.21.15.18:0/1843352550 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f841c15ef50 msgr2=0x7f841c0cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f84211cb640 1 --2- 172.21.15.18:0/1843352550 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f841c15ef50 0x7f841c0cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f84211cb640 1 -- 172.21.15.18:0/1843352550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c0cef70 msgr2=0x7f841c151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f84211cb640 1 --2- 172.21.15.18:0/1843352550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c0cef70 0x7f841c151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f84211cb640 1 -- 172.21.15.18:0/1843352550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c152030 con 0x7f841c0d3580 2024-09-21T07:10:56.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f84221cd640 1 --2- 172.21.15.18:0/1843352550 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f841c15ef50 0x7f841c0cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:10:56.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.506+0000 7f84211cb640 1 --2- 172.21.15.18:0/1843352550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c0d3580 0x7f841c0abca0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f840c00d610 tx=0x7f840c00dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:56.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.507+0000 7f84127fc640 1 -- 172.21.15.18:0/1843352550 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c017070 con 0x7f841c0d3580 2024-09-21T07:10:56.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.507+0000 7f84127fc640 1 -- 172.21.15.18:0/1843352550 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f840c009a40 con 0x7f841c0d3580 2024-09-21T07:10:56.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.507+0000 7f84127fc640 1 -- 172.21.15.18:0/1843352550 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c010460 con 0x7f841c0d3580 2024-09-21T07:10:56.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.507+0000 7f8423c30640 1 -- 172.21.15.18:0/1843352550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841c1f6600 con 0x7f841c0d3580 2024-09-21T07:10:56.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.507+0000 7f8423c30640 1 -- 172.21.15.18:0/1843352550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841c0ab1c0 con 0x7f841c0d3580 2024-09-21T07:10:56.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.508+0000 7f8423c30640 1 -- 172.21.15.18:0/1843352550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841c1f6370 con 0x7f841c0d3580 2024-09-21T07:10:56.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.508+0000 7f84127fc640 1 -- 172.21.15.18:0/1843352550 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f840c01a070 con 0x7f841c0d3580 2024-09-21T07:10:56.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.509+0000 7f84127fc640 1 --2- 172.21.15.18:0/1843352550 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8400078bc0 0x7f840007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.509+0000 7f84127fc640 1 -- 172.21.15.18:0/1843352550 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f840c09ad20 con 0x7f841c0d3580 2024-09-21T07:10:56.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.509+0000 7f84219cc640 1 --2- 172.21.15.18:0/1843352550 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8400078bc0 0x7f840007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:56.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.510+0000 7f84219cc640 1 --2- 172.21.15.18:0/1843352550 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8400078bc0 0x7f840007b0d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8418004630 tx=0x7f841800b2e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:56.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.513+0000 7f84127fc640 1 -- 172.21.15.18:0/1843352550 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f840c062a80 con 0x7f841c0d3580 2024-09-21T07:10:56.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.741+0000 7f8423c30640 1 -- 172.21.15.18:0/1843352550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f841c162a40 con 0x7f841c0d3580 2024-09-21T07:10:56.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.742+0000 7f84127fc640 1 -- 172.21.15.18:0/1843352550 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5214 (secure 0 0 0) 0x7f840c0674b0 con 0x7f841c0d3580 2024-09-21T07:10:56.745 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:56.745 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"btime":"2024-09-21T07:10:46:409212+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/760501489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":760501489},{"type":"v1","addr":"172.21.15.49:6835","nonce":760501489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2249656343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2249656343},{"type":"v1","addr":"172.21.15.49:6837","nonce":2249656343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2651218421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2651218421},{"type":"v1","addr":"172.21.15.18:6834","nonce":2651218421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:10:42.833958+0000","modified":"2024-09-21T07:10:45.793498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2785506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2785506081},{"type":"v1","addr":"172.21.15.18:6835","nonce":2785506081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":1}]} 2024-09-21T07:10:56.745 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2024-09-21T07:10:56.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.744+0000 7f8423c30640 1 -- 172.21.15.18:0/1843352550 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8400078bc0 msgr2=0x7f840007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.744+0000 7f8423c30640 1 --2- 172.21.15.18:0/1843352550 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8400078bc0 0x7f840007b0d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8418004630 tx=0x7f841800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.744+0000 7f8423c30640 1 -- 172.21.15.18:0/1843352550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c0d3580 msgr2=0x7f841c0abca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.744+0000 7f8423c30640 1 --2- 172.21.15.18:0/1843352550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c0d3580 0x7f841c0abca0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f840c00d610 tx=0x7f840c00dad0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.744+0000 7f8423c30640 1 -- 172.21.15.18:0/1843352550 shutdown_connections 2024-09-21T07:10:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.744+0000 7f8423c30640 1 --2- 172.21.15.18:0/1843352550 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8400078bc0 0x7f840007b0d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.744+0000 7f8423c30640 1 --2- 172.21.15.18:0/1843352550 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f841c15ef50 0x7f841c0cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.744+0000 7f8423c30640 1 --2- 172.21.15.18:0/1843352550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c0d3580 0x7f841c0abca0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.744+0000 7f8423c30640 1 --2- 172.21.15.18:0/1843352550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f841c0cef70 0x7f841c151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.744+0000 7f8423c30640 1 -- 172.21.15.18:0/1843352550 >> 172.21.15.18:0/1843352550 conn(0x7f841c073f30 msgr2=0x7f841c15bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.745+0000 7f8423c30640 1 -- 172.21.15.18:0/1843352550 shutdown_connections 2024-09-21T07:10:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.745+0000 7f8423c30640 1 -- 172.21.15.18:0/1843352550 wait complete. 2024-09-21T07:10:56.759 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:10:56.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.872+0000 7f9a64b07640 1 -- 172.21.15.18:0/3987580932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60162a40 msgr2=0x7f9a60162e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.872+0000 7f9a64b07640 1 --2- 172.21.15.18:0/3987580932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60162a40 0x7f9a60162e50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9a6006dd50 tx=0x7f9a5802a5f0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.872+0000 7f9a64b07640 1 -- 172.21.15.18:0/3987580932 shutdown_connections 2024-09-21T07:10:56.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.872+0000 7f9a64b07640 1 --2- 172.21.15.18:0/3987580932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60162a40 0x7f9a60162e50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.872+0000 7f9a64b07640 1 --2- 172.21.15.18:0/3987580932 >> v2:172.21.15.49:3300/0 conn(0x7f9a6015ef50 0x7f9a6015c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.872+0000 7f9a64b07640 1 -- 172.21.15.18:0/3987580932 >> 172.21.15.18:0/3987580932 conn(0x7f9a60073f30 msgr2=0x7f9a600b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:56.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.872+0000 7f9a64b07640 1 -- 172.21.15.18:0/3987580932 shutdown_connections 2024-09-21T07:10:56.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.872+0000 7f9a64b07640 1 -- 172.21.15.18:0/3987580932 wait complete. 2024-09-21T07:10:56.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.874+0000 7f9a64b07640 1 Processor -- start 2024-09-21T07:10:56.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.874+0000 7f9a64b07640 1 -- start start 2024-09-21T07:10:56.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.875+0000 7f9a64b07640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a600cef70 0x7f9a601f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.875+0000 7f9a64b07640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a6015ef50 0x7f9a600cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.875+0000 7f9a64b07640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9a60162a40 0x7f9a600b9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.875+0000 7f9a64b07640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9a600d11a0 con 0x7f9a6015ef50 2024-09-21T07:10:56.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.875+0000 7f9a64b07640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9a600d1020 con 0x7f9a600cef70 2024-09-21T07:10:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.875+0000 7f9a64b07640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f9a600d1320 con 0x7f9a60162a40 2024-09-21T07:10:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.875+0000 7f9a5dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a6015ef50 0x7f9a600cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.875+0000 7f9a5dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a6015ef50 0x7f9a600cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45754/0 (socket says 172.21.15.18:45754) 2024-09-21T07:10:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.876+0000 7f9a5dd9b640 1 -- 172.21.15.18:0/1797325950 learned_addr learned my addr 172.21.15.18:0/1797325950 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.876+0000 7f9a5e59c640 1 --2- 172.21.15.18:0/1797325950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a600cef70 0x7f9a601f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.876+0000 7f9a5ed9d640 1 --2- 172.21.15.18:0/1797325950 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9a60162a40 0x7f9a600b9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.876+0000 7f9a5dd9b640 1 -- 172.21.15.18:0/1797325950 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9a60162a40 msgr2=0x7f9a600b9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.876+0000 7f9a5dd9b640 1 --2- 172.21.15.18:0/1797325950 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9a60162a40 0x7f9a600b9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.876+0000 7f9a5dd9b640 1 -- 172.21.15.18:0/1797325950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a600cef70 msgr2=0x7f9a601f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.876+0000 7f9a5dd9b640 1 --2- 172.21.15.18:0/1797325950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a600cef70 0x7f9a601f5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.876+0000 7f9a5dd9b640 1 -- 172.21.15.18:0/1797325950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a601f6860 con 0x7f9a6015ef50 2024-09-21T07:10:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.876+0000 7f9a5dd9b640 1 --2- 172.21.15.18:0/1797325950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a6015ef50 0x7f9a600cdf90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800c3c0 tx=0x7f9a4800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.876+0000 7f9a56ffd640 1 -- 172.21.15.18:0/1797325950 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a48017070 con 0x7f9a6015ef50 2024-09-21T07:10:56.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.876+0000 7f9a56ffd640 1 -- 172.21.15.18:0/1797325950 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a480053c0 con 0x7f9a6015ef50 2024-09-21T07:10:56.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.876+0000 7f9a56ffd640 1 -- 172.21.15.18:0/1797325950 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a48003850 con 0x7f9a6015ef50 2024-09-21T07:10:56.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.876+0000 7f9a64b07640 1 -- 172.21.15.18:0/1797325950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a601f6b40 con 0x7f9a6015ef50 2024-09-21T07:10:56.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.876+0000 7f9a64b07640 1 -- 172.21.15.18:0/1797325950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a601f7100 con 0x7f9a6015ef50 2024-09-21T07:10:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.877+0000 7f9a64b07640 1 -- 172.21.15.18:0/1797325950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a600d17d0 con 0x7f9a6015ef50 2024-09-21T07:10:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.878+0000 7f9a56ffd640 1 -- 172.21.15.18:0/1797325950 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a4801a070 con 0x7f9a6015ef50 2024-09-21T07:10:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.879+0000 7f9a56ffd640 1 --2- 172.21.15.18:0/1797325950 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9a40078b90 0x7f9a4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.879+0000 7f9a56ffd640 1 -- 172.21.15.18:0/1797325950 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9a4809a050 con 0x7f9a6015ef50 2024-09-21T07:10:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.879+0000 7f9a5e59c640 1 --2- 172.21.15.18:0/1797325950 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9a40078b90 0x7f9a4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:56.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.879+0000 7f9a5e59c640 1 --2- 172.21.15.18:0/1797325950 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9a40078b90 0x7f9a4007b0a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a50005fd0 tx=0x7f9a50009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:56.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:56.883+0000 7f9a56ffd640 1 -- 172.21.15.18:0/1797325950 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9a48062490 con 0x7f9a6015ef50 2024-09-21T07:10:57.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.073+0000 7f9a64b07640 1 -- 172.21.15.18:0/1797325950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a600cf8a0 con 0x7f9a6015ef50 2024-09-21T07:10:57.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.074+0000 7f9a56ffd640 1 -- 172.21.15.18:0/1797325950 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f9a48061d90 con 0x7f9a6015ef50 2024-09-21T07:10:57.077 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:57.077 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:10:44.397635+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:40.463042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:41.734661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:10:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.077+0000 7f9a64b07640 1 -- 172.21.15.18:0/1797325950 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9a40078b90 msgr2=0x7f9a4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.077+0000 7f9a64b07640 1 --2- 172.21.15.18:0/1797325950 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9a40078b90 0x7f9a4007b0a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a50005fd0 tx=0x7f9a50009500 comp rx=0 tx=0).stop 2024-09-21T07:10:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.077+0000 7f9a64b07640 1 -- 172.21.15.18:0/1797325950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a6015ef50 msgr2=0x7f9a600cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.077+0000 7f9a64b07640 1 --2- 172.21.15.18:0/1797325950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a6015ef50 0x7f9a600cdf90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800c3c0 tx=0x7f9a4800c880 comp rx=0 tx=0).stop 2024-09-21T07:10:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.077+0000 7f9a64b07640 1 -- 172.21.15.18:0/1797325950 shutdown_connections 2024-09-21T07:10:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.077+0000 7f9a64b07640 1 --2- 172.21.15.18:0/1797325950 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9a40078b90 0x7f9a4007b0a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.077+0000 7f9a64b07640 1 --2- 172.21.15.18:0/1797325950 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f9a60162a40 0x7f9a600b9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.077+0000 7f9a64b07640 1 --2- 172.21.15.18:0/1797325950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a6015ef50 0x7f9a600cdf90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.077+0000 7f9a64b07640 1 --2- 172.21.15.18:0/1797325950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a600cef70 0x7f9a601f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.077+0000 7f9a64b07640 1 -- 172.21.15.18:0/1797325950 >> 172.21.15.18:0/1797325950 conn(0x7f9a60073f30 msgr2=0x7f9a6015ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.077+0000 7f9a64b07640 1 -- 172.21.15.18:0/1797325950 shutdown_connections 2024-09-21T07:10:57.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.077+0000 7f9a64b07640 1 -- 172.21.15.18:0/1797325950 wait complete. 2024-09-21T07:10:57.091 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:10:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.205+0000 7ff0459a1640 1 -- 172.21.15.18:0/2037936756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff04015ef50 msgr2=0x7ff04015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.205+0000 7ff0459a1640 1 --2- 172.21.15.18:0/2037936756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff04015ef50 0x7ff04015c520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff030005fd0 tx=0x7ff03002a8b0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.205+0000 7ff0459a1640 1 -- 172.21.15.18:0/2037936756 shutdown_connections 2024-09-21T07:10:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.205+0000 7ff0459a1640 1 --2- 172.21.15.18:0/2037936756 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff0400cef70 0x7ff0400d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.205+0000 7ff0459a1640 1 --2- 172.21.15.18:0/2037936756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff04015ef50 0x7ff04015c520 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.205+0000 7ff0459a1640 1 -- 172.21.15.18:0/2037936756 >> 172.21.15.18:0/2037936756 conn(0x7ff040073f30 msgr2=0x7ff0400b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:57.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.205+0000 7ff0459a1640 1 -- 172.21.15.18:0/2037936756 shutdown_connections 2024-09-21T07:10:57.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.205+0000 7ff0459a1640 1 -- 172.21.15.18:0/2037936756 wait complete. 2024-09-21T07:10:57.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.207+0000 7ff0459a1640 1 Processor -- start 2024-09-21T07:10:57.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.207+0000 7ff0459a1640 1 -- start start 2024-09-21T07:10:57.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.208+0000 7ff0459a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0400cef70 0x7ff0400ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:57.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.208+0000 7ff0459a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0400d3580 0x7ff0400ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:57.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.208+0000 7ff0459a1640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff04015ef50 0x7ff0401f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.208+0000 7ff0459a1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0400d11a0 con 0x7ff0400d3580 2024-09-21T07:10:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.208+0000 7ff0459a1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff0400d1020 con 0x7ff0400cef70 2024-09-21T07:10:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.208+0000 7ff0459a1640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7ff0400d1320 con 0x7ff04015ef50 2024-09-21T07:10:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.208+0000 7ff03e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0400d3580 0x7ff0400ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.208+0000 7ff03e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0400d3580 0x7ff0400ac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45764/0 (socket says 172.21.15.18:45764) 2024-09-21T07:10:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.208+0000 7ff03e7fc640 1 -- 172.21.15.18:0/1710258099 learned_addr learned my addr 172.21.15.18:0/1710258099 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.209+0000 7ff03effd640 1 --2- 172.21.15.18:0/1710258099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0400cef70 0x7ff0400ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.209+0000 7ff03f7fe640 1 --2- 172.21.15.18:0/1710258099 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff04015ef50 0x7ff0401f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.209+0000 7ff03e7fc640 1 -- 172.21.15.18:0/1710258099 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff04015ef50 msgr2=0x7ff0401f63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.209+0000 7ff03e7fc640 1 --2- 172.21.15.18:0/1710258099 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff04015ef50 0x7ff0401f63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.209+0000 7ff03e7fc640 1 -- 172.21.15.18:0/1710258099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0400cef70 msgr2=0x7ff0400ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.209+0000 7ff03e7fc640 1 --2- 172.21.15.18:0/1710258099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0400cef70 0x7ff0400ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.209+0000 7ff03e7fc640 1 -- 172.21.15.18:0/1710258099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0400ab950 con 0x7ff0400d3580 2024-09-21T07:10:57.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.209+0000 7ff03e7fc640 1 --2- 172.21.15.18:0/1710258099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0400d3580 0x7ff0400ac9f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff02800d6a0 tx=0x7ff02800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:57.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.209+0000 7ff037fff640 1 -- 172.21.15.18:0/1710258099 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028017070 con 0x7ff0400d3580 2024-09-21T07:10:57.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.209+0000 7ff037fff640 1 -- 172.21.15.18:0/1710258099 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff028009b10 con 0x7ff0400d3580 2024-09-21T07:10:57.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.209+0000 7ff0459a1640 1 -- 172.21.15.18:0/1710258099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0400abc30 con 0x7ff0400d3580 2024-09-21T07:10:57.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.209+0000 7ff037fff640 1 -- 172.21.15.18:0/1710258099 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028010460 con 0x7ff0400d3580 2024-09-21T07:10:57.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.209+0000 7ff0459a1640 1 -- 172.21.15.18:0/1710258099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0400ac1f0 con 0x7ff0400d3580 2024-09-21T07:10:57.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.210+0000 7ff0459a1640 1 -- 172.21.15.18:0/1710258099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0400d17d0 con 0x7ff0400d3580 2024-09-21T07:10:57.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.211+0000 7ff037fff640 1 -- 172.21.15.18:0/1710258099 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff02801a070 con 0x7ff0400d3580 2024-09-21T07:10:57.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.211+0000 7ff037fff640 1 --2- 172.21.15.18:0/1710258099 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff020078b90 0x7ff02007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:57.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.211+0000 7ff037fff640 1 -- 172.21.15.18:0/1710258099 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff02809add0 con 0x7ff0400d3580 2024-09-21T07:10:57.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.212+0000 7ff03effd640 1 --2- 172.21.15.18:0/1710258099 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff020078b90 0x7ff02007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:57.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.212+0000 7ff03effd640 1 --2- 172.21.15.18:0/1710258099 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff020078b90 0x7ff02007b0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff030034000 tx=0x7ff030004ab0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:57.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.216+0000 7ff037fff640 1 -- 172.21.15.18:0/1710258099 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff028062bb0 con 0x7ff0400d3580 2024-09-21T07:10:57.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.445+0000 7ff0459a1640 1 -- 172.21.15.18:0/1710258099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff040069870 con 0x7ff0400d3580 2024-09-21T07:10:57.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.445+0000 7ff037fff640 1 -- 172.21.15.18:0/1710258099 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5214 (secure 0 0 0) 0x7ff0280675e0 con 0x7ff0400d3580 2024-09-21T07:10:57.448 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:10:57.449 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"btime":"2024-09-21T07:10:46:409212+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/760501489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":760501489},{"type":"v1","addr":"172.21.15.49:6835","nonce":760501489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2249656343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2249656343},{"type":"v1","addr":"172.21.15.49:6837","nonce":2249656343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2651218421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2651218421},{"type":"v1","addr":"172.21.15.18:6834","nonce":2651218421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:10:42.833958+0000","modified":"2024-09-21T07:10:45.793498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2785506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2785506081},{"type":"v1","addr":"172.21.15.18:6835","nonce":2785506081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":1}]} 2024-09-21T07:10:57.449 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2024-09-21T07:10:57.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.448+0000 7ff0459a1640 1 -- 172.21.15.18:0/1710258099 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff020078b90 msgr2=0x7ff02007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:57.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.448+0000 7ff0459a1640 1 --2- 172.21.15.18:0/1710258099 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff020078b90 0x7ff02007b0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff030034000 tx=0x7ff030004ab0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.448+0000 7ff0459a1640 1 -- 172.21.15.18:0/1710258099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0400d3580 msgr2=0x7ff0400ac9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:57.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.448+0000 7ff0459a1640 1 --2- 172.21.15.18:0/1710258099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0400d3580 0x7ff0400ac9f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff02800d6a0 tx=0x7ff02800db60 comp rx=0 tx=0).stop 2024-09-21T07:10:57.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.448+0000 7ff0459a1640 1 -- 172.21.15.18:0/1710258099 shutdown_connections 2024-09-21T07:10:57.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.448+0000 7ff0459a1640 1 --2- 172.21.15.18:0/1710258099 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff020078b90 0x7ff02007b0a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.448+0000 7ff0459a1640 1 --2- 172.21.15.18:0/1710258099 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff04015ef50 0x7ff0401f63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.448+0000 7ff0459a1640 1 --2- 172.21.15.18:0/1710258099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0400d3580 0x7ff0400ac9f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.448+0000 7ff0459a1640 1 --2- 172.21.15.18:0/1710258099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0400cef70 0x7ff0400ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.448+0000 7ff0459a1640 1 -- 172.21.15.18:0/1710258099 >> 172.21.15.18:0/1710258099 conn(0x7ff040073f30 msgr2=0x7ff0400b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:57.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.448+0000 7ff0459a1640 1 -- 172.21.15.18:0/1710258099 shutdown_connections 2024-09-21T07:10:57.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.448+0000 7ff0459a1640 1 -- 172.21.15.18:0/1710258099 wait complete. 2024-09-21T07:10:57.864 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:10:42.833958+0000', 'modified': '2024-09-21T07:10:45.793498+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4395}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4395': {'gid': 4395, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.18:6835/2785506081', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6833', 'nonce': 2785506081}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 2785506081}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4395, 'qdb_cluster': [4395]} 2024-09-21T07:10:57.865 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:10:57.865 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T07:10:57.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.984+0000 7f28f4020640 1 -- 172.21.15.18:0/1838585043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28ec1627c0 msgr2=0x7f28ec162bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:57.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.984+0000 7f28f4020640 1 --2- 172.21.15.18:0/1838585043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28ec1627c0 0x7f28ec162bd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009830 tx=0x7f28e002a510 comp rx=0 tx=0).stop 2024-09-21T07:10:57.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.984+0000 7f28f4020640 1 -- 172.21.15.18:0/1838585043 shutdown_connections 2024-09-21T07:10:57.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.984+0000 7f28f4020640 1 --2- 172.21.15.18:0/1838585043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28ec1627c0 0x7f28ec162bd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.984+0000 7f28f4020640 1 --2- 172.21.15.18:0/1838585043 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f28ec0d1f60 0x7f28ec06def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.984+0000 7f28f4020640 1 -- 172.21.15.18:0/1838585043 >> 172.21.15.18:0/1838585043 conn(0x7f28ec0b78b0 msgr2=0x7f28ec0b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:57.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.984+0000 7f28f4020640 1 -- 172.21.15.18:0/1838585043 shutdown_connections 2024-09-21T07:10:57.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.984+0000 7f28f4020640 1 -- 172.21.15.18:0/1838585043 wait complete. 2024-09-21T07:10:57.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.986+0000 7f28f4020640 1 Processor -- start 2024-09-21T07:10:57.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.986+0000 7f28f4020640 1 -- start start 2024-09-21T07:10:57.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.987+0000 7f28f4020640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28ec0af330 0x7f28ec0d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:57.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f4020640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f28ec0d1f60 0x7f28ec09d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f4020640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28ec1627c0 0x7f28ec09dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f4020640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec155ad0 con 0x7f28ec1627c0 2024-09-21T07:10:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f4020640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec155950 con 0x7f28ec0af330 2024-09-21T07:10:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f4020640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f28ec155c50 con 0x7f28ec0d1f60 2024-09-21T07:10:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f25bd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28ec1627c0 0x7f28ec09dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f25bd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28ec1627c0 0x7f28ec09dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45780/0 (socket says 172.21.15.18:45780) 2024-09-21T07:10:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f25bd640 1 -- 172.21.15.18:0/2192489351 learned_addr learned my addr 172.21.15.18:0/2192489351 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f1dbc640 1 --2- 172.21.15.18:0/2192489351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28ec0af330 0x7f28ec0d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f15bb640 1 --2- 172.21.15.18:0/2192489351 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f28ec0d1f60 0x7f28ec09d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f25bd640 1 -- 172.21.15.18:0/2192489351 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f28ec0d1f60 msgr2=0x7f28ec09d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f25bd640 1 --2- 172.21.15.18:0/2192489351 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f28ec0d1f60 0x7f28ec09d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f25bd640 1 -- 172.21.15.18:0/2192489351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28ec0af330 msgr2=0x7f28ec0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f25bd640 1 --2- 172.21.15.18:0/2192489351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28ec0af330 0x7f28ec0d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f25bd640 1 -- 172.21.15.18:0/2192489351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ec0d1800 con 0x7f28ec1627c0 2024-09-21T07:10:57.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28f25bd640 1 --2- 172.21.15.18:0/2192489351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28ec1627c0 0x7f28ec09dc80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00c7b0 tx=0x7f28dc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:57.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28ea7fc640 1 -- 172.21.15.18:0/2192489351 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc003b70 con 0x7f28ec1627c0 2024-09-21T07:10:57.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.988+0000 7f28ea7fc640 1 -- 172.21.15.18:0/2192489351 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28dc003d10 con 0x7f28ec1627c0 2024-09-21T07:10:57.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.989+0000 7f28ea7fc640 1 -- 172.21.15.18:0/2192489351 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc0052d0 con 0x7f28ec1627c0 2024-09-21T07:10:57.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.989+0000 7f28f4020640 1 -- 172.21.15.18:0/2192489351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ec145b90 con 0x7f28ec1627c0 2024-09-21T07:10:57.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.989+0000 7f28f4020640 1 -- 172.21.15.18:0/2192489351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ec146150 con 0x7f28ec1627c0 2024-09-21T07:10:57.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.991+0000 7f28ea7fc640 1 -- 172.21.15.18:0/2192489351 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f28dc005470 con 0x7f28ec1627c0 2024-09-21T07:10:57.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.991+0000 7f28ea7fc640 1 --2- 172.21.15.18:0/2192489351 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f28d8078b90 0x7f28d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:57.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.992+0000 7f28ea7fc640 1 -- 172.21.15.18:0/2192489351 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f28dc09a8c0 con 0x7f28ec1627c0 2024-09-21T07:10:57.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.992+0000 7f28f1dbc640 1 --2- 172.21.15.18:0/2192489351 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f28d8078b90 0x7f28d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.992+0000 7f28fb067740 1 Processor -- start 2024-09-21T07:10:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.992+0000 7f28fb067740 1 -- start start 2024-09-21T07:10:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.992+0000 7f28f1dbc640 1 --2- 172.21.15.18:0/2192489351 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f28d8078b90 0x7f28d807b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009530 tx=0x7f28e4009260 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.993+0000 7f28fb067740 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x561675908fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.993+0000 7f28fb067740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56167550e3b0 0x5616759094e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.993+0000 7f28fb067740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x5616759263e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.993+0000 7f28fb067740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561675851820 con 0x561675516590 2024-09-21T07:10:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.993+0000 7f28fb067740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561675840c50 con 0x56167550e3b0 2024-09-21T07:10:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.993+0000 7f28fb067740 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x561675844a60 con 0x561675537270 2024-09-21T07:10:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.993+0000 7f28f25bd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x5616759263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.993+0000 7f28f25bd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x5616759263e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45796/0 (socket says 172.21.15.18:45796) 2024-09-21T07:10:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.993+0000 7f28f25bd640 1 -- 172.21.15.18:0/1395644849 learned_addr learned my addr 172.21.15.18:0/1395644849 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.994+0000 7f28f15bb640 1 --2- 172.21.15.18:0/1395644849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56167550e3b0 0x5616759094e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.994+0000 7f28f1dbc640 1 --2- 172.21.15.18:0/1395644849 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x561675908fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.994+0000 7f28f25bd640 1 -- 172.21.15.18:0/1395644849 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 msgr2=0x561675908fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:10:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.994+0000 7f28f25bd640 1 --2- 172.21.15.18:0/1395644849 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x561675908fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.994+0000 7f28f25bd640 1 -- 172.21.15.18:0/1395644849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56167550e3b0 msgr2=0x5616759094e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:10:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.994+0000 7f28f25bd640 1 --2- 172.21.15.18:0/1395644849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56167550e3b0 0x5616759094e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.994+0000 7f28f25bd640 1 -- 172.21.15.18:0/1395644849 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616755a2850 con 0x561675516590 2024-09-21T07:10:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.994+0000 7f28f25bd640 1 --2- 172.21.15.18:0/1395644849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x5616759263e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f28dc098e10 tx=0x7f28dc0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ce2f3c37c65b95 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.994+0000 7f28d37fe640 1 -- 172.21.15.18:0/1395644849 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc088020 con 0x561675516590 2024-09-21T07:10:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.994+0000 7f28d37fe640 1 -- 172.21.15.18:0/1395644849 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28dc067170 con 0x561675516590 2024-09-21T07:10:57.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.994+0000 7f28d37fe640 1 -- 172.21.15.18:0/1395644849 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc06c020 con 0x561675516590 2024-09-21T07:10:58.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.995+0000 7f28fb067740 1 -- 172.21.15.18:0/1395644849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 msgr2=0x5616759263e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:58.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.995+0000 7f28fb067740 1 --2- 172.21.15.18:0/1395644849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x5616759263e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f28dc098e10 tx=0x7f28dc0016d0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.995+0000 7f28fb067740 1 -- 172.21.15.18:0/1395644849 shutdown_connections 2024-09-21T07:10:58.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.995+0000 7f28fb067740 1 --2- 172.21.15.18:0/1395644849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x5616759263e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.995+0000 7f28fb067740 1 --2- 172.21.15.18:0/1395644849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56167550e3b0 0x5616759094e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.995+0000 7f28fb067740 1 --2- 172.21.15.18:0/1395644849 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x561675908fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.995+0000 7f28fb067740 1 -- 172.21.15.18:0/1395644849 >> 172.21.15.18:0/1395644849 conn(0x56167552b3c0 msgr2=0x5616758df260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.995+0000 7f28fb067740 1 -- 172.21.15.18:0/1395644849 shutdown_connections 2024-09-21T07:10:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.995+0000 7f28fb067740 1 -- 172.21.15.18:0/1395644849 wait complete. 2024-09-21T07:10:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.996+0000 7f28fb067740 1 -- start start 2024-09-21T07:10:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.996+0000 7f28fb067740 1 Processor -- start 2024-09-21T07:10:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.997+0000 7f28fb067740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56167550e3b0 0x561675936d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.997+0000 7f28fb067740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x5616758f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.997+0000 7f28fb067740 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x561675907e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.997+0000 7f28fb067740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5616755b1620 con 0x561675516590 2024-09-21T07:10:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.997+0000 7f28fb067740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5616757e65f0 con 0x56167550e3b0 2024-09-21T07:10:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.997+0000 7f28fb067740 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x561675909a20 con 0x561675537270 2024-09-21T07:10:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.997+0000 7f28fb067740 10 client.0 _ll_register_callbacks cb 0x5616757ea0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:10:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28f15bb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x5616758f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28f15bb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x5616758f71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45800/0 (socket says 172.21.15.18:45800) 2024-09-21T07:10:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28f15bb640 1 -- 172.21.15.18:0/2764397407 learned_addr learned my addr 172.21.15.18:0/2764397407 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28f25bd640 1 --2- 172.21.15.18:0/2764397407 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x561675907e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28f1dbc640 1 --2- 172.21.15.18:0/2764397407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56167550e3b0 0x561675936d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28f15bb640 1 -- 172.21.15.18:0/2764397407 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 msgr2=0x561675907e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:10:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28f15bb640 1 --2- 172.21.15.18:0/2764397407 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x561675907e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28f15bb640 1 -- 172.21.15.18:0/2764397407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56167550e3b0 msgr2=0x561675936d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:10:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28f15bb640 1 --2- 172.21.15.18:0/2764397407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56167550e3b0 0x561675936d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28f15bb640 1 -- 172.21.15.18:0/2764397407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616756196b0 con 0x561675516590 2024-09-21T07:10:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28f15bb640 1 --2- 172.21.15.18:0/2764397407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x5616758f71b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009950 tx=0x7f28e00045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddebbef5c90b1ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-21T07:10:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28d0ff9640 1 -- 172.21.15.18:0/2764397407 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e00039c0 con 0x561675516590 2024-09-21T07:10:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28d0ff9640 1 -- 172.21.15.18:0/2764397407 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f28e0003b60 con 0x561675516590 2024-09-21T07:10:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28fb067740 1 -- 172.21.15.18:0/2764397407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28dc067170 con 0x561675516590 2024-09-21T07:10:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28d0ff9640 1 -- 172.21.15.18:0/2764397407 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f28e0003d60 con 0x561675516590 2024-09-21T07:10:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28fb067740 10 client.4695 fetch_fsmap learned FSMap version 8 2024-09-21T07:10:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.998+0000 7f28fb067740 1 -- 172.21.15.18:0/2764397407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5616758f7840 con 0x561675516590 2024-09-21T07:10:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.999+0000 7f28d0ff9640 1 -- 172.21.15.18:0/2764397407 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28dc067170 con 0x561675516590 2024-09-21T07:10:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.999+0000 7f28d0ff9640 1 -- 172.21.15.18:0/2764397407 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f28e0005020 con 0x561675516590 2024-09-21T07:10:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.999+0000 7f28fb067740 10 client.4695 fetch_fsmap finished waiting for FSMap version 8 2024-09-21T07:10:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.999+0000 7f28fb067740 10 client.4695 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:10:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.999+0000 7f28fb067740 20 client.4695 populate_metadata read hostname 'smithi018' 2024-09-21T07:10:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.999+0000 7f28fb067740 1 --2- 172.21.15.18:0/2764397407 >> [v2:172.21.15.18:6833/2785506081,v1:172.21.15.18:6835/2785506081] conn(0x5616754f5e40 0x56167591ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.999+0000 7f28fb067740 4 client.4695 mds_command: new command op to 4395 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:10:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.999+0000 7f28fb067740 1 -- 172.21.15.18:0/2764397407 --> [v2:172.21.15.18:6833/2785506081,v1:172.21.15.18:6835/2785506081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561675853770 con 0x5616754f5e40 2024-09-21T07:10:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.999+0000 7f28f1dbc640 1 --2- 172.21.15.18:0/2764397407 >> [v2:172.21.15.18:6833/2785506081,v1:172.21.15.18:6835/2785506081] conn(0x5616754f5e40 0x56167591ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.999+0000 7f28f1dbc640 1 --2- 172.21.15.18:0/2764397407 >> [v2:172.21.15.18:6833/2785506081,v1:172.21.15.18:6835/2785506081] conn(0x5616754f5e40 0x56167591ab90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3bbf72c03d4b274 server_cookie=6d9aa926d34592f2 in_seq=0 out_seq=0 2024-09-21T07:10:58.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:57.999+0000 7f28d0ff9640 10 client.4695 ms_handle_connect on v2:172.21.15.18:6833/2785506081 2024-09-21T07:10:58.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.000+0000 7f28d0ff9640 1 -- 172.21.15.18:0/2764397407 <== mds.0 v2:172.21.15.18:6833/2785506081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561675853770 con 0x5616754f5e40 2024-09-21T07:10:58.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.000+0000 7f28d0ff9640 10 client.4695 handle_command_reply: tid=0 2024-09-21T07:10:58.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.000+0000 7f28fb067740 1 client.4695 shutdown 2024-09-21T07:10:58.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.000+0000 7f28fb067740 1 -- 172.21.15.18:0/2764397407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 msgr2=0x5616758f71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:58.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.000+0000 7f28fb067740 1 --2- 172.21.15.18:0/2764397407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x5616758f71b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009950 tx=0x7f28e00045d0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.000+0000 7f28fb067740 1 -- 172.21.15.18:0/2764397407 shutdown_connections 2024-09-21T07:10:58.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.000+0000 7f28fb067740 1 --2- 172.21.15.18:0/2764397407 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x561675907e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.000+0000 7f28fb067740 1 --2- 172.21.15.18:0/2764397407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x5616758f71b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.000+0000 7f28fb067740 1 --2- 172.21.15.18:0/2764397407 >> [v2:172.21.15.18:6833/2785506081,v1:172.21.15.18:6835/2785506081] conn(0x5616754f5e40 0x56167591ab90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.000+0000 7f28fb067740 1 --2- 172.21.15.18:0/2764397407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56167550e3b0 0x561675936d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.000+0000 7f28d0ff9640 0 client.4695 ms_handle_reset on v2:172.21.15.18:6833/2785506081 2024-09-21T07:10:58.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.000+0000 7f28fb067740 1 -- 172.21.15.18:0/2764397407 >> 172.21.15.18:0/2764397407 conn(0x56167552b3c0 msgr2=0x5616758df110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:58.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.000+0000 7f28fb067740 1 -- 172.21.15.18:0/2764397407 shutdown_connections 2024-09-21T07:10:58.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.000+0000 7f28fb067740 1 -- 172.21.15.18:0/2764397407 wait complete. 2024-09-21T07:10:58.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.000+0000 7f28fb067740 20 client.4695 trim_cache size 0 max 16384 2024-09-21T07:10:58.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.019+0000 7f28fb067740 1 Processor -- start 2024-09-21T07:10:58.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.019+0000 7f28fb067740 1 -- start start 2024-09-21T07:10:58.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.020+0000 7f28fb067740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56167550e3b0 0x56167591d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:58.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.020+0000 7f28fb067740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x56167591dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:58.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.020+0000 7f28fb067740 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x561675905b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:58.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.020+0000 7f28fb067740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec147e00 con 0x561675516590 2024-09-21T07:10:58.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.020+0000 7f28fb067740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1f9ec0 con 0x56167550e3b0 2024-09-21T07:10:58.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.020+0000 7f28fb067740 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f28ec1477b0 con 0x561675537270 2024-09-21T07:10:58.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.021+0000 7f28f15bb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x56167591dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:58.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.021+0000 7f28f15bb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x56167591dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45816/0 (socket says 172.21.15.18:45816) 2024-09-21T07:10:58.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.021+0000 7f28f15bb640 1 -- 172.21.15.18:0/1948590847 learned_addr learned my addr 172.21.15.18:0/1948590847 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:58.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.021+0000 7f28f15bb640 1 -- 172.21.15.18:0/1948590847 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 msgr2=0x561675905b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:10:58.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.021+0000 7f28f15bb640 1 --2- 172.21.15.18:0/1948590847 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x561675905b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.021+0000 7f28f15bb640 1 -- 172.21.15.18:0/1948590847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56167550e3b0 msgr2=0x56167591d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:10:58.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.021+0000 7f28f15bb640 1 --2- 172.21.15.18:0/1948590847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56167550e3b0 0x56167591d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.021+0000 7f28f15bb640 1 -- 172.21.15.18:0/1948590847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561675926bb0 con 0x561675516590 2024-09-21T07:10:58.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.021+0000 7f28f15bb640 1 --2- 172.21.15.18:0/1948590847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x56167591dd10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009780 tx=0x7f28e0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f558154afe5f567a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:58.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.021+0000 7f28d2ffd640 1 -- 172.21.15.18:0/1948590847 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e00039c0 con 0x561675516590 2024-09-21T07:10:58.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.021+0000 7f28d2ffd640 1 -- 172.21.15.18:0/1948590847 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28e0046470 con 0x561675516590 2024-09-21T07:10:58.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.021+0000 7f28d2ffd640 1 -- 172.21.15.18:0/1948590847 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e00468a0 con 0x561675516590 2024-09-21T07:10:58.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.022+0000 7f28fb067740 1 -- 172.21.15.18:0/1948590847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 msgr2=0x56167591dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:58.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.022+0000 7f28fb067740 1 --2- 172.21.15.18:0/1948590847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x56167591dd10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009780 tx=0x7f28e0005fd0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.022+0000 7f28fb067740 1 -- 172.21.15.18:0/1948590847 shutdown_connections 2024-09-21T07:10:58.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.022+0000 7f28fb067740 1 --2- 172.21.15.18:0/1948590847 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x561675905b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.022+0000 7f28fb067740 1 --2- 172.21.15.18:0/1948590847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561675516590 0x56167591dd10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.022+0000 7f28fb067740 1 --2- 172.21.15.18:0/1948590847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56167550e3b0 0x56167591d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.022+0000 7f28fb067740 1 -- 172.21.15.18:0/1948590847 >> 172.21.15.18:0/1948590847 conn(0x56167552b3c0 msgr2=0x5616758d4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:58.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.022+0000 7f28fb067740 1 -- 172.21.15.18:0/1948590847 shutdown_connections 2024-09-21T07:10:58.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.022+0000 7f28fb067740 1 -- 172.21.15.18:0/1948590847 wait complete. 2024-09-21T07:10:58.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.023+0000 7f28fb067740 1 -- start start 2024-09-21T07:10:58.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.023+0000 7f28fb067740 1 Processor -- start 2024-09-21T07:10:58.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.024+0000 7f28fb067740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167550e3b0 0x561675927870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:58.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.024+0000 7f28fb067740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561675516590 0x56167591d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:58.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.024+0000 7f28fb067740 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x56167591dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:58.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.024+0000 7f28fb067740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5616759084b0 con 0x56167550e3b0 2024-09-21T07:10:58.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.024+0000 7f28fb067740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5616759013d0 con 0x561675516590 2024-09-21T07:10:58.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.024+0000 7f28fb067740 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x56167591cb40 con 0x561675537270 2024-09-21T07:10:58.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.024+0000 7f28fb067740 10 client.0 _ll_register_callbacks cb 0x7f28e00096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:10:58.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28f1dbc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167550e3b0 0x561675927870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:58.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28f1dbc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167550e3b0 0x561675927870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45818/0 (socket says 172.21.15.18:45818) 2024-09-21T07:10:58.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28f1dbc640 1 -- 172.21.15.18:0/563751076 learned_addr learned my addr 172.21.15.18:0/563751076 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:58.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28f15bb640 1 --2- 172.21.15.18:0/563751076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561675516590 0x56167591d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:58.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28f25bd640 1 --2- 172.21.15.18:0/563751076 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x56167591dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:58.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28f1dbc640 1 -- 172.21.15.18:0/563751076 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 msgr2=0x56167591dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:10:58.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28f1dbc640 1 --2- 172.21.15.18:0/563751076 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x56167591dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28f1dbc640 1 -- 172.21.15.18:0/563751076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561675516590 msgr2=0x56167591d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:10:58.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28f1dbc640 1 --2- 172.21.15.18:0/563751076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561675516590 0x56167591d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28f1dbc640 1 -- 172.21.15.18:0/563751076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561675927390 con 0x56167550e3b0 2024-09-21T07:10:58.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28f15bb640 1 --2- 172.21.15.18:0/563751076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561675516590 0x56167591d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:58.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28f25bd640 1 --2- 172.21.15.18:0/563751076 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x56167591dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:10:58.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28f1dbc640 1 --2- 172.21.15.18:0/563751076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167550e3b0 0x561675927870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f28e4005fd0 tx=0x7f28e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25f95c7d94a1c81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:58.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-21T07:10:58.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28d0ff9640 1 -- 172.21.15.18:0/563751076 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e4036060 con 0x56167550e3b0 2024-09-21T07:10:58.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28d0ff9640 1 -- 172.21.15.18:0/563751076 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f28e402b640 con 0x56167550e3b0 2024-09-21T07:10:58.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28fb067740 1 -- 172.21.15.18:0/563751076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28e0046470 con 0x56167550e3b0 2024-09-21T07:10:58.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28d0ff9640 1 -- 172.21.15.18:0/563751076 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f28e403c050 con 0x56167550e3b0 2024-09-21T07:10:58.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28fb067740 10 client.4701 fetch_fsmap learned FSMap version 8 2024-09-21T07:10:58.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.025+0000 7f28fb067740 1 -- 172.21.15.18:0/563751076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x561675927db0 con 0x56167550e3b0 2024-09-21T07:10:58.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.026+0000 7f28d0ff9640 1 -- 172.21.15.18:0/563751076 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28e0046470 con 0x56167550e3b0 2024-09-21T07:10:58.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.026+0000 7f28d0ff9640 1 -- 172.21.15.18:0/563751076 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f28e403f020 con 0x56167550e3b0 2024-09-21T07:10:58.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.026+0000 7f28fb067740 10 client.4701 fetch_fsmap finished waiting for FSMap version 8 2024-09-21T07:10:58.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.026+0000 7f28fb067740 10 client.4701 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:10:58.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.026+0000 7f28fb067740 20 client.4701 populate_metadata read hostname 'smithi018' 2024-09-21T07:10:58.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.026+0000 7f28fb067740 1 --2- 172.21.15.18:0/563751076 >> [v2:172.21.15.18:6833/2785506081,v1:172.21.15.18:6835/2785506081] conn(0x561675902b30 0x5616759a6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:58.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.026+0000 7f28fb067740 4 client.4701 mds_command: new command op to 4395 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:10:58.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.026+0000 7f28fb067740 1 -- 172.21.15.18:0/563751076 --> [v2:172.21.15.18:6833/2785506081,v1:172.21.15.18:6835/2785506081] -- command(tid 0: {"prefix": "status"}) -- 0x56167584f220 con 0x561675902b30 2024-09-21T07:10:58.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.026+0000 7f28f15bb640 1 --2- 172.21.15.18:0/563751076 >> [v2:172.21.15.18:6833/2785506081,v1:172.21.15.18:6835/2785506081] conn(0x561675902b30 0x5616759a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:58.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.026+0000 7f28d0ff9640 10 client.4701 ms_handle_connect on v2:172.21.15.18:6833/2785506081 2024-09-21T07:10:58.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.026+0000 7f28f15bb640 1 --2- 172.21.15.18:0/563751076 >> [v2:172.21.15.18:6833/2785506081,v1:172.21.15.18:6835/2785506081] conn(0x561675902b30 0x5616759a6930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8be9c67292224fa8 server_cookie=213d0c2bd8e06c77 in_seq=0 out_seq=0 2024-09-21T07:10:58.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28d0ff9640 1 -- 172.21.15.18:0/563751076 <== mds.0 v2:172.21.15.18:6833/2785506081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x56167584f220 con 0x561675902b30 2024-09-21T07:10:58.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28d0ff9640 10 client.4701 handle_command_reply: tid=0 2024-09-21T07:10:58.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28fb067740 1 client.4701 shutdown 2024-09-21T07:10:58.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28fb067740 1 -- 172.21.15.18:0/563751076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167550e3b0 msgr2=0x561675927870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:58.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28fb067740 1 --2- 172.21.15.18:0/563751076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167550e3b0 0x561675927870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f28e4005fd0 tx=0x7f28e4004730 comp rx=0 tx=0).stop 2024-09-21T07:10:58.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28fb067740 1 -- 172.21.15.18:0/563751076 shutdown_connections 2024-09-21T07:10:58.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28fb067740 1 --2- 172.21.15.18:0/563751076 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x561675537270 0x56167591dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28fb067740 1 --2- 172.21.15.18:0/563751076 >> [v2:172.21.15.18:6833/2785506081,v1:172.21.15.18:6835/2785506081] conn(0x561675902b30 0x5616759a6930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28fb067740 1 --2- 172.21.15.18:0/563751076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561675516590 0x56167591d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28fb067740 1 --2- 172.21.15.18:0/563751076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56167550e3b0 0x561675927870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28d0ff9640 0 client.4701 ms_handle_reset on v2:172.21.15.18:6833/2785506081 2024-09-21T07:10:58.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28fb067740 1 -- 172.21.15.18:0/563751076 >> 172.21.15.18:0/563751076 conn(0x56167552b3c0 msgr2=0x5616758df0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:58.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28fb067740 1 -- 172.21.15.18:0/563751076 shutdown_connections 2024-09-21T07:10:58.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28fb067740 1 -- 172.21.15.18:0/563751076 wait complete. 2024-09-21T07:10:58.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28fb067740 20 client.4701 trim_cache size 0 max 16384 2024-09-21T07:10:58.035 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T07:10:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "ed917ec8-3fd9-4777-97f4-b5e2f57d6f41", 2024-09-21T07:10:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-21T07:10:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4395, 2024-09-21T07:10:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-21T07:10:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-21T07:10:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-21T07:10:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 14.641172843, 2024-09-21T07:10:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 8, 2024-09-21T07:10:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 21, 2024-09-21T07:10:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 21, 2024-09-21T07:10:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 20.892352874 2024-09-21T07:10:58.036 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T07:10:58.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28f4020640 1 -- 172.21.15.18:0/2192489351 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f28d8078b90 msgr2=0x7f28d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:58.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28f4020640 1 --2- 172.21.15.18:0/2192489351 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f28d8078b90 0x7f28d807b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009530 tx=0x7f28e4009260 comp rx=0 tx=0).stop 2024-09-21T07:10:58.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28f4020640 1 -- 172.21.15.18:0/2192489351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28ec1627c0 msgr2=0x7f28ec09dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:58.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.027+0000 7f28f4020640 1 --2- 172.21.15.18:0/2192489351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28ec1627c0 0x7f28ec09dc80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00c7b0 tx=0x7f28dc00cc70 comp rx=0 tx=0).stop 2024-09-21T07:10:58.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.028+0000 7f28f4020640 1 -- 172.21.15.18:0/2192489351 shutdown_connections 2024-09-21T07:10:58.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.028+0000 7f28f4020640 1 --2- 172.21.15.18:0/2192489351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28ec1627c0 0x7f28ec09dc80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.028+0000 7f28f4020640 1 --2- 172.21.15.18:0/2192489351 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f28d8078b90 0x7f28d807b0a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.028+0000 7f28f4020640 1 --2- 172.21.15.18:0/2192489351 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f28ec0d1f60 0x7f28ec09d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.028+0000 7f28f4020640 1 --2- 172.21.15.18:0/2192489351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28ec0af330 0x7f28ec0d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.028+0000 7f28f4020640 1 -- 172.21.15.18:0/2192489351 >> 172.21.15.18:0/2192489351 conn(0x7f28ec0b78b0 msgr2=0x7f28ec0b4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:58.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.028+0000 7f28f4020640 1 -- 172.21.15.18:0/2192489351 shutdown_connections 2024-09-21T07:10:58.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.028+0000 7f28f4020640 1 -- 172.21.15.18:0/2192489351 wait complete. 2024-09-21T07:10:58.041 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T07:10:58.064 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T07:10:58.064 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-21T07:10:58.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:10:58.064 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-21T07:10:58.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:10:58.080 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-21T07:10:58.148 INFO:teuthology.orchestra.run.smithi018.stderr:Cannot find device "ceph-brx" 2024-09-21T07:10:58.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:10:58.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:10:58.150 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-21T07:10:58.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:10:58.206 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-21T07:10:58.271 INFO:teuthology.orchestra.run.smithi018.stderr:Cannot find device "ceph-brx" 2024-09-21T07:10:58.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:10:58.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:10:58.273 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-09-21T07:10:58.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:10:58.293 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-09-21T07:10:58.366 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2024-09-21T07:10:58.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:10:58.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:10:58.368 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-09-21T07:10:58.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:10:58.426 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-09-21T07:10:58.495 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2024-09-21T07:10:58.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:10:58.496 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-21T07:10:58.496 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:10:58.497 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:10:58.497 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:10:58.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.611+0000 7fd17d52b640 1 -- 172.21.15.18:0/2832643083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd164004d40 msgr2=0x7fd1640051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:58.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.611+0000 7fd17d52b640 1 --2- 172.21.15.18:0/2832643083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd164004d40 0x7fd1640051f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd17000c310 tx=0x7fd164005830 comp rx=0 tx=0).stop 2024-09-21T07:10:58.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.611+0000 7fd1777fe640 1 -- 172.21.15.18:0/2832643083 reap_dead start 2024-09-21T07:10:58.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.611+0000 7fd17d52b640 1 -- 172.21.15.18:0/2832643083 shutdown_connections 2024-09-21T07:10:58.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.611+0000 7fd17d52b640 1 -- 172.21.15.18:0/2832643083 >> 172.21.15.18:0/2832643083 conn(0x7fd1780b1fe0 msgr2=0x7fd1780b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:58.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.611+0000 7fd17d52b640 1 -- 172.21.15.18:0/2832643083 shutdown_connections 2024-09-21T07:10:58.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.611+0000 7fd17d52b640 1 -- 172.21.15.18:0/2832643083 wait complete. 2024-09-21T07:10:58.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.613+0000 7fd17d52b640 1 Processor -- start 2024-09-21T07:10:58.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.613+0000 7fd17d52b640 1 -- start start 2024-09-21T07:10:58.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.614+0000 7fd17d52b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd164004d40 0x7fd1780cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:58.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.614+0000 7fd17d52b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd1781587f0 0x7fd17814f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:58.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.614+0000 7fd17d52b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1781f31c0 0x7fd1781f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:58.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.614+0000 7fd17d52b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd1780b3670 con 0x7fd1781f31c0 2024-09-21T07:10:58.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.614+0000 7fd17d52b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd1780b34f0 con 0x7fd164004d40 2024-09-21T07:10:58.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.614+0000 7fd17d52b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fd1780b37f0 con 0x7fd1781587f0 2024-09-21T07:10:58.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.614+0000 7fd1777fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1781f31c0 0x7fd1781f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:58.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.614+0000 7fd1767fc640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd1781587f0 0x7fd17814f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:58.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.614+0000 7fd1777fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1781f31c0 0x7fd1781f35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45836/0 (socket says 172.21.15.18:45836) 2024-09-21T07:10:58.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.614+0000 7fd1777fe640 1 -- 172.21.15.18:0/2420066504 learned_addr learned my addr 172.21.15.18:0/2420066504 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:10:58.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.614+0000 7fd176ffd640 1 --2- 172.21.15.18:0/2420066504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd164004d40 0x7fd1780cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:58.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.614+0000 7fd1777fe640 1 -- 172.21.15.18:0/2420066504 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd1781587f0 msgr2=0x7fd17814f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:58.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.614+0000 7fd1777fe640 1 --2- 172.21.15.18:0/2420066504 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd1781587f0 0x7fd17814f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.615+0000 7fd1777fe640 1 -- 172.21.15.18:0/2420066504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd164004d40 msgr2=0x7fd1780cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:58.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.615+0000 7fd1777fe640 1 --2- 172.21.15.18:0/2420066504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd164004d40 0x7fd1780cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.615+0000 7fd1777fe640 1 -- 172.21.15.18:0/2420066504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd178158c00 con 0x7fd1781f31c0 2024-09-21T07:10:58.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.615+0000 7fd1777fe640 1 --2- 172.21.15.18:0/2420066504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1781f31c0 0x7fd1781f35d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd17000c430 tx=0x7fd17002ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:58.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.615+0000 7fd16f7fe640 1 -- 172.21.15.18:0/2420066504 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd170031050 con 0x7fd1781f31c0 2024-09-21T07:10:58.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.615+0000 7fd16f7fe640 1 -- 172.21.15.18:0/2420066504 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd170006070 con 0x7fd1781f31c0 2024-09-21T07:10:58.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.615+0000 7fd17d52b640 1 -- 172.21.15.18:0/2420066504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd178157750 con 0x7fd1781f31c0 2024-09-21T07:10:58.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.615+0000 7fd16f7fe640 1 -- 172.21.15.18:0/2420066504 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd170006c90 con 0x7fd1781f31c0 2024-09-21T07:10:58.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.615+0000 7fd17d52b640 1 -- 172.21.15.18:0/2420066504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd178157d10 con 0x7fd1781f31c0 2024-09-21T07:10:58.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.616+0000 7fd17d52b640 1 -- 172.21.15.18:0/2420066504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1780b3d80 con 0x7fd1781f31c0 2024-09-21T07:10:58.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.617+0000 7fd16f7fe640 1 -- 172.21.15.18:0/2420066504 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd17003e030 con 0x7fd1781f31c0 2024-09-21T07:10:58.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.617+0000 7fd16f7fe640 1 --2- 172.21.15.18:0/2420066504 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd158078b90 0x7fd15807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:10:58.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.617+0000 7fd16f7fe640 1 -- 172.21.15.18:0/2420066504 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd1700ba760 con 0x7fd1781f31c0 2024-09-21T07:10:58.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.618+0000 7fd176ffd640 1 --2- 172.21.15.18:0/2420066504 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd158078b90 0x7fd15807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:10:58.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.618+0000 7fd176ffd640 1 --2- 172.21.15.18:0/2420066504 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd158078b90 0x7fd15807b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd168005fd0 tx=0x7fd168009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:10:58.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.622+0000 7fd16f7fe640 1 -- 172.21.15.18:0/2420066504 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd170006240 con 0x7fd1781f31c0 2024-09-21T07:10:58.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.850+0000 7fd17d52b640 1 -- 172.21.15.18:0/2420066504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd17806eda0 con 0x7fd1781f31c0 2024-09-21T07:10:58.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.850+0000 7fd16f7fe640 1 -- 172.21.15.18:0/2420066504 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fd1700825e0 con 0x7fd1781f31c0 2024-09-21T07:10:58.853 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:10:58.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.852+0000 7fd17d52b640 1 -- 172.21.15.18:0/2420066504 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd158078b90 msgr2=0x7fd15807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:58.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.852+0000 7fd17d52b640 1 --2- 172.21.15.18:0/2420066504 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd158078b90 0x7fd15807b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd168005fd0 tx=0x7fd168009500 comp rx=0 tx=0).stop 2024-09-21T07:10:58.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.853+0000 7fd17d52b640 1 -- 172.21.15.18:0/2420066504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1781f31c0 msgr2=0x7fd1781f35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:10:58.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.853+0000 7fd17d52b640 1 --2- 172.21.15.18:0/2420066504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1781f31c0 0x7fd1781f35d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd17000c430 tx=0x7fd17002ec60 comp rx=0 tx=0).stop 2024-09-21T07:10:58.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.853+0000 7fd17d52b640 1 -- 172.21.15.18:0/2420066504 shutdown_connections 2024-09-21T07:10:58.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.853+0000 7fd17d52b640 1 --2- 172.21.15.18:0/2420066504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1781f31c0 0x7fd1781f35d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.853+0000 7fd17d52b640 1 --2- 172.21.15.18:0/2420066504 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd158078b90 0x7fd15807b0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.853+0000 7fd17d52b640 1 --2- 172.21.15.18:0/2420066504 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd1781587f0 0x7fd17814f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.853+0000 7fd17d52b640 1 --2- 172.21.15.18:0/2420066504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd164004d40 0x7fd1780cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:10:58.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.853+0000 7fd17d52b640 1 -- 172.21.15.18:0/2420066504 >> 172.21.15.18:0/2420066504 conn(0x7fd1780b1fe0 msgr2=0x7fd17806e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:10:58.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.853+0000 7fd17d52b640 1 -- 172.21.15.18:0/2420066504 shutdown_connections 2024-09-21T07:10:58.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58.853+0000 7fd17d52b640 1 -- 172.21.15.18:0/2420066504 wait complete. 2024-09-21T07:10:58.866 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:10:58.867 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:10:58.867 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-21T07:10:58.867 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:10:58.867 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:10:58.867 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:10:58.867 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:10:58.867 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:10:58.867 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:10:58.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:10:58.867 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-21T07:10:58.883 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:10:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:10:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:10:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:10:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-21T07:10:58.883 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:10:58.884 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:10:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:10:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-21T07:10:58.884 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:10:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:10:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-21T07:10:58.884 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:10:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:10:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-21T07:10:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T07:10:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42697sec preferred_lft 42697sec 2024-09-21T07:10:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-21T07:10:58.884 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:10:58.884 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:10:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:10:58.885 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-21T07:10:58.885 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T07:10:58.885 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:10:58.885 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-21T07:10:58.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-09-21T07:10:58.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-09-21T07:10:58.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-09-21T07:10:58.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T07:10:58.886 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-21T07:10:58.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:10:59.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:10:59.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:10:59.096 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:10:59.122 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-21T07:10:59.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:10:59.124 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-21T07:10:59.188 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-21T07:10:59.188 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:10:59.188 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T07:10:59.188 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T07:10:59.188 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:10:59.188 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:10:59.188 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-21T07:10:59.189 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T07:10:59.189 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T07:10:59.189 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T07:10:59.189 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-21T07:10:59.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:10:59.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:10:59.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:10:59.486 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-21T07:10:59.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:10:59.503 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-09-21T07:10:59.559 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:10:59.559 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-21T07:10:59.559 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:10:59.559 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T07:10:59.559 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-21T07:10:59.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:10:59.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:10:59.684 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T07:10:59.684 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:10:59.684 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-21T07:10:59.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T07:10:59.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T07:10:59.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T07:10:59.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T07:10:59.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T07:10:59.684 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-21T07:10:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:10:59.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:10:59.816 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:10:59.816 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-21T07:10:59.816 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-21T07:10:59.816 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T07:10:59.816 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-21T07:10:59.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:10:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:10:59.897 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:10:59.897 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:10:59.913 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:10:59.913 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:10:59.913 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:10:59.968 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:10:59.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:10:59.969 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:00.074 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:00.074 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:11:00.211 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:00.211 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:11:00.211 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.49:3300,172.21.15.49:3301" 2024-09-21T07:11:00.211 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@ed917ec8-3fd9-4777-97f4-b5e2f57d6f41.cephfs=/ 2024-09-21T07:11:00.211 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.49:3300/172.21.15.49:3301" will pass to kernel 2024-09-21T07:11:00.211 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T07:11:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-21T07:11:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T07:11:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T07:11:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T07:11:00.214 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:11:00.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:00.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:11:00.240 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:11:00.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:00.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:00.345 INFO:teuthology.orchestra.run.smithi018.stdout:client4636 2024-09-21T07:11:00.346 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:11:00.346 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:00.362 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:11:00.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:00.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:00.466 INFO:teuthology.orchestra.run.smithi018.stdout:client4636 2024-09-21T07:11:00.466 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:11:00.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:00.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:00.528 INFO:teuthology.orchestra.run.smithi018.stdout:client4636 2024-09-21T07:11:00.528 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/ed917ec8-3fd9-4777-97f4-b5e2f57d6f41.client4636/status') 2024-09-21T07:11:00.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:00.592 INFO:teuthology.orchestra.run.smithi018.stdout:instance: client.4636 (3)172.21.15.18:0/1230048173 2024-09-21T07:11:00.592 INFO:teuthology.orchestra.run.smithi018.stdout:blocklisted: false 2024-09-21T07:11:00.593 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records in 2024-09-21T07:11:00.593 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records out 2024-09-21T07:11:00.593 INFO:teuthology.orchestra.run.smithi018.stderr:70 bytes copied, 2.424e-05 s, 2.9 MB/s 2024-09-21T07:11:00.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:00.600 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-21T07:11:00.600 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:11:00.600 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T07:11:00.600 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:11:00.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.713+0000 7f923aaa4640 1 -- 172.21.15.18:0/2647915536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92340d0b20 msgr2=0x7f92340ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:00.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.713+0000 7f923aaa4640 1 --2- 172.21.15.18:0/2647915536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92340d0b20 0x7f92340ce0b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9234072170 tx=0x7f922c02a530 comp rx=0 tx=0).stop 2024-09-21T07:11:00.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.713+0000 7f923aaa4640 1 -- 172.21.15.18:0/2647915536 shutdown_connections 2024-09-21T07:11:00.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.713+0000 7f923aaa4640 1 --2- 172.21.15.18:0/2647915536 >> v2:172.21.15.49:3300/0 conn(0x7f923406f850 0x7f923415ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:00.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.713+0000 7f923aaa4640 1 --2- 172.21.15.18:0/2647915536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92340d0b20 0x7f92340ce0b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:00.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.713+0000 7f923aaa4640 1 -- 172.21.15.18:0/2647915536 >> 172.21.15.18:0/2647915536 conn(0x7f92340b1fe0 msgr2=0x7f92340b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:00.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.713+0000 7f923aaa4640 1 -- 172.21.15.18:0/2647915536 shutdown_connections 2024-09-21T07:11:00.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.713+0000 7f923aaa4640 1 -- 172.21.15.18:0/2647915536 wait complete. 2024-09-21T07:11:00.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.716+0000 7f923aaa4640 1 Processor -- start 2024-09-21T07:11:00.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.716+0000 7f923aaa4640 1 -- start start 2024-09-21T07:11:00.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.717+0000 7f923aaa4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f923406f850 0x7f9234148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:00.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.717+0000 7f923aaa4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92340d0b20 0x7f92341f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:00.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.717+0000 7f923aaa4640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f923415efa0 0x7f923415cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:00.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.717+0000 7f923aaa4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f923415bb80 con 0x7f923406f850 2024-09-21T07:11:00.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.717+0000 7f923aaa4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f923415f5c0 con 0x7f92340d0b20 2024-09-21T07:11:00.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.717+0000 7f923aaa4640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f923415bd00 con 0x7f923415efa0 2024-09-21T07:11:00.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.717+0000 7f9238840640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f923406f850 0x7f9234148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:00.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.717+0000 7f9238840640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f923406f850 0x7f9234148950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45860/0 (socket says 172.21.15.18:45860) 2024-09-21T07:11:00.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.717+0000 7f9238840640 1 -- 172.21.15.18:0/3082233576 learned_addr learned my addr 172.21.15.18:0/3082233576 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:00.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.717+0000 7f9233fff640 1 --2- 172.21.15.18:0/3082233576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92340d0b20 0x7f92341f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:00.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.717+0000 7f9239041640 1 --2- 172.21.15.18:0/3082233576 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f923415efa0 0x7f923415cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:00.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.718+0000 7f9238840640 1 -- 172.21.15.18:0/3082233576 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f923415efa0 msgr2=0x7f923415cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:00.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.718+0000 7f9238840640 1 --2- 172.21.15.18:0/3082233576 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f923415efa0 0x7f923415cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:00.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.718+0000 7f9238840640 1 -- 172.21.15.18:0/3082233576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92340d0b20 msgr2=0x7f92341f6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:00.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.718+0000 7f9238840640 1 --2- 172.21.15.18:0/3082233576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92340d0b20 0x7f92341f6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:00.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.718+0000 7f9238840640 1 -- 172.21.15.18:0/3082233576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92341f7c70 con 0x7f923406f850 2024-09-21T07:11:00.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.718+0000 7f9238840640 1 --2- 172.21.15.18:0/3082233576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f923406f850 0x7f9234148950 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f922c009780 tx=0x7f922c033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:00.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.718+0000 7f92317fa640 1 -- 172.21.15.18:0/3082233576 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c031d60 con 0x7f923406f850 2024-09-21T07:11:00.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.718+0000 7f92317fa640 1 -- 172.21.15.18:0/3082233576 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f922c005020 con 0x7f923406f850 2024-09-21T07:11:00.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.718+0000 7f923aaa4640 1 -- 172.21.15.18:0/3082233576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92341f3c10 con 0x7f923406f850 2024-09-21T07:11:00.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.718+0000 7f92317fa640 1 -- 172.21.15.18:0/3082233576 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c005470 con 0x7f923406f850 2024-09-21T07:11:00.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.718+0000 7f923aaa4640 1 -- 172.21.15.18:0/3082233576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92341f41d0 con 0x7f923406f850 2024-09-21T07:11:00.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.719+0000 7f923aaa4640 1 -- 172.21.15.18:0/3082233576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92341f3a00 con 0x7f923406f850 2024-09-21T07:11:00.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.720+0000 7f92317fa640 1 -- 172.21.15.18:0/3082233576 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f922c0047a0 con 0x7f923406f850 2024-09-21T07:11:00.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.720+0000 7f92317fa640 1 --2- 172.21.15.18:0/3082233576 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9214078bc0 0x7f921407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:00.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.720+0000 7f92317fa640 1 -- 172.21.15.18:0/3082233576 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f922c0bbff0 con 0x7f923406f850 2024-09-21T07:11:00.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.721+0000 7f9233fff640 1 --2- 172.21.15.18:0/3082233576 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9214078bc0 0x7f921407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:00.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.721+0000 7f9233fff640 1 --2- 172.21.15.18:0/3082233576 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9214078bc0 0x7f921407b0d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f92340cd530 tx=0x7f922400d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:00.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.725+0000 7f92317fa640 1 -- 172.21.15.18:0/3082233576 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f922c03f030 con 0x7f923406f850 2024-09-21T07:11:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.951+0000 7f923aaa4640 1 -- 172.21.15.18:0/3082233576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f923415c210 con 0x7f923406f850 2024-09-21T07:11:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.951+0000 7f92317fa640 1 -- 172.21.15.18:0/3082233576 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f922c083d70 con 0x7f923406f850 2024-09-21T07:11:00.954 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:11:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.953+0000 7f923aaa4640 1 -- 172.21.15.18:0/3082233576 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9214078bc0 msgr2=0x7f921407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.953+0000 7f923aaa4640 1 --2- 172.21.15.18:0/3082233576 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9214078bc0 0x7f921407b0d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f92340cd530 tx=0x7f922400d040 comp rx=0 tx=0).stop 2024-09-21T07:11:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.953+0000 7f923aaa4640 1 -- 172.21.15.18:0/3082233576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f923406f850 msgr2=0x7f9234148950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.953+0000 7f923aaa4640 1 --2- 172.21.15.18:0/3082233576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f923406f850 0x7f9234148950 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f922c009780 tx=0x7f922c033d60 comp rx=0 tx=0).stop 2024-09-21T07:11:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.953+0000 7f923aaa4640 1 -- 172.21.15.18:0/3082233576 shutdown_connections 2024-09-21T07:11:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.953+0000 7f923aaa4640 1 --2- 172.21.15.18:0/3082233576 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9214078bc0 0x7f921407b0d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.953+0000 7f923aaa4640 1 --2- 172.21.15.18:0/3082233576 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f923415efa0 0x7f923415cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.953+0000 7f923aaa4640 1 --2- 172.21.15.18:0/3082233576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92340d0b20 0x7f92341f6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.953+0000 7f923aaa4640 1 --2- 172.21.15.18:0/3082233576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f923406f850 0x7f9234148950 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.953+0000 7f923aaa4640 1 -- 172.21.15.18:0/3082233576 >> 172.21.15.18:0/3082233576 conn(0x7f92340b1fe0 msgr2=0x7f923415c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.953+0000 7f923aaa4640 1 -- 172.21.15.18:0/3082233576 shutdown_connections 2024-09-21T07:11:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:00.953+0000 7f923aaa4640 1 -- 172.21.15.18:0/3082233576 wait complete. 2024-09-21T07:11:00.967 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:11:00.967 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:11:00.967 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-21T07:11:00.967 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-21T07:11:00.967 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T07:11:00.967 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:11:00.967 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:11:00.967 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:11:00.967 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-21T07:11:00.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:00.968 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-21T07:11:00.984 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:11:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:11:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:11:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-21T07:11:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:00.984 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-21T07:11:00.985 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-21T07:11:00.985 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:11:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-21T07:11:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T07:11:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42695sec preferred_lft 42695sec 2024-09-21T07:11:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-21T07:11:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:00.985 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-21T07:11:00.986 INFO:teuthology.orchestra.run.smithi018.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:11:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 56:4e:7f:fd:b6:ee brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:11:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::8032:aaff:fe57:3b46/64 scope link 2024-09-21T07:11:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:00.986 INFO:teuthology.orchestra.run.smithi018.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:11:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 56:4e:7f:fd:b6:ee brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:11:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::544e:7fff:fefd:b6ee/64 scope link tentative 2024-09-21T07:11:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:00.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:00.987 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:11:01.048 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-21T07:11:01.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:01.050 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-21T07:11:01.107 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-21T07:11:01.107 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:11:01.107 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T07:11:01.107 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T07:11:01.107 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:11:01.107 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:01.107 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-21T07:11:01.108 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T07:11:01.108 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T07:11:01.108 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T07:11:01.108 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-21T07:11:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:01.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:01.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:01.236 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-21T07:11:01.252 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:11:01.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:01.252 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-09-21T07:11:01.308 INFO:teuthology.orchestra.run.smithi018.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-21T07:11:01.308 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:01.309 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-21T07:11:01.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:11:01.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-21T07:11:01.309 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-21T07:11:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:01.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:01.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:01.427 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T07:11:01.452 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:11:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:11:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:11:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-21T07:11:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:01.453 INFO:teuthology.orchestra.run.smithi018.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:11:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether ee:27:46:50:3f:ee brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T07:11:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T07:11:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec27:46ff:fe50:3fee/64 scope link 2024-09-21T07:11:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:01.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:01.454 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T07:11:01.520 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:11:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:11:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:11:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-21T07:11:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:01.520 INFO:teuthology.orchestra.run.smithi018.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:11:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether ee:27:46:50:3f:ee brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T07:11:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T07:11:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec27:46ff:fe50:3fee/64 scope link 2024-09-21T07:11:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:01.522 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-21T07:11:01.522 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:01.522 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-21T07:11:01.522 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-21T07:11:01.522 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T07:11:01.522 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-21T07:11:01.522 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-21T07:11:01.522 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-21T07:11:01.522 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-21T07:11:01.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:01.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:01.677 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:01.678 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-21T07:11:01.678 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.1 up 2024-09-21T07:11:01.678 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T07:11:01.678 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-21T07:11:01.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:01.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:01.757 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:11:01.757 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-21T07:11:01.772 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-21T07:11:01.772 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:11:01.773 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-21T07:11:01.828 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-21T07:11:01.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:01.828 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:01.923 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:01.923 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:11:01.933 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:01.933 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:11:01.933 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.49:3300,172.21.15.49:3301" 2024-09-21T07:11:01.933 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 2@ed917ec8-3fd9-4777-97f4-b5e2f57d6f41.cephfs=/ 2024-09-21T07:11:01.933 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.18:3300/172.21.15.49:3300/172.21.15.49:3301" will pass to kernel 2024-09-21T07:11:01.933 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-21T07:11:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-21T07:11:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T07:11:01.934 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T07:11:01.934 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T07:11:01.935 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:11:01.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:01.935 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-21T07:11:01.960 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:11:02.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:02.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:02.058 INFO:teuthology.orchestra.run.smithi018.stdout:client4562 2024-09-21T07:11:02.058 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:11:02.058 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:02.074 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:11:02.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:02.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:02.171 INFO:teuthology.orchestra.run.smithi018.stdout:client4562 2024-09-21T07:11:02.171 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:11:02.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:02.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:02.227 INFO:teuthology.orchestra.run.smithi018.stdout:client4562 2024-09-21T07:11:02.227 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/ed917ec8-3fd9-4777-97f4-b5e2f57d6f41.client4562/status') 2024-09-21T07:11:02.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:02.287 INFO:teuthology.orchestra.run.smithi018.stdout:instance: client.4562 (3)172.21.15.18:0/2976174831 2024-09-21T07:11:02.287 INFO:teuthology.orchestra.run.smithi018.stdout:blocklisted: false 2024-09-21T07:11:02.288 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records in 2024-09-21T07:11:02.288 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records out 2024-09-21T07:11:02.288 INFO:teuthology.orchestra.run.smithi018.stderr:70 bytes copied, 2.3578e-05 s, 3.0 MB/s 2024-09-21T07:11:02.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:02.295 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-21T07:11:02.295 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:11:02.295 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T07:11:02.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:11:02.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.409+0000 7f2c85519640 1 -- 172.21.15.18:0/2216848761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c800b4490 msgr2=0x7f2c800b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:02.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.409+0000 7f2c85519640 1 --2- 172.21.15.18:0/2216848761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c800b4490 0x7f2c800b48a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2c800b5ca0 tx=0x7f2c7002a890 comp rx=0 tx=0).stop 2024-09-21T07:11:02.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.409+0000 7f2c85519640 1 -- 172.21.15.18:0/2216848761 shutdown_connections 2024-09-21T07:11:02.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.409+0000 7f2c85519640 1 --2- 172.21.15.18:0/2216848761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c800b4490 0x7f2c800b48a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:02.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.409+0000 7f2c85519640 1 -- 172.21.15.18:0/2216848761 >> 172.21.15.18:0/2216848761 conn(0x7f2c800b3a40 msgr2=0x7f2c800d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:02.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.409+0000 7f2c85519640 1 -- 172.21.15.18:0/2216848761 shutdown_connections 2024-09-21T07:11:02.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.409+0000 7f2c85519640 1 -- 172.21.15.18:0/2216848761 wait complete. 2024-09-21T07:11:02.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.411+0000 7f2c85519640 1 Processor -- start 2024-09-21T07:11:02.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.411+0000 7f2c85519640 1 -- start start 2024-09-21T07:11:02.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.412+0000 7f2c85519640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2c8006e340 0x7f2c801f7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:02.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.412+0000 7f2c85519640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c800b4490 0x7f2c800ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:02.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.412+0000 7f2c85519640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c8015c810 0x7f2c8014bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.412+0000 7f2c85519640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8006d240 con 0x7f2c800b4490 2024-09-21T07:11:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.412+0000 7f2c85519640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8006d0c0 con 0x7f2c8015c810 2024-09-21T07:11:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.412+0000 7f2c85519640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8006d3c0 con 0x7f2c8006e340 2024-09-21T07:11:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c7e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c800b4490 0x7f2c800ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c7e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c800b4490 0x7f2c800ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45870/0 (socket says 172.21.15.18:45870) 2024-09-21T07:11:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c7e7fc640 1 -- 172.21.15.18:0/1673820223 learned_addr learned my addr 172.21.15.18:0/1673820223 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c7effd640 1 --2- 172.21.15.18:0/1673820223 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2c8006e340 0x7f2c801f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c7f7fe640 1 --2- 172.21.15.18:0/1673820223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c8015c810 0x7f2c8014bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c7e7fc640 1 -- 172.21.15.18:0/1673820223 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2c8006e340 msgr2=0x7f2c801f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c7e7fc640 1 --2- 172.21.15.18:0/1673820223 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2c8006e340 0x7f2c801f7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c7e7fc640 1 -- 172.21.15.18:0/1673820223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c8015c810 msgr2=0x7f2c8014bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c7e7fc640 1 --2- 172.21.15.18:0/1673820223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c8015c810 0x7f2c8014bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c7e7fc640 1 -- 172.21.15.18:0/1673820223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8014c410 con 0x7f2c800b4490 2024-09-21T07:11:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c7e7fc640 1 --2- 172.21.15.18:0/1673820223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c800b4490 0x7f2c800ad880 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c400 tx=0x7f2c6800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c777fe640 1 -- 172.21.15.18:0/1673820223 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c68011790 con 0x7f2c800b4490 2024-09-21T07:11:02.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c777fe640 1 -- 172.21.15.18:0/1673820223 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c68017070 con 0x7f2c800b4490 2024-09-21T07:11:02.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c777fe640 1 -- 172.21.15.18:0/1673820223 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c68011c60 con 0x7f2c800b4490 2024-09-21T07:11:02.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c85519640 1 -- 172.21.15.18:0/1673820223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c801e6200 con 0x7f2c800b4490 2024-09-21T07:11:02.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.413+0000 7f2c85519640 1 -- 172.21.15.18:0/1673820223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c801e67c0 con 0x7f2c800b4490 2024-09-21T07:11:02.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.414+0000 7f2c85519640 1 -- 172.21.15.18:0/1673820223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c800b48a0 con 0x7f2c800b4490 2024-09-21T07:11:02.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.415+0000 7f2c777fe640 1 -- 172.21.15.18:0/1673820223 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c6801c460 con 0x7f2c800b4490 2024-09-21T07:11:02.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.416+0000 7f2c777fe640 1 --2- 172.21.15.18:0/1673820223 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2c60078b90 0x7f2c6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:02.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.416+0000 7f2c777fe640 1 -- 172.21.15.18:0/1673820223 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2c6809a9f0 con 0x7f2c800b4490 2024-09-21T07:11:02.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.416+0000 7f2c7effd640 1 --2- 172.21.15.18:0/1673820223 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2c60078b90 0x7f2c6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:02.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.417+0000 7f2c7effd640 1 --2- 172.21.15.18:0/1673820223 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2c60078b90 0x7f2c6007b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2c78001740 tx=0x7f2c78009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:02.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.421+0000 7f2c777fe640 1 -- 172.21.15.18:0/1673820223 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2c8014c410 con 0x7f2c800b4490 2024-09-21T07:11:02.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.650+0000 7f2c85519640 1 -- 172.21.15.18:0/1673820223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2c800b1690 con 0x7f2c800b4490 2024-09-21T07:11:02.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.651+0000 7f2c777fe640 1 -- 172.21.15.18:0/1673820223 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f2c800b4de0 con 0x7f2c800b4490 2024-09-21T07:11:02.654 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:11:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.653+0000 7f2c85519640 1 -- 172.21.15.18:0/1673820223 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2c60078b90 msgr2=0x7f2c6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.653+0000 7f2c85519640 1 --2- 172.21.15.18:0/1673820223 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2c60078b90 0x7f2c6007b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2c78001740 tx=0x7f2c78009040 comp rx=0 tx=0).stop 2024-09-21T07:11:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.653+0000 7f2c85519640 1 -- 172.21.15.18:0/1673820223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c800b4490 msgr2=0x7f2c800ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.653+0000 7f2c85519640 1 --2- 172.21.15.18:0/1673820223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c800b4490 0x7f2c800ad880 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c400 tx=0x7f2c6800c8c0 comp rx=0 tx=0).stop 2024-09-21T07:11:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.653+0000 7f2c85519640 1 -- 172.21.15.18:0/1673820223 shutdown_connections 2024-09-21T07:11:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.653+0000 7f2c85519640 1 --2- 172.21.15.18:0/1673820223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c8015c810 0x7f2c8014bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.653+0000 7f2c85519640 1 --2- 172.21.15.18:0/1673820223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c800b4490 0x7f2c800ad880 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.653+0000 7f2c85519640 1 --2- 172.21.15.18:0/1673820223 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2c60078b90 0x7f2c6007b0a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.653+0000 7f2c85519640 1 --2- 172.21.15.18:0/1673820223 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2c8006e340 0x7f2c801f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.653+0000 7f2c85519640 1 -- 172.21.15.18:0/1673820223 >> 172.21.15.18:0/1673820223 conn(0x7f2c800b3a40 msgr2=0x7f2c8015f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.653+0000 7f2c85519640 1 -- 172.21.15.18:0/1673820223 shutdown_connections 2024-09-21T07:11:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:02.653+0000 7f2c85519640 1 -- 172.21.15.18:0/1673820223 wait complete. 2024-09-21T07:11:02.667 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:11:02.667 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:11:02.667 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-09-21T07:11:02.667 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T07:11:02.667 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T07:11:02.667 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:11:02.667 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:11:02.668 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:11:02.668 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T07:11:02.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:02.668 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-09-21T07:11:02.688 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:11:02.688 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:11:02.688 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:11:02.688 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:02.688 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-09-21T07:11:02.688 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:02.688 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:02.688 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:02.688 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-09-21T07:11:02.689 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:02.689 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:02.689 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-09-21T07:11:02.689 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:11:02.689 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:02.689 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-09-21T07:11:02.689 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T07:11:02.689 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42736sec preferred_lft 42736sec 2024-09-21T07:11:02.689 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-09-21T07:11:02.689 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:02.689 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:02.689 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:02.689 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-09-21T07:11:02.690 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T07:11:02.690 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:02.690 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-21T07:11:02.690 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2024-09-21T07:11:02.690 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2024-09-21T07:11:02.690 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2024-09-21T07:11:02.690 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T07:11:02.690 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-21T07:11:02.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:02.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:02.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:02.904 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:11:02.932 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-09-21T07:11:02.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:02.933 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-09-21T07:11:03.003 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-09-21T07:11:03.003 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:11:03.003 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T07:11:03.003 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T07:11:03.003 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:11:03.004 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:03.004 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-21T07:11:03.004 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T07:11:03.004 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T07:11:03.004 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T07:11:03.004 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-21T07:11:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:03.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:03.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:03.294 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-09-21T07:11:03.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:03.310 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2024-09-21T07:11:03.366 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:03.366 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-21T07:11:03.366 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T07:11:03.366 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-21T07:11:03.366 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-21T07:11:03.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:03.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:03.488 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-21T07:11:03.488 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:03.488 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-21T07:11:03.488 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-21T07:11:03.488 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T07:11:03.488 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-21T07:11:03.488 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-21T07:11:03.488 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-21T07:11:03.488 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-21T07:11:03.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:03.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:03.620 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:03.620 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-21T07:11:03.620 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-09-21T07:11:03.620 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T07:11:03.620 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-21T07:11:03.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:03.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:03.702 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:11:03.702 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T07:11:03.717 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T07:11:03.717 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:11:03.717 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T07:11:03.772 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T07:11:03.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:03.772 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:03.871 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:03.871 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:11:04.003 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:04.004 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:11:04.004 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.49:3300,172.21.15.49:3301" 2024-09-21T07:11:04.004 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 1@ed917ec8-3fd9-4777-97f4-b5e2f57d6f41.cephfs=/ 2024-09-21T07:11:04.004 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.18:3300/172.21.15.49:3300/172.21.15.49:3301" will pass to kernel 2024-09-21T07:11:04.004 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T07:11:04.004 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2024-09-21T07:11:04.004 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T07:11:04.004 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T07:11:04.005 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T07:11:04.006 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:11:04.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:04.007 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T07:11:04.032 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:11:04.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:04.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:04.131 INFO:teuthology.orchestra.run.smithi049.stdout:client4568 2024-09-21T07:11:04.131 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:11:04.131 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:04.147 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:11:04.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:04.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:client4568 2024-09-21T07:11:04.245 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:11:04.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:04.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:04.302 INFO:teuthology.orchestra.run.smithi049.stdout:client4568 2024-09-21T07:11:04.302 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/ed917ec8-3fd9-4777-97f4-b5e2f57d6f41.client4568/status') 2024-09-21T07:11:04.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:instance: client.4568 (3)192.168.0.1:0/490463796 2024-09-21T07:11:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:blocklisted: false 2024-09-21T07:11:04.363 INFO:teuthology.orchestra.run.smithi049.stderr:0+1 records in 2024-09-21T07:11:04.363 INFO:teuthology.orchestra.run.smithi049.stderr:0+1 records out 2024-09-21T07:11:04.363 INFO:teuthology.orchestra.run.smithi049.stderr:68 bytes copied, 2.3108e-05 s, 2.9 MB/s 2024-09-21T07:11:04.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:04.370 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-21T07:11:04.370 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:11:04.370 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T07:11:04.370 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:11:04.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.500+0000 7fea2afc3640 1 -- 172.21.15.18:0/1657782090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea2415c520 msgr2=0x7fea240d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:04.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.500+0000 7fea2afc3640 1 --2- 172.21.15.18:0/1657782090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea2415c520 0x7fea240d3040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea10009820 tx=0x7fea1002a5a0 comp rx=0 tx=0).stop 2024-09-21T07:11:04.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.500+0000 7fea2afc3640 1 -- 172.21.15.18:0/1657782090 shutdown_connections 2024-09-21T07:11:04.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.500+0000 7fea2afc3640 1 --2- 172.21.15.18:0/1657782090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea2415c520 0x7fea240d3040 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:04.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.500+0000 7fea2afc3640 1 -- 172.21.15.18:0/1657782090 >> 172.21.15.18:0/1657782090 conn(0x7fea24073f30 msgr2=0x7fea240b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:04.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.500+0000 7fea2afc3640 1 -- 172.21.15.18:0/1657782090 shutdown_connections 2024-09-21T07:11:04.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.500+0000 7fea2afc3640 1 -- 172.21.15.18:0/1657782090 wait complete. 2024-09-21T07:11:04.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.501+0000 7fea2afc3640 1 Processor -- start 2024-09-21T07:11:04.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.502+0000 7fea2afc3640 1 -- start start 2024-09-21T07:11:04.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.503+0000 7fea2afc3640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fea240d3580 0x7fea240acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:04.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.503+0000 7fea2afc3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea2415c520 0x7fea240ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:04.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.503+0000 7fea2afc3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2415ef50 0x7fea241f9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:04.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.503+0000 7fea2afc3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fea240d13b0 con 0x7fea2415ef50 2024-09-21T07:11:04.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.503+0000 7fea2afc3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fea240d1230 con 0x7fea2415c520 2024-09-21T07:11:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.503+0000 7fea2afc3640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fea240d1530 con 0x7fea240d3580 2024-09-21T07:11:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.503+0000 7fea29560640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2415ef50 0x7fea241f9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.503+0000 7fea23fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea2415c520 0x7fea240ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.503+0000 7fea28d5f640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fea240d3580 0x7fea240acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.503+0000 7fea29560640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2415ef50 0x7fea241f9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45876/0 (socket says 172.21.15.18:45876) 2024-09-21T07:11:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.503+0000 7fea29560640 1 -- 172.21.15.18:0/1953191664 learned_addr learned my addr 172.21.15.18:0/1953191664 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.504+0000 7fea29560640 1 -- 172.21.15.18:0/1953191664 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fea240d3580 msgr2=0x7fea240acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.504+0000 7fea29560640 1 --2- 172.21.15.18:0/1953191664 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fea240d3580 0x7fea240acf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.504+0000 7fea29560640 1 -- 172.21.15.18:0/1953191664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea2415c520 msgr2=0x7fea240ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.504+0000 7fea29560640 1 --2- 172.21.15.18:0/1953191664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea2415c520 0x7fea240ad490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.504+0000 7fea29560640 1 -- 172.21.15.18:0/1953191664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2415c100 con 0x7fea2415ef50 2024-09-21T07:11:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.504+0000 7fea23fff640 1 --2- 172.21.15.18:0/1953191664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea2415c520 0x7fea240ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:11:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.504+0000 7fea29560640 1 --2- 172.21.15.18:0/1953191664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2415ef50 0x7fea241f9320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00c6e0 tx=0x7fea1c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.504+0000 7fea217fa640 1 -- 172.21.15.18:0/1953191664 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c003b70 con 0x7fea2415ef50 2024-09-21T07:11:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.504+0000 7fea2afc3640 1 -- 172.21.15.18:0/1953191664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea240ceab0 con 0x7fea2415ef50 2024-09-21T07:11:04.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.504+0000 7fea217fa640 1 -- 172.21.15.18:0/1953191664 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea1c003d10 con 0x7fea2415ef50 2024-09-21T07:11:04.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.504+0000 7fea217fa640 1 -- 172.21.15.18:0/1953191664 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c005330 con 0x7fea2415ef50 2024-09-21T07:11:04.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.504+0000 7fea2afc3640 1 -- 172.21.15.18:0/1953191664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea240cc810 con 0x7fea2415ef50 2024-09-21T07:11:04.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.505+0000 7fea2afc3640 1 -- 172.21.15.18:0/1953191664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea240d19e0 con 0x7fea2415ef50 2024-09-21T07:11:04.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.506+0000 7fea217fa640 1 -- 172.21.15.18:0/1953191664 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea1c0054d0 con 0x7fea2415ef50 2024-09-21T07:11:04.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.507+0000 7fea217fa640 1 --2- 172.21.15.18:0/1953191664 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fea08078bc0 0x7fea0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:04.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.507+0000 7fea217fa640 1 -- 172.21.15.18:0/1953191664 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fea1c09aa00 con 0x7fea2415ef50 2024-09-21T07:11:04.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.507+0000 7fea28d5f640 1 --2- 172.21.15.18:0/1953191664 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fea08078bc0 0x7fea0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:04.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.507+0000 7fea28d5f640 1 --2- 172.21.15.18:0/1953191664 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fea08078bc0 0x7fea0807b0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea180046b0 tx=0x7fea18007cc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:04.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.511+0000 7fea217fa640 1 -- 172.21.15.18:0/1953191664 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fea1c0627f0 con 0x7fea2415ef50 2024-09-21T07:11:04.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.734+0000 7fea2afc3640 1 -- 172.21.15.18:0/1953191664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fea241f6b60 con 0x7fea2415ef50 2024-09-21T07:11:04.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.735+0000 7fea217fa640 1 -- 172.21.15.18:0/1953191664 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fea1c067220 con 0x7fea2415ef50 2024-09-21T07:11:04.738 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:11:04.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.737+0000 7fea2afc3640 1 -- 172.21.15.18:0/1953191664 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fea08078bc0 msgr2=0x7fea0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:04.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.737+0000 7fea2afc3640 1 --2- 172.21.15.18:0/1953191664 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fea08078bc0 0x7fea0807b0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea180046b0 tx=0x7fea18007cc0 comp rx=0 tx=0).stop 2024-09-21T07:11:04.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.737+0000 7fea2afc3640 1 -- 172.21.15.18:0/1953191664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2415ef50 msgr2=0x7fea241f9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:04.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.737+0000 7fea2afc3640 1 --2- 172.21.15.18:0/1953191664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2415ef50 0x7fea241f9320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00c6e0 tx=0x7fea1c00cba0 comp rx=0 tx=0).stop 2024-09-21T07:11:04.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.737+0000 7fea2afc3640 1 -- 172.21.15.18:0/1953191664 shutdown_connections 2024-09-21T07:11:04.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.737+0000 7fea2afc3640 1 --2- 172.21.15.18:0/1953191664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea2415ef50 0x7fea241f9320 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:04.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.737+0000 7fea2afc3640 1 --2- 172.21.15.18:0/1953191664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea2415c520 0x7fea240ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:04.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.737+0000 7fea2afc3640 1 --2- 172.21.15.18:0/1953191664 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fea08078bc0 0x7fea0807b0d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:04.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.737+0000 7fea2afc3640 1 --2- 172.21.15.18:0/1953191664 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fea240d3580 0x7fea240acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:04.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.737+0000 7fea2afc3640 1 -- 172.21.15.18:0/1953191664 >> 172.21.15.18:0/1953191664 conn(0x7fea24073f30 msgr2=0x7fea240d4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:04.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.737+0000 7fea2afc3640 1 -- 172.21.15.18:0/1953191664 shutdown_connections 2024-09-21T07:11:04.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:04.737+0000 7fea2afc3640 1 -- 172.21.15.18:0/1953191664 wait complete. 2024-09-21T07:11:04.751 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:11:04.751 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:11:04.751 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-09-21T07:11:04.751 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-21T07:11:04.751 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T07:11:04.751 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:11:04.751 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:11:04.751 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:11:04.751 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-21T07:11:04.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:04.752 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-09-21T07:11:04.769 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:11:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:11:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:11:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-09-21T07:11:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:04.769 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:04.769 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-09-21T07:11:04.769 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-09-21T07:11:04.770 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:11:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-09-21T07:11:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T07:11:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42734sec preferred_lft 42734sec 2024-09-21T07:11:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-09-21T07:11:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:04.770 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-09-21T07:11:04.771 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:11:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ba:ad:85:96:3c:34 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:11:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e480:3cff:fe77:95ef/64 scope link 2024-09-21T07:11:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:04.771 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:11:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ba:ad:85:96:3c:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T07:11:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::b8ad:85ff:fe96:3c34/64 scope link tentative 2024-09-21T07:11:04.771 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:04.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:04.772 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:11:04.834 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-09-21T07:11:04.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:04.836 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-09-21T07:11:04.893 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-09-21T07:11:04.893 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:11:04.893 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T07:11:04.893 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T07:11:04.893 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:11:04.894 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:04.894 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-21T07:11:04.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T07:11:04.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T07:11:04.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T07:11:04.894 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-21T07:11:04.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:05.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:05.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:05.022 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-09-21T07:11:05.037 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T07:11:05.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:05.038 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2024-09-21T07:11:05.093 INFO:teuthology.orchestra.run.smithi049.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-21T07:11:05.093 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:05.093 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-21T07:11:05.094 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T07:11:05.094 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-21T07:11:05.094 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-21T07:11:05.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:05.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:05.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:05.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T07:11:05.238 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:11:05.238 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:11:05.238 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:11:05.238 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:05.238 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-09-21T07:11:05.238 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:05.238 INFO:teuthology.orchestra.run.smithi049.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:11:05.238 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:34:d0:53:a0:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T07:11:05.238 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T07:11:05.238 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:05.238 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a034:d0ff:fe53:a0eb/64 scope link 2024-09-21T07:11:05.239 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:05.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:05.239 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T07:11:05.305 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:11:05.305 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:11:05.305 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:11:05.305 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:05.305 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-09-21T07:11:05.306 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:05.306 INFO:teuthology.orchestra.run.smithi049.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:11:05.306 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:34:d0:53:a0:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T07:11:05.306 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T07:11:05.306 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:05.306 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a034:d0ff:fe53:a0eb/64 scope link 2024-09-21T07:11:05.306 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:05.307 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-21T07:11:05.307 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:05.307 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-21T07:11:05.307 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-21T07:11:05.308 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T07:11:05.308 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-21T07:11:05.308 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-21T07:11:05.308 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-21T07:11:05.308 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-21T07:11:05.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:05.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:05.463 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:05.463 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-21T07:11:05.463 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.1 up 2024-09-21T07:11:05.463 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T07:11:05.463 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-21T07:11:05.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:05.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:05.542 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:11:05.542 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-21T07:11:05.557 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-21T07:11:05.557 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:11:05.558 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-21T07:11:05.613 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-21T07:11:05.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:05.614 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:05.709 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:05.709 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:11:05.721 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:05.721 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:11:05.721 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.49:3300,172.21.15.49:3301" 2024-09-21T07:11:05.721 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 3@ed917ec8-3fd9-4777-97f4-b5e2f57d6f41.cephfs=/ 2024-09-21T07:11:05.721 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.18:3300/172.21.15.49:3300/172.21.15.49:3301" will pass to kernel 2024-09-21T07:11:05.721 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-21T07:11:05.722 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2024-09-21T07:11:05.722 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T07:11:05.722 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T07:11:05.722 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T07:11:05.724 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:11:05.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:05.724 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-21T07:11:05.749 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:11:05.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:05.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:05.848 INFO:teuthology.orchestra.run.smithi049.stdout:client4574 2024-09-21T07:11:05.848 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:11:05.848 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:05.864 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:11:05.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:05.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:05.961 INFO:teuthology.orchestra.run.smithi049.stdout:client4574 2024-09-21T07:11:05.962 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:11:06.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:06.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:06.019 INFO:teuthology.orchestra.run.smithi049.stdout:client4574 2024-09-21T07:11:06.020 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/ed917ec8-3fd9-4777-97f4-b5e2f57d6f41.client4574/status') 2024-09-21T07:11:06.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:06.080 INFO:teuthology.orchestra.run.smithi049.stdout:instance: client.4574 (3)192.168.0.2:0/4007582749 2024-09-21T07:11:06.080 INFO:teuthology.orchestra.run.smithi049.stdout:blocklisted: false 2024-09-21T07:11:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:0+1 records in 2024-09-21T07:11:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:0+1 records out 2024-09-21T07:11:06.080 INFO:teuthology.orchestra.run.smithi049.stderr:69 bytes copied, 2.7312e-05 s, 2.5 MB/s 2024-09-21T07:11:06.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:06.087 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T07:11:06.097 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-21T07:11:06.254 INFO:tasks.cephfs_test_runner:Starting test: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2024-09-21T07:11:06.254 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:11:06.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.384+0000 7f20b6fa8640 1 -- 172.21.15.18:0/2992907133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20b0160f30 msgr2=0x7f20b00b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:06.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.384+0000 7f20b6fa8640 1 --2- 172.21.15.18:0/2992907133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20b0160f30 0x7f20b00b57e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f20b00b81a0 tx=0x7f20a802a8b0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.384+0000 7f20b6fa8640 1 -- 172.21.15.18:0/2992907133 shutdown_connections 2024-09-21T07:11:06.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.384+0000 7f20b6fa8640 1 --2- 172.21.15.18:0/2992907133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20b0160f30 0x7f20b00b57e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.384+0000 7f20b6fa8640 1 --2- 172.21.15.18:0/2992907133 >> v2:172.21.15.49:3300/0 conn(0x7f20b01605e0 0x7f20b01609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.384+0000 7f20b6fa8640 1 -- 172.21.15.18:0/2992907133 >> 172.21.15.18:0/2992907133 conn(0x7f20b00b78b0 msgr2=0x7f20b00b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:06.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.384+0000 7f20b6fa8640 1 -- 172.21.15.18:0/2992907133 shutdown_connections 2024-09-21T07:11:06.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.384+0000 7f20b6fa8640 1 -- 172.21.15.18:0/2992907133 wait complete. 2024-09-21T07:11:06.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.386+0000 7f20b6fa8640 1 Processor -- start 2024-09-21T07:11:06.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.386+0000 7f20b6fa8640 1 -- start start 2024-09-21T07:11:06.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b6fa8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20b00b4760 0x7f20b006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:06.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b6fa8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b01605e0 0x7f20b014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:06.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b6fa8640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f20b0160f30 0x7f20b01f89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:06.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b6fa8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f20b00b60b0 con 0x7f20b00b4760 2024-09-21T07:11:06.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b6fa8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f20b00b5f30 con 0x7f20b01605e0 2024-09-21T07:11:06.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b6fa8640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f20b00b6230 con 0x7f20b0160f30 2024-09-21T07:11:06.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b4d44640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20b00b4760 0x7f20b006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:06.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b4d44640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20b00b4760 0x7f20b006e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53960/0 (socket says 172.21.15.18:53960) 2024-09-21T07:11:06.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b4d44640 1 -- 172.21.15.18:0/565780764 learned_addr learned my addr 172.21.15.18:0/565780764 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:06.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b5545640 1 --2- 172.21.15.18:0/565780764 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f20b0160f30 0x7f20b01f89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:06.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20affff640 1 --2- 172.21.15.18:0/565780764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b01605e0 0x7f20b014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:06.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b4d44640 1 -- 172.21.15.18:0/565780764 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f20b0160f30 msgr2=0x7f20b01f89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:06.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b4d44640 1 --2- 172.21.15.18:0/565780764 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f20b0160f30 0x7f20b01f89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b4d44640 1 -- 172.21.15.18:0/565780764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b01605e0 msgr2=0x7f20b014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:06.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b4d44640 1 --2- 172.21.15.18:0/565780764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b01605e0 0x7f20b014ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b4d44640 1 -- 172.21.15.18:0/565780764 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b01f9870 con 0x7f20b00b4760 2024-09-21T07:11:06.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20b4d44640 1 --2- 172.21.15.18:0/565780764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20b00b4760 0x7f20b006e0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f20a000c3f0 tx=0x7f20a000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:06.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.388+0000 7f20ad7fa640 1 -- 172.21.15.18:0/565780764 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a0017070 con 0x7f20b00b4760 2024-09-21T07:11:06.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.389+0000 7f20ad7fa640 1 -- 172.21.15.18:0/565780764 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20a00035f0 con 0x7f20b00b4760 2024-09-21T07:11:06.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.389+0000 7f20b6fa8640 1 -- 172.21.15.18:0/565780764 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b006d020 con 0x7f20b00b4760 2024-09-21T07:11:06.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.389+0000 7f20ad7fa640 1 -- 172.21.15.18:0/565780764 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a0003a40 con 0x7f20b00b4760 2024-09-21T07:11:06.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.389+0000 7f20b6fa8640 1 -- 172.21.15.18:0/565780764 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b006d5e0 con 0x7f20b00b4760 2024-09-21T07:11:06.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.390+0000 7f20b6fa8640 1 -- 172.21.15.18:0/565780764 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b01609f0 con 0x7f20b00b4760 2024-09-21T07:11:06.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.390+0000 7f20ad7fa640 1 -- 172.21.15.18:0/565780764 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f20a001a070 con 0x7f20b00b4760 2024-09-21T07:11:06.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.391+0000 7f20ad7fa640 1 --2- 172.21.15.18:0/565780764 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f209c078bc0 0x7f209c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:06.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.391+0000 7f20ad7fa640 1 -- 172.21.15.18:0/565780764 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f20a0099ef0 con 0x7f20b00b4760 2024-09-21T07:11:06.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.391+0000 7f20affff640 1 --2- 172.21.15.18:0/565780764 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f209c078bc0 0x7f209c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:06.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.392+0000 7f20affff640 1 --2- 172.21.15.18:0/565780764 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f209c078bc0 0x7f209c07b0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f20b015c330 tx=0x7f20a400b2e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:06.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.395+0000 7f20ad7fa640 1 -- 172.21.15.18:0/565780764 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f20a0061d70 con 0x7f20b00b4760 2024-09-21T07:11:06.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.589+0000 7f20b6fa8640 1 -- 172.21.15.18:0/565780764 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20b0071020 con 0x7f20b00b4760 2024-09-21T07:11:06.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.591+0000 7f20ad7fa640 1 -- 172.21.15.18:0/565780764 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f20a00667a0 con 0x7f20b00b4760 2024-09-21T07:11:06.592 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:06.593 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:10:44.397635+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:40.463042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:41.734661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:06.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.593+0000 7f20b6fa8640 1 -- 172.21.15.18:0/565780764 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f209c078bc0 msgr2=0x7f209c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:06.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.593+0000 7f20b6fa8640 1 --2- 172.21.15.18:0/565780764 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f209c078bc0 0x7f209c07b0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f20b015c330 tx=0x7f20a400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.593+0000 7f20b6fa8640 1 -- 172.21.15.18:0/565780764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20b00b4760 msgr2=0x7f20b006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:06.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.593+0000 7f20b6fa8640 1 --2- 172.21.15.18:0/565780764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20b00b4760 0x7f20b006e0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f20a000c3f0 tx=0x7f20a000c8b0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.593+0000 7f20b6fa8640 1 -- 172.21.15.18:0/565780764 shutdown_connections 2024-09-21T07:11:06.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.593+0000 7f20b6fa8640 1 --2- 172.21.15.18:0/565780764 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f209c078bc0 0x7f209c07b0d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.593+0000 7f20b6fa8640 1 --2- 172.21.15.18:0/565780764 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f20b0160f30 0x7f20b01f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.593+0000 7f20b6fa8640 1 --2- 172.21.15.18:0/565780764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20b01605e0 0x7f20b014ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.593+0000 7f20b6fa8640 1 --2- 172.21.15.18:0/565780764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20b00b4760 0x7f20b006e0c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.593+0000 7f20b6fa8640 1 -- 172.21.15.18:0/565780764 >> 172.21.15.18:0/565780764 conn(0x7f20b00b78b0 msgr2=0x7f20b015f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:06.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.593+0000 7f20b6fa8640 1 -- 172.21.15.18:0/565780764 shutdown_connections 2024-09-21T07:11:06.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.593+0000 7f20b6fa8640 1 -- 172.21.15.18:0/565780764 wait complete. 2024-09-21T07:11:06.606 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:10:30.329949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T07:10:40.463042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T07:10:41.734661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:11:06.607 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:11:06.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.724+0000 7efdc75f1640 1 -- 172.21.15.18:0/356875787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc015c520 msgr2=0x7efdc00d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:06.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.724+0000 7efdc75f1640 1 --2- 172.21.15.18:0/356875787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc015c520 0x7efdc00d3040 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efdb00098e0 tx=0x7efdb002a5d0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.724+0000 7efdc75f1640 1 -- 172.21.15.18:0/356875787 shutdown_connections 2024-09-21T07:11:06.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.724+0000 7efdc75f1640 1 --2- 172.21.15.18:0/356875787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc015c520 0x7efdc00d3040 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.724+0000 7efdc75f1640 1 -- 172.21.15.18:0/356875787 >> 172.21.15.18:0/356875787 conn(0x7efdc0073f30 msgr2=0x7efdc00b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:06.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.724+0000 7efdc75f1640 1 -- 172.21.15.18:0/356875787 shutdown_connections 2024-09-21T07:11:06.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.724+0000 7efdc75f1640 1 -- 172.21.15.18:0/356875787 wait complete. 2024-09-21T07:11:06.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.726+0000 7efdc75f1640 1 Processor -- start 2024-09-21T07:11:06.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.726+0000 7efdc75f1640 1 -- start start 2024-09-21T07:11:06.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.727+0000 7efdc75f1640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7efdc00d3580 0x7efdc0150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:06.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.727+0000 7efdc75f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc015c520 0x7efdc00c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:06.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.727+0000 7efdc75f1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdc015ef50 0x7efdc00ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:06.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.727+0000 7efdc75f1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efdc00d13b0 con 0x7efdc015c520 2024-09-21T07:11:06.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.727+0000 7efdc75f1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efdc00d1230 con 0x7efdc015ef50 2024-09-21T07:11:06.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.727+0000 7efdc75f1640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7efdc00d1530 con 0x7efdc00d3580 2024-09-21T07:11:06.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.727+0000 7efdc4b8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc015c520 0x7efdc00c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:06.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.727+0000 7efdc4b8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc015c520 0x7efdc00c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53980/0 (socket says 172.21.15.18:53980) 2024-09-21T07:11:06.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.727+0000 7efdc4b8c640 1 -- 172.21.15.18:0/947612679 learned_addr learned my addr 172.21.15.18:0/947612679 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:06.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.727+0000 7efdc538d640 1 --2- 172.21.15.18:0/947612679 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7efdc00d3580 0x7efdc0150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.727+0000 7efdc5b8e640 1 --2- 172.21.15.18:0/947612679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdc015ef50 0x7efdc00ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.728+0000 7efdc4b8c640 1 -- 172.21.15.18:0/947612679 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7efdc00d3580 msgr2=0x7efdc0150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.728+0000 7efdc4b8c640 1 --2- 172.21.15.18:0/947612679 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7efdc00d3580 0x7efdc0150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.728+0000 7efdc4b8c640 1 -- 172.21.15.18:0/947612679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdc015ef50 msgr2=0x7efdc00ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.728+0000 7efdc4b8c640 1 --2- 172.21.15.18:0/947612679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdc015ef50 0x7efdc00ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.728+0000 7efdc4b8c640 1 -- 172.21.15.18:0/947612679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc00cd110 con 0x7efdc015c520 2024-09-21T07:11:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.728+0000 7efdc4b8c640 1 --2- 172.21.15.18:0/947612679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc015c520 0x7efdc00c9d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009a00 tx=0x7efdb0005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.728+0000 7efdb5ffb640 1 -- 172.21.15.18:0/947612679 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb003f070 con 0x7efdc015c520 2024-09-21T07:11:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.728+0000 7efdb5ffb640 1 -- 172.21.15.18:0/947612679 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdb0004050 con 0x7efdc015c520 2024-09-21T07:11:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.728+0000 7efdc75f1640 1 -- 172.21.15.18:0/947612679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc00cc350 con 0x7efdc015c520 2024-09-21T07:11:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.728+0000 7efdb5ffb640 1 -- 172.21.15.18:0/947612679 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb00044a0 con 0x7efdc015c520 2024-09-21T07:11:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.728+0000 7efdc75f1640 1 -- 172.21.15.18:0/947612679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc00cc910 con 0x7efdc015c520 2024-09-21T07:11:06.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.729+0000 7efdc75f1640 1 -- 172.21.15.18:0/947612679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc00d19e0 con 0x7efdc015c520 2024-09-21T07:11:06.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.730+0000 7efdb5ffb640 1 -- 172.21.15.18:0/947612679 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efdb0042070 con 0x7efdc015c520 2024-09-21T07:11:06.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.731+0000 7efdb5ffb640 1 --2- 172.21.15.18:0/947612679 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7efda4078b90 0x7efda407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:06.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.731+0000 7efdb5ffb640 1 -- 172.21.15.18:0/947612679 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efdb00bbaa0 con 0x7efdc015c520 2024-09-21T07:11:06.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.731+0000 7efdc538d640 1 --2- 172.21.15.18:0/947612679 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7efda4078b90 0x7efda407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:06.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.731+0000 7efdc538d640 1 --2- 172.21.15.18:0/947612679 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7efda4078b90 0x7efda407b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efdbc006fd0 tx=0x7efdbc009060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:06.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.735+0000 7efdb5ffb640 1 -- 172.21.15.18:0/947612679 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efdb0083890 con 0x7efdc015c520 2024-09-21T07:11:06.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.923+0000 7efdc75f1640 1 -- 172.21.15.18:0/947612679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efdc00b3920 con 0x7efdc015c520 2024-09-21T07:11:06.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.924+0000 7efdb5ffb640 1 -- 172.21.15.18:0/947612679 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7efdb00882c0 con 0x7efdc015c520 2024-09-21T07:11:06.926 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-21T07:11:06.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.926+0000 7efdc75f1640 1 -- 172.21.15.18:0/947612679 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7efda4078b90 msgr2=0x7efda407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:06.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.926+0000 7efdc75f1640 1 --2- 172.21.15.18:0/947612679 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7efda4078b90 0x7efda407b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efdbc006fd0 tx=0x7efdbc009060 comp rx=0 tx=0).stop 2024-09-21T07:11:06.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.926+0000 7efdc75f1640 1 -- 172.21.15.18:0/947612679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc015c520 msgr2=0x7efdc00c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:06.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.926+0000 7efdc75f1640 1 --2- 172.21.15.18:0/947612679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc015c520 0x7efdc00c9d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009a00 tx=0x7efdb0005040 comp rx=0 tx=0).stop 2024-09-21T07:11:06.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.926+0000 7efdc75f1640 1 -- 172.21.15.18:0/947612679 shutdown_connections 2024-09-21T07:11:06.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.926+0000 7efdc75f1640 1 --2- 172.21.15.18:0/947612679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdc015ef50 0x7efdc00ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.926+0000 7efdc75f1640 1 --2- 172.21.15.18:0/947612679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc015c520 0x7efdc00c9d10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.926+0000 7efdc75f1640 1 --2- 172.21.15.18:0/947612679 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7efda4078b90 0x7efda407b0a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.926+0000 7efdc75f1640 1 --2- 172.21.15.18:0/947612679 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7efdc00d3580 0x7efdc0150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.926+0000 7efdc75f1640 1 -- 172.21.15.18:0/947612679 >> 172.21.15.18:0/947612679 conn(0x7efdc0073f30 msgr2=0x7efdc015e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.926+0000 7efdc75f1640 1 -- 172.21.15.18:0/947612679 shutdown_connections 2024-09-21T07:11:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:06.926+0000 7efdc75f1640 1 -- 172.21.15.18:0/947612679 wait complete. 2024-09-21T07:11:06.939 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T07:11:07.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.056+0000 7f325e641640 1 -- 172.21.15.18:0/3745812419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f325815ef50 msgr2=0x7f325815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:07.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.056+0000 7f325e641640 1 --2- 172.21.15.18:0/3745812419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f325815ef50 0x7f325815c520 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f32580d1fb0 tx=0x7f324802a560 comp rx=0 tx=0).stop 2024-09-21T07:11:07.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.057+0000 7f325e641640 1 -- 172.21.15.18:0/3745812419 shutdown_connections 2024-09-21T07:11:07.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.057+0000 7f325e641640 1 --2- 172.21.15.18:0/3745812419 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f32580d3580 0x7f3258162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.057+0000 7f325e641640 1 --2- 172.21.15.18:0/3745812419 >> v2:172.21.15.49:3300/0 conn(0x7f32580cef70 0x7f32580d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.057+0000 7f325e641640 1 --2- 172.21.15.18:0/3745812419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f325815ef50 0x7f325815c520 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.057+0000 7f325e641640 1 -- 172.21.15.18:0/3745812419 >> 172.21.15.18:0/3745812419 conn(0x7f3258073f30 msgr2=0x7f32580b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:07.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.057+0000 7f325e641640 1 -- 172.21.15.18:0/3745812419 shutdown_connections 2024-09-21T07:11:07.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.057+0000 7f325e641640 1 -- 172.21.15.18:0/3745812419 wait complete. 2024-09-21T07:11:07.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.058+0000 7f325e641640 1 Processor -- start 2024-09-21T07:11:07.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.058+0000 7f325e641640 1 -- start start 2024-09-21T07:11:07.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f325e641640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f32580cef70 0x7f32581f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:07.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f325e641640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32580d3580 0x7f32580b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:07.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f325e641640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f325815ef50 0x7f32580b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:07.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f325e641640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3258163310 con 0x7f32580d3580 2024-09-21T07:11:07.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f325e641640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3258163190 con 0x7f325815ef50 2024-09-21T07:11:07.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f325e641640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f32580d1020 con 0x7f32580cef70 2024-09-21T07:11:07.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f324ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32580d3580 0x7f32580b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:07.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f3257fff640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f32580cef70 0x7f32581f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:07.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f324ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32580d3580 0x7f32580b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53996/0 (socket says 172.21.15.18:53996) 2024-09-21T07:11:07.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f324ffff640 1 -- 172.21.15.18:0/1494238934 learned_addr learned my addr 172.21.15.18:0/1494238934 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:07.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f325cbde640 1 --2- 172.21.15.18:0/1494238934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f325815ef50 0x7f32580b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:07.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f324ffff640 1 -- 172.21.15.18:0/1494238934 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f32580cef70 msgr2=0x7f32581f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:07.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f324ffff640 1 --2- 172.21.15.18:0/1494238934 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f32580cef70 0x7f32581f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f324ffff640 1 -- 172.21.15.18:0/1494238934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f325815ef50 msgr2=0x7f32580b8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:07.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f324ffff640 1 --2- 172.21.15.18:0/1494238934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f325815ef50 0x7f32580b8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f324ffff640 1 -- 172.21.15.18:0/1494238934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32580cbb80 con 0x7f32580d3580 2024-09-21T07:11:07.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.060+0000 7f324ffff640 1 --2- 172.21.15.18:0/1494238934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32580d3580 0x7f32580b2c50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f324000d660 tx=0x7f324000db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:07.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.061+0000 7f32557fa640 1 -- 172.21.15.18:0/1494238934 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240017070 con 0x7f32580d3580 2024-09-21T07:11:07.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.061+0000 7f32557fa640 1 -- 172.21.15.18:0/1494238934 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3240009b10 con 0x7f32580d3580 2024-09-21T07:11:07.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.061+0000 7f32557fa640 1 -- 172.21.15.18:0/1494238934 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240010460 con 0x7f32580d3580 2024-09-21T07:11:07.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.061+0000 7f325e641640 1 -- 172.21.15.18:0/1494238934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32580cbe60 con 0x7f32580d3580 2024-09-21T07:11:07.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.061+0000 7f325e641640 1 -- 172.21.15.18:0/1494238934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32580cc420 con 0x7f32580d3580 2024-09-21T07:11:07.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.062+0000 7f325e641640 1 -- 172.21.15.18:0/1494238934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32580cc800 con 0x7f32580d3580 2024-09-21T07:11:07.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.062+0000 7f32557fa640 1 -- 172.21.15.18:0/1494238934 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f324001a070 con 0x7f32580d3580 2024-09-21T07:11:07.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.063+0000 7f32557fa640 1 --2- 172.21.15.18:0/1494238934 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3238078b90 0x7f323807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:07.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.063+0000 7f32557fa640 1 -- 172.21.15.18:0/1494238934 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f324009ac40 con 0x7f32580d3580 2024-09-21T07:11:07.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.063+0000 7f3257fff640 1 --2- 172.21.15.18:0/1494238934 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3238078b90 0x7f323807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:07.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.064+0000 7f3257fff640 1 --2- 172.21.15.18:0/1494238934 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3238078b90 0x7f323807b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3248033000 tx=0x7f3248004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:07.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.067+0000 7f32557fa640 1 -- 172.21.15.18:0/1494238934 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f32580cc800 con 0x7f32580d3580 2024-09-21T07:11:07.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.254+0000 7f325e641640 1 -- 172.21.15.18:0/1494238934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3258162a40 con 0x7f32580d3580 2024-09-21T07:11:07.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.255+0000 7f32557fa640 1 -- 172.21.15.18:0/1494238934 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f3240062b50 con 0x7f32580d3580 2024-09-21T07:11:07.257 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-21T07:11:07.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.257+0000 7f325e641640 1 -- 172.21.15.18:0/1494238934 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3238078b90 msgr2=0x7f323807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:07.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.257+0000 7f325e641640 1 --2- 172.21.15.18:0/1494238934 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3238078b90 0x7f323807b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3248033000 tx=0x7f3248004730 comp rx=0 tx=0).stop 2024-09-21T07:11:07.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.257+0000 7f325e641640 1 -- 172.21.15.18:0/1494238934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32580d3580 msgr2=0x7f32580b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:07.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.257+0000 7f325e641640 1 --2- 172.21.15.18:0/1494238934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32580d3580 0x7f32580b2c50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f324000d660 tx=0x7f324000db20 comp rx=0 tx=0).stop 2024-09-21T07:11:07.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.257+0000 7f325e641640 1 -- 172.21.15.18:0/1494238934 shutdown_connections 2024-09-21T07:11:07.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.257+0000 7f325e641640 1 --2- 172.21.15.18:0/1494238934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f325815ef50 0x7f32580b8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.257+0000 7f325e641640 1 --2- 172.21.15.18:0/1494238934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32580d3580 0x7f32580b2c50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.257+0000 7f325e641640 1 --2- 172.21.15.18:0/1494238934 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3238078b90 0x7f323807b0a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.257+0000 7f325e641640 1 --2- 172.21.15.18:0/1494238934 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f32580cef70 0x7f32581f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.257+0000 7f325e641640 1 -- 172.21.15.18:0/1494238934 >> 172.21.15.18:0/1494238934 conn(0x7f3258073f30 msgr2=0x7f325815d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:07.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.257+0000 7f325e641640 1 -- 172.21.15.18:0/1494238934 shutdown_connections 2024-09-21T07:11:07.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.257+0000 7f325e641640 1 -- 172.21.15.18:0/1494238934 wait complete. 2024-09-21T07:11:07.270 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T07:11:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.388+0000 7f9245b12640 1 -- 172.21.15.18:0/44898147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92400cef70 msgr2=0x7f92400d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.388+0000 7f9245b12640 1 --2- 172.21.15.18:0/44898147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92400cef70 0x7f92400d3040 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f924006dd50 tx=0x7f923402a530 comp rx=0 tx=0).stop 2024-09-21T07:11:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.388+0000 7f9245b12640 1 -- 172.21.15.18:0/44898147 shutdown_connections 2024-09-21T07:11:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.388+0000 7f9245b12640 1 --2- 172.21.15.18:0/44898147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92400cef70 0x7f92400d3040 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.388+0000 7f9245b12640 1 --2- 172.21.15.18:0/44898147 >> v2:172.21.15.49:3300/0 conn(0x7f924015ef50 0x7f924015c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.388+0000 7f9245b12640 1 -- 172.21.15.18:0/44898147 >> 172.21.15.18:0/44898147 conn(0x7f9240073f30 msgr2=0x7f92400b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.388+0000 7f9245b12640 1 -- 172.21.15.18:0/44898147 shutdown_connections 2024-09-21T07:11:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.388+0000 7f9245b12640 1 -- 172.21.15.18:0/44898147 wait complete. 2024-09-21T07:11:07.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.389+0000 7f9245b12640 1 Processor -- start 2024-09-21T07:11:07.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.390+0000 7f9245b12640 1 -- start start 2024-09-21T07:11:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.391+0000 7f9245b12640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92400cef70 0x7f924015aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.391+0000 7f9245b12640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f92400d3580 0x7f92400ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.391+0000 7f9245b12640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f924015ef50 0x7f92400cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.391+0000 7f9245b12640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f92400d1020 con 0x7f924015ef50 2024-09-21T07:11:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.391+0000 7f9245b12640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9240163360 con 0x7f92400cef70 2024-09-21T07:11:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.391+0000 7f9245b12640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f92400d11a0 con 0x7f92400d3580 2024-09-21T07:11:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.391+0000 7f923ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f924015ef50 0x7f92400cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.391+0000 7f923ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f924015ef50 0x7f92400cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54020/0 (socket says 172.21.15.18:54020) 2024-09-21T07:11:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.391+0000 7f923ffff640 1 -- 172.21.15.18:0/2831853019 learned_addr learned my addr 172.21.15.18:0/2831853019 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.391+0000 7f923f7fe640 1 --2- 172.21.15.18:0/2831853019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92400cef70 0x7f924015aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.391+0000 7f923effd640 1 --2- 172.21.15.18:0/2831853019 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f92400d3580 0x7f92400ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.392+0000 7f923ffff640 1 -- 172.21.15.18:0/2831853019 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f92400d3580 msgr2=0x7f92400ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.392+0000 7f923ffff640 1 --2- 172.21.15.18:0/2831853019 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f92400d3580 0x7f92400ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.392+0000 7f923ffff640 1 -- 172.21.15.18:0/2831853019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92400cef70 msgr2=0x7f924015aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.392+0000 7f923ffff640 1 --2- 172.21.15.18:0/2831853019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92400cef70 0x7f924015aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.392+0000 7f923ffff640 1 -- 172.21.15.18:0/2831853019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92400cb390 con 0x7f924015ef50 2024-09-21T07:11:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.392+0000 7f923ffff640 1 --2- 172.21.15.18:0/2831853019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f924015ef50 0x7f92400cb7c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f923800ca80 tx=0x7f923800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.392+0000 7f9227fff640 1 -- 172.21.15.18:0/2831853019 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238016020 con 0x7f924015ef50 2024-09-21T07:11:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.392+0000 7f9227fff640 1 -- 172.21.15.18:0/2831853019 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f923800ad20 con 0x7f924015ef50 2024-09-21T07:11:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.392+0000 7f9245b12640 1 -- 172.21.15.18:0/2831853019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f924015bf00 con 0x7f924015ef50 2024-09-21T07:11:07.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.392+0000 7f9227fff640 1 -- 172.21.15.18:0/2831853019 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238012680 con 0x7f924015ef50 2024-09-21T07:11:07.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.392+0000 7f9245b12640 1 -- 172.21.15.18:0/2831853019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92401e8fe0 con 0x7f924015ef50 2024-09-21T07:11:07.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.393+0000 7f9245b12640 1 -- 172.21.15.18:0/2831853019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f924014da10 con 0x7f924015ef50 2024-09-21T07:11:07.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.394+0000 7f9227fff640 1 -- 172.21.15.18:0/2831853019 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9238019020 con 0x7f924015ef50 2024-09-21T07:11:07.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.394+0000 7f9227fff640 1 --2- 172.21.15.18:0/2831853019 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f922c078bc0 0x7f922c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:07.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.394+0000 7f9227fff640 1 -- 172.21.15.18:0/2831853019 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f923809ae40 con 0x7f924015ef50 2024-09-21T07:11:07.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.394+0000 7f923f7fe640 1 --2- 172.21.15.18:0/2831853019 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f922c078bc0 0x7f922c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:07.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.395+0000 7f923f7fe640 1 --2- 172.21.15.18:0/2831853019 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f922c078bc0 0x7f922c07b0d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f92300098e0 tx=0x7f9230009060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:07.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.399+0000 7f9227fff640 1 -- 172.21.15.18:0/2831853019 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9238020030 con 0x7f924015ef50 2024-09-21T07:11:07.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.588+0000 7f9245b12640 1 -- 172.21.15.18:0/2831853019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f92400cb560 con 0x7f924015ef50 2024-09-21T07:11:07.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.589+0000 7f9227fff640 1 -- 172.21.15.18:0/2831853019 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f9238062cc0 con 0x7f924015ef50 2024-09-21T07:11:07.591 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-09-21T07:11:07.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.591+0000 7f9245b12640 1 -- 172.21.15.18:0/2831853019 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f922c078bc0 msgr2=0x7f922c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:07.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.591+0000 7f9245b12640 1 --2- 172.21.15.18:0/2831853019 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f922c078bc0 0x7f922c07b0d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f92300098e0 tx=0x7f9230009060 comp rx=0 tx=0).stop 2024-09-21T07:11:07.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.591+0000 7f9245b12640 1 -- 172.21.15.18:0/2831853019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f924015ef50 msgr2=0x7f92400cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:07.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.591+0000 7f9245b12640 1 --2- 172.21.15.18:0/2831853019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f924015ef50 0x7f92400cb7c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f923800ca80 tx=0x7f923800cf40 comp rx=0 tx=0).stop 2024-09-21T07:11:07.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.591+0000 7f9245b12640 1 -- 172.21.15.18:0/2831853019 shutdown_connections 2024-09-21T07:11:07.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.591+0000 7f9245b12640 1 --2- 172.21.15.18:0/2831853019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f924015ef50 0x7f92400cb7c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.591+0000 7f9245b12640 1 --2- 172.21.15.18:0/2831853019 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f922c078bc0 0x7f922c07b0d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.591+0000 7f9245b12640 1 --2- 172.21.15.18:0/2831853019 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f92400d3580 0x7f92400ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.591+0000 7f9245b12640 1 --2- 172.21.15.18:0/2831853019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92400cef70 0x7f924015aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.591+0000 7f9245b12640 1 -- 172.21.15.18:0/2831853019 >> 172.21.15.18:0/2831853019 conn(0x7f9240073f30 msgr2=0x7f92400cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:07.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.591+0000 7f9245b12640 1 -- 172.21.15.18:0/2831853019 shutdown_connections 2024-09-21T07:11:07.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.591+0000 7f9245b12640 1 -- 172.21.15.18:0/2831853019 wait complete. 2024-09-21T07:11:07.604 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2024-09-21T07:11:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.720+0000 7f270834a640 1 -- 172.21.15.18:0/503513040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26ec004d40 msgr2=0x7f26ec0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.720+0000 7f270834a640 1 --2- 172.21.15.18:0/503513040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26ec004d40 0x7f26ec0051f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f27000b4140 tx=0x7f26ec005830 comp rx=0 tx=0).stop 2024-09-21T07:11:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.720+0000 7f27068e7640 1 -- 172.21.15.18:0/503513040 reap_dead start 2024-09-21T07:11:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.720+0000 7f270834a640 1 -- 172.21.15.18:0/503513040 shutdown_connections 2024-09-21T07:11:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.720+0000 7f270834a640 1 -- 172.21.15.18:0/503513040 >> 172.21.15.18:0/503513040 conn(0x7f2700073f30 msgr2=0x7f27000b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.720+0000 7f270834a640 1 -- 172.21.15.18:0/503513040 shutdown_connections 2024-09-21T07:11:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.720+0000 7f270834a640 1 -- 172.21.15.18:0/503513040 wait complete. 2024-09-21T07:11:07.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.722+0000 7f270834a640 1 Processor -- start 2024-09-21T07:11:07.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.722+0000 7f270834a640 1 -- start start 2024-09-21T07:11:07.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f270834a640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f26ec004d40 0x7f27000b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:07.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f270834a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27000c8220 0x7f27000c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:07.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f270834a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27000c8b70 0x7f27001f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:07.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f270834a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f270015c8b0 con 0x7f27000c8b70 2024-09-21T07:11:07.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f270834a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f270015c730 con 0x7f27000c8220 2024-09-21T07:11:07.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f270834a640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f27000d1020 con 0x7f26ec004d40 2024-09-21T07:11:07.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f27068e7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27000c8b70 0x7f27001f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f27068e7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27000c8b70 0x7f27001f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54032/0 (socket says 172.21.15.18:54032) 2024-09-21T07:11:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f27068e7640 1 -- 172.21.15.18:0/2138317048 learned_addr learned my addr 172.21.15.18:0/2138317048 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f27060e6640 1 --2- 172.21.15.18:0/2138317048 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f26ec004d40 0x7f27000b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f27058e5640 1 --2- 172.21.15.18:0/2138317048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27000c8220 0x7f27000c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f27068e7640 1 -- 172.21.15.18:0/2138317048 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f26ec004d40 msgr2=0x7f27000b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f27068e7640 1 --2- 172.21.15.18:0/2138317048 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f26ec004d40 0x7f27000b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f27068e7640 1 -- 172.21.15.18:0/2138317048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27000c8220 msgr2=0x7f27000c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f27068e7640 1 --2- 172.21.15.18:0/2138317048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27000c8220 0x7f27000c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.723+0000 7f27068e7640 1 -- 172.21.15.18:0/2138317048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27000cabf0 con 0x7f27000c8b70 2024-09-21T07:11:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.724+0000 7f27068e7640 1 --2- 172.21.15.18:0/2138317048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27000c8b70 0x7f27001f51e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f26f8001e50 tx=0x7f26f8001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.724+0000 7f26f6ffd640 1 -- 172.21.15.18:0/2138317048 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f80060b0 con 0x7f27000c8b70 2024-09-21T07:11:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.724+0000 7f26f6ffd640 1 -- 172.21.15.18:0/2138317048 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26f8006250 con 0x7f27000c8b70 2024-09-21T07:11:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.724+0000 7f270834a640 1 -- 172.21.15.18:0/2138317048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27000caed0 con 0x7f27000c8b70 2024-09-21T07:11:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.724+0000 7f26f6ffd640 1 -- 172.21.15.18:0/2138317048 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f80066a0 con 0x7f27000c8b70 2024-09-21T07:11:07.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.724+0000 7f270834a640 1 -- 172.21.15.18:0/2138317048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27000cb490 con 0x7f27000c8b70 2024-09-21T07:11:07.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.725+0000 7f270834a640 1 -- 172.21.15.18:0/2138317048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27000d15b0 con 0x7f27000c8b70 2024-09-21T07:11:07.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.726+0000 7f26f6ffd640 1 -- 172.21.15.18:0/2138317048 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f26f8033480 con 0x7f27000c8b70 2024-09-21T07:11:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.726+0000 7f26f6ffd640 1 --2- 172.21.15.18:0/2138317048 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f26e4078b90 0x7f26e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.726+0000 7f26f6ffd640 1 -- 172.21.15.18:0/2138317048 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f26f80babb0 con 0x7f27000c8b70 2024-09-21T07:11:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.726+0000 7f27060e6640 1 --2- 172.21.15.18:0/2138317048 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f26e4078b90 0x7f26e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.727+0000 7f27060e6640 1 --2- 172.21.15.18:0/2138317048 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f26e4078b90 0x7f26e407b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009c50 tx=0x7f26fc005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:07.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.731+0000 7f26f6ffd640 1 -- 172.21.15.18:0/2138317048 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f26f8083080 con 0x7f27000c8b70 2024-09-21T07:11:07.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:07.989+0000 7f270834a640 1 -- 172.21.15.18:0/2138317048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) -- 0x7f27000ca980 con 0x7f27000c8b70 2024-09-21T07:11:08.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.465+0000 7f26f6ffd640 1 -- 172.21.15.18:0/2138317048 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v45) ==== 170+0+0 (secure 0 0 0) 0x7f26f80be020 con 0x7f27000c8b70 2024-09-21T07:11:08.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.468+0000 7f270834a640 1 -- 172.21.15.18:0/2138317048 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f26e4078b90 msgr2=0x7f26e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:08.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.468+0000 7f270834a640 1 --2- 172.21.15.18:0/2138317048 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f26e4078b90 0x7f26e407b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009c50 tx=0x7f26fc005f90 comp rx=0 tx=0).stop 2024-09-21T07:11:08.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.468+0000 7f270834a640 1 -- 172.21.15.18:0/2138317048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27000c8b70 msgr2=0x7f27001f51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:08.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.468+0000 7f270834a640 1 --2- 172.21.15.18:0/2138317048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27000c8b70 0x7f27001f51e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f26f8001e50 tx=0x7f26f8001af0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.468+0000 7f270834a640 1 -- 172.21.15.18:0/2138317048 shutdown_connections 2024-09-21T07:11:08.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.468+0000 7f270834a640 1 --2- 172.21.15.18:0/2138317048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27000c8b70 0x7f27001f51e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.468+0000 7f270834a640 1 --2- 172.21.15.18:0/2138317048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27000c8220 0x7f27000c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.468+0000 7f270834a640 1 --2- 172.21.15.18:0/2138317048 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f26e4078b90 0x7f26e407b0a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.468+0000 7f270834a640 1 --2- 172.21.15.18:0/2138317048 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f26ec004d40 0x7f27000b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.468+0000 7f270834a640 1 -- 172.21.15.18:0/2138317048 >> 172.21.15.18:0/2138317048 conn(0x7f2700073f30 msgr2=0x7f270015cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:08.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.468+0000 7f270834a640 1 -- 172.21.15.18:0/2138317048 shutdown_connections 2024-09-21T07:11:08.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.468+0000 7f270834a640 1 -- 172.21.15.18:0/2138317048 wait complete. 2024-09-21T07:11:08.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:11:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.601+0000 7f0990507640 1 -- 172.21.15.18:0/2577520702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f098815ef50 msgr2=0x7f098815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.601+0000 7f0990507640 1 --2- 172.21.15.18:0/2577520702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f098815ef50 0x7f098815c520 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0984005fd0 tx=0x7f098402a530 comp rx=0 tx=0).stop 2024-09-21T07:11:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.601+0000 7f0990507640 1 -- 172.21.15.18:0/2577520702 shutdown_connections 2024-09-21T07:11:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.601+0000 7f0990507640 1 --2- 172.21.15.18:0/2577520702 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0988162a40 0x7f0988162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.601+0000 7f0990507640 1 --2- 172.21.15.18:0/2577520702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f098815ef50 0x7f098815c520 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.601+0000 7f0990507640 1 -- 172.21.15.18:0/2577520702 >> 172.21.15.18:0/2577520702 conn(0x7f0988073f30 msgr2=0x7f09880b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.601+0000 7f0990507640 1 -- 172.21.15.18:0/2577520702 shutdown_connections 2024-09-21T07:11:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.601+0000 7f0990507640 1 -- 172.21.15.18:0/2577520702 wait complete. 2024-09-21T07:11:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.603+0000 7f0990507640 1 Processor -- start 2024-09-21T07:11:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.603+0000 7f0990507640 1 -- start start 2024-09-21T07:11:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.604+0000 7f0990507640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09880cef70 0x7f09880b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.604+0000 7f0990507640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098815ef50 0x7f098814bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.604+0000 7f0990507640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0988162a40 0x7f09880ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.604+0000 7f0990507640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f09880d11a0 con 0x7f09880cef70 2024-09-21T07:11:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.604+0000 7f0990507640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f09880d1020 con 0x7f098815ef50 2024-09-21T07:11:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.604+0000 7f0990507640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f09880d1320 con 0x7f0988162a40 2024-09-21T07:11:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.604+0000 7f098e2a3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09880cef70 0x7f09880b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.604+0000 7f098e2a3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09880cef70 0x7f09880b0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54044/0 (socket says 172.21.15.18:54044) 2024-09-21T07:11:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.604+0000 7f098e2a3640 1 -- 172.21.15.18:0/2025130787 learned_addr learned my addr 172.21.15.18:0/2025130787 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.604+0000 7f098daa2640 1 --2- 172.21.15.18:0/2025130787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098815ef50 0x7f098814bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.604+0000 7f098eaa4640 1 --2- 172.21.15.18:0/2025130787 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0988162a40 0x7f09880ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.605+0000 7f098e2a3640 1 -- 172.21.15.18:0/2025130787 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0988162a40 msgr2=0x7f09880ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.605+0000 7f098e2a3640 1 --2- 172.21.15.18:0/2025130787 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0988162a40 0x7f09880ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.605+0000 7f098e2a3640 1 -- 172.21.15.18:0/2025130787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098815ef50 msgr2=0x7f098814bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.605+0000 7f098e2a3640 1 --2- 172.21.15.18:0/2025130787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098815ef50 0x7f098814bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.605+0000 7f098e2a3640 1 -- 172.21.15.18:0/2025130787 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09880ab250 con 0x7f09880cef70 2024-09-21T07:11:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.605+0000 7f098e2a3640 1 --2- 172.21.15.18:0/2025130787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09880cef70 0x7f09880b0a40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0984000c00 tx=0x7f0984003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.605+0000 7f097effd640 1 -- 172.21.15.18:0/2025130787 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098403e030 con 0x7f09880cef70 2024-09-21T07:11:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.605+0000 7f097effd640 1 -- 172.21.15.18:0/2025130787 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0984003e60 con 0x7f09880cef70 2024-09-21T07:11:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.605+0000 7f0990507640 1 -- 172.21.15.18:0/2025130787 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09880ab530 con 0x7f09880cef70 2024-09-21T07:11:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.605+0000 7f097effd640 1 -- 172.21.15.18:0/2025130787 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0984035040 con 0x7f09880cef70 2024-09-21T07:11:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.605+0000 7f0990507640 1 -- 172.21.15.18:0/2025130787 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09880abaf0 con 0x7f09880cef70 2024-09-21T07:11:08.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.606+0000 7f0990507640 1 -- 172.21.15.18:0/2025130787 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09880d17d0 con 0x7f09880cef70 2024-09-21T07:11:08.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.607+0000 7f097effd640 1 -- 172.21.15.18:0/2025130787 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0984041030 con 0x7f09880cef70 2024-09-21T07:11:08.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.607+0000 7f097effd640 1 --2- 172.21.15.18:0/2025130787 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f096c078b90 0x7f096c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:08.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.608+0000 7f097effd640 1 -- 172.21.15.18:0/2025130787 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f09840bb500 con 0x7f09880cef70 2024-09-21T07:11:08.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.608+0000 7f098daa2640 1 --2- 172.21.15.18:0/2025130787 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f096c078b90 0x7f096c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:08.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.608+0000 7f098daa2640 1 --2- 172.21.15.18:0/2025130787 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f096c078b90 0x7f096c07b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0988163280 tx=0x7f0978009060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:08.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.612+0000 7f097effd640 1 -- 172.21.15.18:0/2025130787 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0984083300 con 0x7f09880cef70 2024-09-21T07:11:08.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.799+0000 7f0990507640 1 -- 172.21.15.18:0/2025130787 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f09880ba310 con 0x7f09880cef70 2024-09-21T07:11:08.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.799+0000 7f097effd640 1 -- 172.21.15.18:0/2025130787 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+2294 (secure 0 0 0) 0x7f0984087d30 con 0x7f09880cef70 2024-09-21T07:11:08.802 INFO:teuthology.orchestra.run.smithi018.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:11:08.802 INFO:teuthology.orchestra.run.smithi018.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:11:08.802 INFO:teuthology.orchestra.run.smithi018.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:11:08.802 INFO:teuthology.orchestra.run.smithi018.stdout:mgr advanced debug_client 20/20 2024-09-21T07:11:08.802 INFO:teuthology.orchestra.run.smithi018.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:11:08.802 INFO:teuthology.orchestra.run.smithi018.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:11:08.803 INFO:teuthology.orchestra.run.smithi018.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:11:08.803 INFO:teuthology.orchestra.run.smithi018.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:11:08.803 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4824.568315 2024-09-21T07:11:08.803 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4826.421018 2024-09-21T07:11:08.803 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5743.162027 2024-09-21T07:11:08.803 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 6565.245428 2024-09-21T07:11:08.803 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3823.570262 2024-09-21T07:11:08.804 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3667.008269 2024-09-21T07:11:08.804 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4013.463876 2024-09-21T07:11:08.804 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4054.854871 2024-09-21T07:11:08.804 INFO:teuthology.orchestra.run.smithi018.stdout:mds advanced debug_mds 20/20 2024-09-21T07:11:08.804 INFO:teuthology.orchestra.run.smithi018.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:11:08.804 INFO:teuthology.orchestra.run.smithi018.stdout:mds advanced debug_ms 2/2 2024-09-21T07:11:08.804 INFO:teuthology.orchestra.run.smithi018.stdout:mds dev mds_debug_frag true 2024-09-21T07:11:08.804 INFO:teuthology.orchestra.run.smithi018.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:11:08.804 INFO:teuthology.orchestra.run.smithi018.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:11:08.804 INFO:teuthology.orchestra.run.smithi018.stdout:mds dev mds_verify_scatter true 2024-09-21T07:11:08.804 INFO:teuthology.orchestra.run.smithi018.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:11:08.805 INFO:teuthology.orchestra.run.smithi018.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:11:08.805 INFO:teuthology.orchestra.run.smithi018.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:11:08.805 INFO:teuthology.orchestra.run.smithi018.stdout:client advanced client_mount_timeout 600 2024-09-21T07:11:08.805 INFO:teuthology.orchestra.run.smithi018.stdout:client advanced debug_client 20/20 2024-09-21T07:11:08.805 INFO:teuthology.orchestra.run.smithi018.stdout:client advanced debug_ms 1/1 2024-09-21T07:11:08.805 INFO:teuthology.orchestra.run.smithi018.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:11:08.805 INFO:teuthology.orchestra.run.smithi018.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:11:08.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.801+0000 7f0990507640 1 -- 172.21.15.18:0/2025130787 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f096c078b90 msgr2=0x7f096c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:08.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.801+0000 7f0990507640 1 --2- 172.21.15.18:0/2025130787 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f096c078b90 0x7f096c07b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0988163280 tx=0x7f0978009060 comp rx=0 tx=0).stop 2024-09-21T07:11:08.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.801+0000 7f0990507640 1 -- 172.21.15.18:0/2025130787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09880cef70 msgr2=0x7f09880b0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:08.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.801+0000 7f0990507640 1 --2- 172.21.15.18:0/2025130787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09880cef70 0x7f09880b0a40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0984000c00 tx=0x7f0984003970 comp rx=0 tx=0).stop 2024-09-21T07:11:08.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.801+0000 7f0990507640 1 -- 172.21.15.18:0/2025130787 shutdown_connections 2024-09-21T07:11:08.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.801+0000 7f0990507640 1 --2- 172.21.15.18:0/2025130787 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f096c078b90 0x7f096c07b0a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.801+0000 7f0990507640 1 --2- 172.21.15.18:0/2025130787 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0988162a40 0x7f09880ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.801+0000 7f0990507640 1 --2- 172.21.15.18:0/2025130787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098815ef50 0x7f098814bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.801+0000 7f0990507640 1 --2- 172.21.15.18:0/2025130787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09880cef70 0x7f09880b0a40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.801+0000 7f0990507640 1 -- 172.21.15.18:0/2025130787 >> 172.21.15.18:0/2025130787 conn(0x7f0988073f30 msgr2=0x7f09880b7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:08.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.802+0000 7f0990507640 1 -- 172.21.15.18:0/2025130787 shutdown_connections 2024-09-21T07:11:08.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.802+0000 7f0990507640 1 -- 172.21.15.18:0/2025130787 wait complete. 2024-09-21T07:11:08.815 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:11:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.933+0000 7fe60e352640 1 -- 172.21.15.18:0/1263584917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe60806f7b0 msgr2=0x7fe608144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.933+0000 7fe60e352640 1 --2- 172.21.15.18:0/1263584917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe60806f7b0 0x7fe608144a10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8005fd0 tx=0x7fe5f802a5d0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.933+0000 7fe60e352640 1 -- 172.21.15.18:0/1263584917 shutdown_connections 2024-09-21T07:11:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.933+0000 7fe60e352640 1 --2- 172.21.15.18:0/1263584917 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe608144f50 0x7fe6080b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.933+0000 7fe60e352640 1 --2- 172.21.15.18:0/1263584917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe60806f7b0 0x7fe608144a10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.933+0000 7fe60e352640 1 -- 172.21.15.18:0/1263584917 >> 172.21.15.18:0/1263584917 conn(0x7fe608074240 msgr2=0x7fe60806cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.933+0000 7fe60e352640 1 -- 172.21.15.18:0/1263584917 shutdown_connections 2024-09-21T07:11:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.933+0000 7fe60e352640 1 -- 172.21.15.18:0/1263584917 wait complete. 2024-09-21T07:11:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.935+0000 7fe60e352640 1 Processor -- start 2024-09-21T07:11:08.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.935+0000 7fe60e352640 1 -- start start 2024-09-21T07:11:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.936+0000 7fe60e352640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe60806f7b0 0x7fe6080aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.936+0000 7fe60e352640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6080b5bc0 0x7fe608137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.936+0000 7fe60e352640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe608144f50 0x7fe6081f05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.936+0000 7fe60e352640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6080b6920 con 0x7fe6080b5bc0 2024-09-21T07:11:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.936+0000 7fe60e352640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe6080b61e0 con 0x7fe608144f50 2024-09-21T07:11:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.936+0000 7fe60e352640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fe6080d01d0 con 0x7fe60806f7b0 2024-09-21T07:11:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe6077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6080b5bc0 0x7fe608137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe6077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6080b5bc0 0x7fe608137cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54066/0 (socket says 172.21.15.18:54066) 2024-09-21T07:11:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe6077fe640 1 -- 172.21.15.18:0/1663260662 learned_addr learned my addr 172.21.15.18:0/1663260662 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:08.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe607fff640 1 --2- 172.21.15.18:0/1663260662 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe60806f7b0 0x7fe6080aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:08.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe60c8ef640 1 --2- 172.21.15.18:0/1663260662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe608144f50 0x7fe6081f05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:08.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe6077fe640 1 -- 172.21.15.18:0/1663260662 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe60806f7b0 msgr2=0x7fe6080aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:08.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe6077fe640 1 --2- 172.21.15.18:0/1663260662 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe60806f7b0 0x7fe6080aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe6077fe640 1 -- 172.21.15.18:0/1663260662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe608144f50 msgr2=0x7fe6081f05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:08.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe6077fe640 1 --2- 172.21.15.18:0/1663260662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe608144f50 0x7fe6081f05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:08.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe6077fe640 1 -- 172.21.15.18:0/1663260662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe608138210 con 0x7fe6080b5bc0 2024-09-21T07:11:08.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe6077fe640 1 --2- 172.21.15.18:0/1663260662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6080b5bc0 0x7fe608137cd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00e6a0 tx=0x7fe5fc00eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:08.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe604ff9640 1 -- 172.21.15.18:0/1663260662 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc004220 con 0x7fe6080b5bc0 2024-09-21T07:11:08.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe604ff9640 1 -- 172.21.15.18:0/1663260662 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5fc0043c0 con 0x7fe6080b5bc0 2024-09-21T07:11:08.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe60e352640 1 -- 172.21.15.18:0/1663260662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6080ad960 con 0x7fe6080b5bc0 2024-09-21T07:11:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe604ff9640 1 -- 172.21.15.18:0/1663260662 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00cb10 con 0x7fe6080b5bc0 2024-09-21T07:11:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.937+0000 7fe60e352640 1 -- 172.21.15.18:0/1663260662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6080ae170 con 0x7fe6080b5bc0 2024-09-21T07:11:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.939+0000 7fe60e352640 1 -- 172.21.15.18:0/1663260662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6080adc00 con 0x7fe6080b5bc0 2024-09-21T07:11:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.939+0000 7fe604ff9640 1 -- 172.21.15.18:0/1663260662 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe5fc00ccb0 con 0x7fe6080b5bc0 2024-09-21T07:11:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.939+0000 7fe604ff9640 1 --2- 172.21.15.18:0/1663260662 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe5f4078b90 0x7fe5f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.940+0000 7fe604ff9640 1 -- 172.21.15.18:0/1663260662 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe5fc09b560 con 0x7fe6080b5bc0 2024-09-21T07:11:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.940+0000 7fe607fff640 1 --2- 172.21.15.18:0/1663260662 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe5f4078b90 0x7fe5f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.940+0000 7fe607fff640 1 --2- 172.21.15.18:0/1663260662 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe5f4078b90 0x7fe5f407b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8033000 tx=0x7fe5f8004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:08.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:08.944+0000 7fe604ff9640 1 -- 172.21.15.18:0/1663260662 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe608138210 con 0x7fe6080b5bc0 2024-09-21T07:11:09.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.131+0000 7fe60e352640 1 -- 172.21.15.18:0/1663260662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe6080d0670 con 0x7fe6080b5bc0 2024-09-21T07:11:09.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.134+0000 7fe604ff9640 1 -- 172.21.15.18:0/1663260662 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7fe5fc063360 con 0x7fe6080b5bc0 2024-09-21T07:11:09.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.136+0000 7fe60e352640 1 -- 172.21.15.18:0/1663260662 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe5f4078b90 msgr2=0x7fe5f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:09.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.136+0000 7fe60e352640 1 --2- 172.21.15.18:0/1663260662 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe5f4078b90 0x7fe5f407b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8033000 tx=0x7fe5f8004730 comp rx=0 tx=0).stop 2024-09-21T07:11:09.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.136+0000 7fe60e352640 1 -- 172.21.15.18:0/1663260662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6080b5bc0 msgr2=0x7fe608137cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:09.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.136+0000 7fe60e352640 1 --2- 172.21.15.18:0/1663260662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6080b5bc0 0x7fe608137cd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00e6a0 tx=0x7fe5fc00eb60 comp rx=0 tx=0).stop 2024-09-21T07:11:09.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.136+0000 7fe60e352640 1 -- 172.21.15.18:0/1663260662 shutdown_connections 2024-09-21T07:11:09.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.136+0000 7fe60e352640 1 --2- 172.21.15.18:0/1663260662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe608144f50 0x7fe6081f05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:09.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.136+0000 7fe60e352640 1 --2- 172.21.15.18:0/1663260662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6080b5bc0 0x7fe608137cd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:09.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.136+0000 7fe60e352640 1 --2- 172.21.15.18:0/1663260662 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe5f4078b90 0x7fe5f407b0a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:09.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.136+0000 7fe60e352640 1 --2- 172.21.15.18:0/1663260662 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe60806f7b0 0x7fe6080aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:09.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.136+0000 7fe60e352640 1 -- 172.21.15.18:0/1663260662 >> 172.21.15.18:0/1663260662 conn(0x7fe608074240 msgr2=0x7fe608068d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:09.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.137+0000 7fe60e352640 1 -- 172.21.15.18:0/1663260662 shutdown_connections 2024-09-21T07:11:09.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.137+0000 7fe60e352640 1 -- 172.21.15.18:0/1663260662 wait complete. 2024-09-21T07:11:09.149 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:11:09.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:11:09.191 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:11:09.239 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:11:09.239 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:11:09.239 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:09.256 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:11:09.256 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:09.313 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:11:09.313 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:09.369 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:11:09.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.527+0000 7f154d08c640 1 -- 172.21.15.18:0/3021208696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f154815d060 msgr2=0x7f154815d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:09.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.527+0000 7f154d08c640 1 --2- 172.21.15.18:0/3021208696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f154815d060 0x7f154815d470 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1548074080 tx=0x7f153c02a5f0 comp rx=0 tx=0).stop 2024-09-21T07:11:09.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.527+0000 7f154d08c640 1 -- 172.21.15.18:0/3021208696 shutdown_connections 2024-09-21T07:11:09.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.527+0000 7f154d08c640 1 --2- 172.21.15.18:0/3021208696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f154815d060 0x7f154815d470 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:09.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.527+0000 7f154d08c640 1 --2- 172.21.15.18:0/3021208696 >> v2:172.21.15.49:3300/0 conn(0x7f15480b4760 0x7f1548153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:09.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.527+0000 7f154d08c640 1 -- 172.21.15.18:0/3021208696 >> 172.21.15.18:0/3021208696 conn(0x7f15480b78b0 msgr2=0x7f15480b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:09.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.527+0000 7f154d08c640 1 -- 172.21.15.18:0/3021208696 shutdown_connections 2024-09-21T07:11:09.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.527+0000 7f154d08c640 1 -- 172.21.15.18:0/3021208696 wait complete. 2024-09-21T07:11:09.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.529+0000 7f154d08c640 1 Processor -- start 2024-09-21T07:11:09.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.529+0000 7f154d08c640 1 -- start start 2024-09-21T07:11:09.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f154d08c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15480b4760 0x7f154815b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f154d08c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154815d060 0x7f1548145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f154d08c640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f154815d9b0 0x7f1548159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f154d08c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15480b4d10 con 0x7f15480b4760 2024-09-21T07:11:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f154d08c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f15480b6a00 con 0x7f154815d060 2024-09-21T07:11:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f154d08c640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f1548160cf0 con 0x7f154815d9b0 2024-09-21T07:11:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f1546d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15480b4760 0x7f154815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f1546d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15480b4760 0x7f154815b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54076/0 (socket says 172.21.15.18:54076) 2024-09-21T07:11:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f1546d9d640 1 -- 172.21.15.18:0/1176837599 learned_addr learned my addr 172.21.15.18:0/1176837599 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f154659c640 1 --2- 172.21.15.18:0/1176837599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154815d060 0x7f1548145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f154759e640 1 --2- 172.21.15.18:0/1176837599 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f154815d9b0 0x7f1548159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f1546d9d640 1 -- 172.21.15.18:0/1176837599 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f154815d9b0 msgr2=0x7f1548159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f1546d9d640 1 --2- 172.21.15.18:0/1176837599 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f154815d9b0 0x7f1548159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:09.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f1546d9d640 1 -- 172.21.15.18:0/1176837599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154815d060 msgr2=0x7f1548145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:09.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f1546d9d640 1 --2- 172.21.15.18:0/1176837599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154815d060 0x7f1548145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:09.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f1546d9d640 1 -- 172.21.15.18:0/1176837599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154815bac0 con 0x7f15480b4760 2024-09-21T07:11:09.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f1546d9d640 1 --2- 172.21.15.18:0/1176837599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15480b4760 0x7f154815b000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f153800d6d0 tx=0x7f153800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:09.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.531+0000 7f152f7fe640 1 -- 172.21.15.18:0/1176837599 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538017070 con 0x7f15480b4760 2024-09-21T07:11:09.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.532+0000 7f152f7fe640 1 -- 172.21.15.18:0/1176837599 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1538005330 con 0x7f15480b4760 2024-09-21T07:11:09.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.532+0000 7f152f7fe640 1 -- 172.21.15.18:0/1176837599 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538009820 con 0x7f15480b4760 2024-09-21T07:11:09.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.532+0000 7f154d08c640 1 -- 172.21.15.18:0/1176837599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154815bda0 con 0x7f15480b4760 2024-09-21T07:11:09.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.532+0000 7f154d08c640 1 -- 172.21.15.18:0/1176837599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15481541b0 con 0x7f15480b4760 2024-09-21T07:11:09.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.533+0000 7f154d08c640 1 -- 172.21.15.18:0/1176837599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15481611a0 con 0x7f15480b4760 2024-09-21T07:11:09.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.533+0000 7f152f7fe640 1 -- 172.21.15.18:0/1176837599 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1538009bd0 con 0x7f15480b4760 2024-09-21T07:11:09.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.534+0000 7f152f7fe640 1 --2- 172.21.15.18:0/1176837599 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1534078b90 0x7f153407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:09.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.534+0000 7f152f7fe640 1 -- 172.21.15.18:0/1176837599 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f153809af40 con 0x7f15480b4760 2024-09-21T07:11:09.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.534+0000 7f154659c640 1 --2- 172.21.15.18:0/1176837599 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1534078b90 0x7f153407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:09.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.535+0000 7f154659c640 1 --2- 172.21.15.18:0/1176837599 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1534078b90 0x7f153407b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f153c033000 tx=0x7f153c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:09.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.539+0000 7f152f7fe640 1 -- 172.21.15.18:0/1176837599 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1538062dc0 con 0x7f15480b4760 2024-09-21T07:11:09.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.740+0000 7f154d08c640 1 -- 172.21.15.18:0/1176837599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1548153bc0 con 0x7f15480b4760 2024-09-21T07:11:09.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.740+0000 7f152f7fe640 1 -- 172.21.15.18:0/1176837599 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f15380677f0 con 0x7f15480b4760 2024-09-21T07:11:09.742 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-21T07:11:09.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.742+0000 7f154d08c640 1 -- 172.21.15.18:0/1176837599 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1534078b90 msgr2=0x7f153407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:09.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.742+0000 7f154d08c640 1 --2- 172.21.15.18:0/1176837599 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1534078b90 0x7f153407b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f153c033000 tx=0x7f153c004730 comp rx=0 tx=0).stop 2024-09-21T07:11:09.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.742+0000 7f154d08c640 1 -- 172.21.15.18:0/1176837599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15480b4760 msgr2=0x7f154815b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:09.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.742+0000 7f154d08c640 1 --2- 172.21.15.18:0/1176837599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15480b4760 0x7f154815b000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f153800d6d0 tx=0x7f153800db90 comp rx=0 tx=0).stop 2024-09-21T07:11:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.742+0000 7f154d08c640 1 -- 172.21.15.18:0/1176837599 shutdown_connections 2024-09-21T07:11:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.742+0000 7f154d08c640 1 --2- 172.21.15.18:0/1176837599 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1534078b90 0x7f153407b0a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.742+0000 7f154d08c640 1 --2- 172.21.15.18:0/1176837599 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f154815d9b0 0x7f1548159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.742+0000 7f154d08c640 1 --2- 172.21.15.18:0/1176837599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f154815d060 0x7f1548145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.742+0000 7f154d08c640 1 --2- 172.21.15.18:0/1176837599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15480b4760 0x7f154815b000 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.742+0000 7f154d08c640 1 -- 172.21.15.18:0/1176837599 >> 172.21.15.18:0/1176837599 conn(0x7f15480b78b0 msgr2=0x7f15480714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.742+0000 7f154d08c640 1 -- 172.21.15.18:0/1176837599 shutdown_connections 2024-09-21T07:11:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:09.742+0000 7f154d08c640 1 -- 172.21.15.18:0/1176837599 wait complete. 2024-09-21T07:11:09.755 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:11:09.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:09.756 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-21T07:11:09.782 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T07:11:09.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:09.783 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:11:09.847 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:11:09.847 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:09.867 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:11:09.867 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:09.927 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:11:09.927 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:09.986 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:11:10.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.103+0000 7f58e1407640 1 -- 172.21.15.18:0/228781619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc06e220 msgr2=0x7f58dc0b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:10.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.103+0000 7f58e1407640 1 --2- 172.21.15.18:0/228781619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc06e220 0x7f58dc0b3cd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009830 tx=0x7f58d002a480 comp rx=0 tx=0).stop 2024-09-21T07:11:10.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.103+0000 7f58e1407640 1 -- 172.21.15.18:0/228781619 shutdown_connections 2024-09-21T07:11:10.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.103+0000 7f58e1407640 1 --2- 172.21.15.18:0/228781619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc06e220 0x7f58dc0b3cd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.103+0000 7f58e1407640 1 --2- 172.21.15.18:0/228781619 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f58dc06f110 0x7f58dc15c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.103+0000 7f58e1407640 1 -- 172.21.15.18:0/228781619 >> 172.21.15.18:0/228781619 conn(0x7f58dc0b1fe0 msgr2=0x7f58dc0b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:10.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.103+0000 7f58e1407640 1 -- 172.21.15.18:0/228781619 shutdown_connections 2024-09-21T07:11:10.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.103+0000 7f58e1407640 1 -- 172.21.15.18:0/228781619 wait complete. 2024-09-21T07:11:10.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.105+0000 7f58e1407640 1 Processor -- start 2024-09-21T07:11:10.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.105+0000 7f58e1407640 1 -- start start 2024-09-21T07:11:10.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.106+0000 7f58e1407640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58dc06e220 0x7f58dc1519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:10.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.106+0000 7f58e1407640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc06f110 0x7f58dc072010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:10.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.106+0000 7f58e1407640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f58dc0b4210 0x7f58dc072550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:10.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.106+0000 7f58e1407640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f58dc160b60 con 0x7f58dc06e220 2024-09-21T07:11:10.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.106+0000 7f58e1407640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f58dc0cffa0 con 0x7f58dc06f110 2024-09-21T07:11:10.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.106+0000 7f58e1407640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f58dc160ce0 con 0x7f58dc0b4210 2024-09-21T07:11:10.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.106+0000 7f58daffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58dc06e220 0x7f58dc1519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.106+0000 7f58daffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58dc06e220 0x7f58dc1519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54088/0 (socket says 172.21.15.18:54088) 2024-09-21T07:11:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.106+0000 7f58daffd640 1 -- 172.21.15.18:0/3013272623 learned_addr learned my addr 172.21.15.18:0/3013272623 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.107+0000 7f58da7fc640 1 --2- 172.21.15.18:0/3013272623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc06f110 0x7f58dc072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.107+0000 7f58db7fe640 1 --2- 172.21.15.18:0/3013272623 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f58dc0b4210 0x7f58dc072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.107+0000 7f58daffd640 1 -- 172.21.15.18:0/3013272623 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f58dc0b4210 msgr2=0x7f58dc072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.107+0000 7f58daffd640 1 --2- 172.21.15.18:0/3013272623 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f58dc0b4210 0x7f58dc072550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.107+0000 7f58daffd640 1 -- 172.21.15.18:0/3013272623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc06f110 msgr2=0x7f58dc072010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.107+0000 7f58daffd640 1 --2- 172.21.15.18:0/3013272623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc06f110 0x7f58dc072010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.107+0000 7f58daffd640 1 -- 172.21.15.18:0/3013272623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58dc1f4490 con 0x7f58dc06e220 2024-09-21T07:11:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.107+0000 7f58daffd640 1 --2- 172.21.15.18:0/3013272623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58dc06e220 0x7f58dc1519e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f58cc00e9c0 tx=0x7f58cc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.107+0000 7f58c37fe640 1 -- 172.21.15.18:0/3013272623 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc00cd80 con 0x7f58dc06e220 2024-09-21T07:11:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.107+0000 7f58c37fe640 1 -- 172.21.15.18:0/3013272623 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58cc004020 con 0x7f58dc06e220 2024-09-21T07:11:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.107+0000 7f58e1407640 1 -- 172.21.15.18:0/3013272623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58dc074370 con 0x7f58dc06e220 2024-09-21T07:11:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.107+0000 7f58c37fe640 1 -- 172.21.15.18:0/3013272623 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc004450 con 0x7f58dc06e220 2024-09-21T07:11:10.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.107+0000 7f58e1407640 1 -- 172.21.15.18:0/3013272623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58dc154d80 con 0x7f58dc06e220 2024-09-21T07:11:10.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.108+0000 7f58e1407640 1 -- 172.21.15.18:0/3013272623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58dc161200 con 0x7f58dc06e220 2024-09-21T07:11:10.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.109+0000 7f58c37fe640 1 -- 172.21.15.18:0/3013272623 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f58cc0035f0 con 0x7f58dc06e220 2024-09-21T07:11:10.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.110+0000 7f58c37fe640 1 --2- 172.21.15.18:0/3013272623 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f58c8078b90 0x7f58c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:10.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.110+0000 7f58c37fe640 1 -- 172.21.15.18:0/3013272623 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f58cc09b640 con 0x7f58dc06e220 2024-09-21T07:11:10.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.110+0000 7f58da7fc640 1 --2- 172.21.15.18:0/3013272623 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f58c8078b90 0x7f58c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:10.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.111+0000 7f58da7fc640 1 --2- 172.21.15.18:0/3013272623 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f58c8078b90 0x7f58c807b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f58d0034000 tx=0x7f58d0004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:10.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.114+0000 7f58c37fe640 1 -- 172.21.15.18:0/3013272623 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f58cc063390 con 0x7f58dc06e220 2024-09-21T07:11:10.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.313+0000 7f58e1407640 1 -- 172.21.15.18:0/3013272623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f58dc151f20 con 0x7f58dc06e220 2024-09-21T07:11:10.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.313+0000 7f58c37fe640 1 -- 172.21.15.18:0/3013272623 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f58cc067dc0 con 0x7f58dc06e220 2024-09-21T07:11:10.315 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-21T07:11:10.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.315+0000 7f58e1407640 1 -- 172.21.15.18:0/3013272623 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f58c8078b90 msgr2=0x7f58c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:10.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.315+0000 7f58e1407640 1 --2- 172.21.15.18:0/3013272623 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f58c8078b90 0x7f58c807b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f58d0034000 tx=0x7f58d0004730 comp rx=0 tx=0).stop 2024-09-21T07:11:10.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.315+0000 7f58e1407640 1 -- 172.21.15.18:0/3013272623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58dc06e220 msgr2=0x7f58dc1519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:10.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.315+0000 7f58e1407640 1 --2- 172.21.15.18:0/3013272623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58dc06e220 0x7f58dc1519e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f58cc00e9c0 tx=0x7f58cc00ee80 comp rx=0 tx=0).stop 2024-09-21T07:11:10.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.315+0000 7f58e1407640 1 -- 172.21.15.18:0/3013272623 shutdown_connections 2024-09-21T07:11:10.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.315+0000 7f58e1407640 1 --2- 172.21.15.18:0/3013272623 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f58c8078b90 0x7f58c807b0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.315+0000 7f58e1407640 1 --2- 172.21.15.18:0/3013272623 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f58dc0b4210 0x7f58dc072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.315+0000 7f58e1407640 1 --2- 172.21.15.18:0/3013272623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc06f110 0x7f58dc072010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.315+0000 7f58e1407640 1 --2- 172.21.15.18:0/3013272623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58dc06e220 0x7f58dc1519e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.315+0000 7f58e1407640 1 -- 172.21.15.18:0/3013272623 >> 172.21.15.18:0/3013272623 conn(0x7f58dc0b1fe0 msgr2=0x7f58dc06e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:10.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.315+0000 7f58e1407640 1 -- 172.21.15.18:0/3013272623 shutdown_connections 2024-09-21T07:11:10.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.315+0000 7f58e1407640 1 -- 172.21.15.18:0/3013272623 wait complete. 2024-09-21T07:11:10.329 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T07:11:10.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:10.329 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-21T07:11:10.362 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T07:11:10.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:10.363 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T07:11:10.430 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:11:10.430 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:10.447 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:11:10.447 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:10.504 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:11:10.504 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:10.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:11:10.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.719+0000 7f7afe3c6640 1 -- 172.21.15.18:0/3713221957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af80afe70 msgr2=0x7f7af8070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:10.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.719+0000 7f7afe3c6640 1 --2- 172.21.15.18:0/3713221957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af80afe70 0x7f7af8070470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009830 tx=0x7f7aec02a510 comp rx=0 tx=0).stop 2024-09-21T07:11:10.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.719+0000 7f7afe3c6640 1 -- 172.21.15.18:0/3713221957 shutdown_connections 2024-09-21T07:11:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.719+0000 7f7afe3c6640 1 --2- 172.21.15.18:0/3713221957 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f7af80709b0 0x7f7af815d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.719+0000 7f7afe3c6640 1 --2- 172.21.15.18:0/3713221957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af80afe70 0x7f7af8070470 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.719+0000 7f7afe3c6640 1 -- 172.21.15.18:0/3713221957 >> 172.21.15.18:0/3713221957 conn(0x7f7af809ba60 msgr2=0x7f7af80b78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.719+0000 7f7afe3c6640 1 -- 172.21.15.18:0/3713221957 shutdown_connections 2024-09-21T07:11:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.719+0000 7f7afe3c6640 1 -- 172.21.15.18:0/3713221957 wait complete. 2024-09-21T07:11:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.721+0000 7f7afe3c6640 1 Processor -- start 2024-09-21T07:11:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.721+0000 7f7afe3c6640 1 -- start start 2024-09-21T07:11:10.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.722+0000 7f7afe3c6640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f7af80709b0 0x7f7af8136940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:10.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.722+0000 7f7afe3c6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af80afe70 0x7f7af81f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:10.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.722+0000 7f7afe3c6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af80b6a00 0x7f7af81f0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:10.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.722+0000 7f7afe3c6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7af815d630 con 0x7f7af80b6a00 2024-09-21T07:11:10.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.722+0000 7f7afe3c6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7af8071050 con 0x7f7af80afe70 2024-09-21T07:11:10.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.722+0000 7f7afe3c6640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f7af815d7b0 con 0x7f7af80709b0 2024-09-21T07:11:10.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.722+0000 7f7afc963640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af80b6a00 0x7f7af81f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:10.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.722+0000 7f7afc963640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af80b6a00 0x7f7af81f0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54102/0 (socket says 172.21.15.18:54102) 2024-09-21T07:11:10.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.722+0000 7f7afc963640 1 -- 172.21.15.18:0/286459186 learned_addr learned my addr 172.21.15.18:0/286459186 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.722+0000 7f7af77fe640 1 --2- 172.21.15.18:0/286459186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af80afe70 0x7f7af81f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.722+0000 7f7af7fff640 1 --2- 172.21.15.18:0/286459186 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f7af80709b0 0x7f7af8136940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.723+0000 7f7afc963640 1 -- 172.21.15.18:0/286459186 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f7af80709b0 msgr2=0x7f7af8136940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.723+0000 7f7afc963640 1 --2- 172.21.15.18:0/286459186 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f7af80709b0 0x7f7af8136940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.723+0000 7f7afc963640 1 -- 172.21.15.18:0/286459186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af80afe70 msgr2=0x7f7af81f01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.723+0000 7f7afc963640 1 --2- 172.21.15.18:0/286459186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af80afe70 0x7f7af81f01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.723+0000 7f7afc963640 1 -- 172.21.15.18:0/286459186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af80cecc0 con 0x7f7af80b6a00 2024-09-21T07:11:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.723+0000 7f7afc963640 1 --2- 172.21.15.18:0/286459186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af80b6a00 0x7f7af81f0720 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7af000ec20 tx=0x7f7af000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.723+0000 7f7af4ff9640 1 -- 172.21.15.18:0/286459186 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af0010630 con 0x7f7af80b6a00 2024-09-21T07:11:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.723+0000 7f7af4ff9640 1 -- 172.21.15.18:0/286459186 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7af00107d0 con 0x7f7af80b6a00 2024-09-21T07:11:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.723+0000 7f7af4ff9640 1 -- 172.21.15.18:0/286459186 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af0010c20 con 0x7f7af80b6a00 2024-09-21T07:11:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.723+0000 7f7afe3c6640 1 -- 172.21.15.18:0/286459186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af8138e20 con 0x7f7af80b6a00 2024-09-21T07:11:10.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.723+0000 7f7afe3c6640 1 -- 172.21.15.18:0/286459186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af81393e0 con 0x7f7af80b6a00 2024-09-21T07:11:10.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.724+0000 7f7afe3c6640 1 -- 172.21.15.18:0/286459186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7af8138b90 con 0x7f7af80b6a00 2024-09-21T07:11:10.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.725+0000 7f7af4ff9640 1 -- 172.21.15.18:0/286459186 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7af0021430 con 0x7f7af80b6a00 2024-09-21T07:11:10.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.725+0000 7f7af4ff9640 1 --2- 172.21.15.18:0/286459186 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7ae4078b90 0x7f7ae407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:10.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.726+0000 7f7af4ff9640 1 -- 172.21.15.18:0/286459186 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7af009bb40 con 0x7f7af80b6a00 2024-09-21T07:11:10.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.726+0000 7f7af7fff640 1 --2- 172.21.15.18:0/286459186 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7ae4078b90 0x7f7ae407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:10.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.726+0000 7f7af7fff640 1 --2- 172.21.15.18:0/286459186 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7ae4078b90 0x7f7ae407b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8001720 tx=0x7f7ae8007e90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:10.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.730+0000 7f7af4ff9640 1 -- 172.21.15.18:0/286459186 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7af0063920 con 0x7f7af80b6a00 2024-09-21T07:11:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.928+0000 7f7afe3c6640 1 -- 172.21.15.18:0/286459186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7af815dc60 con 0x7f7af80b6a00 2024-09-21T07:11:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.929+0000 7f7af4ff9640 1 -- 172.21.15.18:0/286459186 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f7af0068350 con 0x7f7af80b6a00 2024-09-21T07:11:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-21T07:11:10.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.931+0000 7f7afe3c6640 1 -- 172.21.15.18:0/286459186 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7ae4078b90 msgr2=0x7f7ae407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:10.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.931+0000 7f7afe3c6640 1 --2- 172.21.15.18:0/286459186 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7ae4078b90 0x7f7ae407b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8001720 tx=0x7f7ae8007e90 comp rx=0 tx=0).stop 2024-09-21T07:11:10.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.931+0000 7f7afe3c6640 1 -- 172.21.15.18:0/286459186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af80b6a00 msgr2=0x7f7af81f0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:10.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.931+0000 7f7afe3c6640 1 --2- 172.21.15.18:0/286459186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af80b6a00 0x7f7af81f0720 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7af000ec20 tx=0x7f7af000c6a0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.931+0000 7f7afe3c6640 1 -- 172.21.15.18:0/286459186 shutdown_connections 2024-09-21T07:11:10.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.931+0000 7f7afe3c6640 1 --2- 172.21.15.18:0/286459186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af80b6a00 0x7f7af81f0720 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.931+0000 7f7afe3c6640 1 --2- 172.21.15.18:0/286459186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7af80afe70 0x7f7af81f01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.931+0000 7f7afe3c6640 1 --2- 172.21.15.18:0/286459186 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f7ae4078b90 0x7f7ae407b0a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.931+0000 7f7afe3c6640 1 --2- 172.21.15.18:0/286459186 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f7af80709b0 0x7f7af8136940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:10.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.931+0000 7f7afe3c6640 1 -- 172.21.15.18:0/286459186 >> 172.21.15.18:0/286459186 conn(0x7f7af809ba60 msgr2=0x7f7af8071c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:10.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.931+0000 7f7afe3c6640 1 -- 172.21.15.18:0/286459186 shutdown_connections 2024-09-21T07:11:10.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:10.931+0000 7f7afe3c6640 1 -- 172.21.15.18:0/286459186 wait complete. 2024-09-21T07:11:10.944 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-21T07:11:10.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:10.944 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-21T07:11:10.970 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T07:11:10.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:10.971 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-21T07:11:11.027 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:11:11.027 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:11.048 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:11:11.048 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:11.107 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:11:11.107 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:11.167 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:11:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.283+0000 7fc123f01640 1 -- 172.21.15.18:0/3733477944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11c068d40 msgr2=0x7fc11c069150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.283+0000 7fc123f01640 1 --2- 172.21.15.18:0/3733477944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11c068d40 0x7fc11c069150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc110009830 tx=0x7fc11002a410 comp rx=0 tx=0).stop 2024-09-21T07:11:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.283+0000 7fc123f01640 1 -- 172.21.15.18:0/3733477944 shutdown_connections 2024-09-21T07:11:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.283+0000 7fc123f01640 1 --2- 172.21.15.18:0/3733477944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11c068d40 0x7fc11c069150 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.283+0000 7fc123f01640 1 --2- 172.21.15.18:0/3733477944 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc11c15da80 0x7fc11c06f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.283+0000 7fc123f01640 1 -- 172.21.15.18:0/3733477944 >> 172.21.15.18:0/3733477944 conn(0x7fc11c074240 msgr2=0x7fc11c06cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.283+0000 7fc123f01640 1 -- 172.21.15.18:0/3733477944 shutdown_connections 2024-09-21T07:11:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.283+0000 7fc123f01640 1 -- 172.21.15.18:0/3733477944 wait complete. 2024-09-21T07:11:11.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.285+0000 7fc123f01640 1 Processor -- start 2024-09-21T07:11:11.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.285+0000 7fc123f01640 1 -- start start 2024-09-21T07:11:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc123f01640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc11c068d40 0x7fc11c159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc123f01640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc11c0ce960 0x7fc11c142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc123f01640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11c15da80 0x7fc11c1f7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc123f01640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc11c0d0c80 con 0x7fc11c15da80 2024-09-21T07:11:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc123f01640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc11c0d0b00 con 0x7fc11c068d40 2024-09-21T07:11:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc123f01640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fc11c0d0e00 con 0x7fc11c0ce960 2024-09-21T07:11:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc12249e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11c15da80 0x7fc11c1f7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc12249e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11c15da80 0x7fc11c1f7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54124/0 (socket says 172.21.15.18:54124) 2024-09-21T07:11:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc12249e640 1 -- 172.21.15.18:0/3258493449 learned_addr learned my addr 172.21.15.18:0/3258493449 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc12149c640 1 --2- 172.21.15.18:0/3258493449 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc11c0ce960 0x7fc11c142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc121c9d640 1 --2- 172.21.15.18:0/3258493449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc11c068d40 0x7fc11c159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc12249e640 1 -- 172.21.15.18:0/3258493449 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc11c0ce960 msgr2=0x7fc11c142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc12249e640 1 --2- 172.21.15.18:0/3258493449 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc11c0ce960 0x7fc11c142da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc12249e640 1 -- 172.21.15.18:0/3258493449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc11c068d40 msgr2=0x7fc11c159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc12249e640 1 --2- 172.21.15.18:0/3258493449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc11c068d40 0x7fc11c159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.286+0000 7fc12249e640 1 -- 172.21.15.18:0/3258493449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11c159cb0 con 0x7fc11c15da80 2024-09-21T07:11:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.287+0000 7fc12249e640 1 --2- 172.21.15.18:0/3258493449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11c15da80 0x7fc11c1f7020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc11400c490 tx=0x7fc11400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.287+0000 7fc11a7fc640 1 -- 172.21.15.18:0/3258493449 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc114017070 con 0x7fc11c15da80 2024-09-21T07:11:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.287+0000 7fc11a7fc640 1 -- 172.21.15.18:0/3258493449 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1140035f0 con 0x7fc11c15da80 2024-09-21T07:11:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.287+0000 7fc123f01640 1 -- 172.21.15.18:0/3258493449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc11c159f90 con 0x7fc11c15da80 2024-09-21T07:11:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.287+0000 7fc11a7fc640 1 -- 172.21.15.18:0/3258493449 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc114003a80 con 0x7fc11c15da80 2024-09-21T07:11:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.287+0000 7fc123f01640 1 -- 172.21.15.18:0/3258493449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc11c15a550 con 0x7fc11c15da80 2024-09-21T07:11:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.288+0000 7fc123f01640 1 -- 172.21.15.18:0/3258493449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc11c15a790 con 0x7fc11c15da80 2024-09-21T07:11:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.289+0000 7fc11a7fc640 1 -- 172.21.15.18:0/3258493449 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc11401a070 con 0x7fc11c15da80 2024-09-21T07:11:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.289+0000 7fc11a7fc640 1 --2- 172.21.15.18:0/3258493449 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc108078b90 0x7fc10807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.289+0000 7fc11a7fc640 1 -- 172.21.15.18:0/3258493449 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc114099fc0 con 0x7fc11c15da80 2024-09-21T07:11:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.290+0000 7fc121c9d640 1 --2- 172.21.15.18:0/3258493449 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc108078b90 0x7fc10807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.290+0000 7fc121c9d640 1 --2- 172.21.15.18:0/3258493449 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc108078b90 0x7fc10807b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc10c005fd0 tx=0x7fc10c0097d0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:11.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.294+0000 7fc11a7fc640 1 -- 172.21.15.18:0/3258493449 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc11c15a790 con 0x7fc11c15da80 2024-09-21T07:11:11.306 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:11:11.308 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:11:11.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.494+0000 7fc123f01640 1 -- 172.21.15.18:0/3258493449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc11c159a40 con 0x7fc11c15da80 2024-09-21T07:11:11.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.495+0000 7fc11a7fc640 1 -- 172.21.15.18:0/3258493449 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fc114061f90 con 0x7fc11c15da80 2024-09-21T07:11:11.497 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-21T07:11:11.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.497+0000 7fc123f01640 1 -- 172.21.15.18:0/3258493449 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc108078b90 msgr2=0x7fc10807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:11.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.497+0000 7fc123f01640 1 --2- 172.21.15.18:0/3258493449 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc108078b90 0x7fc10807b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc10c005fd0 tx=0x7fc10c0097d0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.497+0000 7fc123f01640 1 -- 172.21.15.18:0/3258493449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11c15da80 msgr2=0x7fc11c1f7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:11.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.497+0000 7fc123f01640 1 --2- 172.21.15.18:0/3258493449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11c15da80 0x7fc11c1f7020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc11400c490 tx=0x7fc11400c950 comp rx=0 tx=0).stop 2024-09-21T07:11:11.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.497+0000 7fc123f01640 1 -- 172.21.15.18:0/3258493449 shutdown_connections 2024-09-21T07:11:11.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.497+0000 7fc123f01640 1 --2- 172.21.15.18:0/3258493449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11c15da80 0x7fc11c1f7020 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.497+0000 7fc123f01640 1 --2- 172.21.15.18:0/3258493449 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc108078b90 0x7fc10807b0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.497+0000 7fc123f01640 1 --2- 172.21.15.18:0/3258493449 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc11c0ce960 0x7fc11c142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.497+0000 7fc123f01640 1 --2- 172.21.15.18:0/3258493449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc11c068d40 0x7fc11c159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.497+0000 7fc123f01640 1 -- 172.21.15.18:0/3258493449 >> 172.21.15.18:0/3258493449 conn(0x7fc11c074240 msgr2=0x7fc11c15c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:11.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.497+0000 7fc123f01640 1 -- 172.21.15.18:0/3258493449 shutdown_connections 2024-09-21T07:11:11.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.497+0000 7fc123f01640 1 -- 172.21.15.18:0/3258493449 wait complete. 2024-09-21T07:11:11.510 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-21T07:11:11.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:11.510 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-21T07:11:11.542 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T07:11:11.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:11.542 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-21T07:11:11.601 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:11:11.601 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:11:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.716+0000 7fcfc34b4640 1 -- 172.21.15.18:0/4288233149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfbc0cef70 msgr2=0x7fcfbc0d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.716+0000 7fcfc34b4640 1 --2- 172.21.15.18:0/4288233149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfbc0cef70 0x7fcfbc0d3040 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009820 tx=0x7fcfac02a510 comp rx=0 tx=0).stop 2024-09-21T07:11:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.716+0000 7fcfc34b4640 1 -- 172.21.15.18:0/4288233149 shutdown_connections 2024-09-21T07:11:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.716+0000 7fcfc34b4640 1 --2- 172.21.15.18:0/4288233149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfbc0cef70 0x7fcfbc0d3040 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.716+0000 7fcfc34b4640 1 --2- 172.21.15.18:0/4288233149 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcfbc15ef50 0x7fcfbc15c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.716+0000 7fcfc34b4640 1 -- 172.21.15.18:0/4288233149 >> 172.21.15.18:0/4288233149 conn(0x7fcfbc073f30 msgr2=0x7fcfbc0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.717+0000 7fcfc34b4640 1 -- 172.21.15.18:0/4288233149 shutdown_connections 2024-09-21T07:11:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.717+0000 7fcfc34b4640 1 -- 172.21.15.18:0/4288233149 wait complete. 2024-09-21T07:11:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.718+0000 7fcfc34b4640 1 Processor -- start 2024-09-21T07:11:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.718+0000 7fcfc34b4640 1 -- start start 2024-09-21T07:11:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc34b4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfbc0cef70 0x7fcfbc0cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc34b4640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcfbc0d3580 0x7fcfbc0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc34b4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfbc15ef50 0x7fcfbc0ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc34b4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0d11a0 con 0x7fcfbc0cef70 2024-09-21T07:11:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc34b4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0d1020 con 0x7fcfbc15ef50 2024-09-21T07:11:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc34b4640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fcfbc0d1320 con 0x7fcfbc0d3580 2024-09-21T07:11:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc1250640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfbc0cef70 0x7fcfbc0cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc1250640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfbc0cef70 0x7fcfbc0cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54130/0 (socket says 172.21.15.18:54130) 2024-09-21T07:11:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc1250640 1 -- 172.21.15.18:0/327973059 learned_addr learned my addr 172.21.15.18:0/327973059 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc0a4f640 1 --2- 172.21.15.18:0/327973059 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcfbc0d3580 0x7fcfbc0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc1250640 1 -- 172.21.15.18:0/327973059 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcfbc0d3580 msgr2=0x7fcfbc0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc1250640 1 --2- 172.21.15.18:0/327973059 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcfbc0d3580 0x7fcfbc0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc1a51640 1 --2- 172.21.15.18:0/327973059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfbc15ef50 0x7fcfbc0ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc1250640 1 -- 172.21.15.18:0/327973059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfbc15ef50 msgr2=0x7fcfbc0ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc1250640 1 --2- 172.21.15.18:0/327973059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfbc15ef50 0x7fcfbc0ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc1250640 1 -- 172.21.15.18:0/327973059 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc0ce2b0 con 0x7fcfbc0cef70 2024-09-21T07:11:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc0a4f640 1 --2- 172.21.15.18:0/327973059 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcfbc0d3580 0x7fcfbc0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:11.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc1250640 1 --2- 172.21.15.18:0/327973059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfbc0cef70 0x7fcfbc0cc440 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800d770 tx=0x7fcfb800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:11.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfb1ffb640 1 -- 172.21.15.18:0/327973059 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8017070 con 0x7fcfbc0cef70 2024-09-21T07:11:11.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfb1ffb640 1 -- 172.21.15.18:0/327973059 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfb8009d20 con 0x7fcfbc0cef70 2024-09-21T07:11:11.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfc34b4640 1 -- 172.21.15.18:0/327973059 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfbc0cb960 con 0x7fcfbc0cef70 2024-09-21T07:11:11.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.720+0000 7fcfb1ffb640 1 -- 172.21.15.18:0/327973059 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80106c0 con 0x7fcfbc0cef70 2024-09-21T07:11:11.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.721+0000 7fcfc34b4640 1 -- 172.21.15.18:0/327973059 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfbc0ab1b0 con 0x7fcfbc0cef70 2024-09-21T07:11:11.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.722+0000 7fcfc34b4640 1 -- 172.21.15.18:0/327973059 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfbc0d17d0 con 0x7fcfbc0cef70 2024-09-21T07:11:11.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.723+0000 7fcfb1ffb640 1 -- 172.21.15.18:0/327973059 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcfb801a070 con 0x7fcfbc0cef70 2024-09-21T07:11:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.723+0000 7fcfb1ffb640 1 --2- 172.21.15.18:0/327973059 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfa0078bc0 0x7fcfa007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.723+0000 7fcfb1ffb640 1 -- 172.21.15.18:0/327973059 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcfb809ae60 con 0x7fcfbc0cef70 2024-09-21T07:11:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.724+0000 7fcfc0a4f640 1 --2- 172.21.15.18:0/327973059 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfa0078bc0 0x7fcfa007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.724+0000 7fcfc0a4f640 1 --2- 172.21.15.18:0/327973059 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfa0078bc0 0x7fcfa007b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcfac034000 tx=0x7fcfac004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:11.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.728+0000 7fcfb1ffb640 1 -- 172.21.15.18:0/327973059 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcfb80632a0 con 0x7fcfbc0cef70 2024-09-21T07:11:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.956+0000 7fcfc34b4640 1 -- 172.21.15.18:0/327973059 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfbc1613d0 con 0x7fcfbc0cef70 2024-09-21T07:11:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.957+0000 7fcfb1ffb640 1 -- 172.21.15.18:0/327973059 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5214 (secure 0 0 0) 0x7fcfb8062ba0 con 0x7fcfbc0cef70 2024-09-21T07:11:11.959 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:11.959 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"btime":"2024-09-21T07:10:46:409212+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/760501489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":760501489},{"type":"v1","addr":"172.21.15.49:6835","nonce":760501489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2249656343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2249656343},{"type":"v1","addr":"172.21.15.49:6837","nonce":2249656343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2651218421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2651218421},{"type":"v1","addr":"172.21.15.18:6834","nonce":2651218421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:10:42.833958+0000","modified":"2024-09-21T07:10:45.793498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2785506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2785506081},{"type":"v1","addr":"172.21.15.18:6835","nonce":2785506081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":1}]} 2024-09-21T07:11:11.959 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2024-09-21T07:11:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.959+0000 7fcfc34b4640 1 -- 172.21.15.18:0/327973059 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfa0078bc0 msgr2=0x7fcfa007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.959+0000 7fcfc34b4640 1 --2- 172.21.15.18:0/327973059 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfa0078bc0 0x7fcfa007b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcfac034000 tx=0x7fcfac004730 comp rx=0 tx=0).stop 2024-09-21T07:11:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.959+0000 7fcfc34b4640 1 -- 172.21.15.18:0/327973059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfbc0cef70 msgr2=0x7fcfbc0cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.959+0000 7fcfc34b4640 1 --2- 172.21.15.18:0/327973059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfbc0cef70 0x7fcfbc0cc440 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800d770 tx=0x7fcfb800dc30 comp rx=0 tx=0).stop 2024-09-21T07:11:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.959+0000 7fcfc34b4640 1 -- 172.21.15.18:0/327973059 shutdown_connections 2024-09-21T07:11:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.959+0000 7fcfc34b4640 1 --2- 172.21.15.18:0/327973059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfbc15ef50 0x7fcfbc0ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.959+0000 7fcfc34b4640 1 --2- 172.21.15.18:0/327973059 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfa0078bc0 0x7fcfa007b0d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.959+0000 7fcfc34b4640 1 --2- 172.21.15.18:0/327973059 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcfbc0d3580 0x7fcfbc0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.959+0000 7fcfc34b4640 1 --2- 172.21.15.18:0/327973059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfbc0cef70 0x7fcfbc0cc440 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.959+0000 7fcfc34b4640 1 -- 172.21.15.18:0/327973059 >> 172.21.15.18:0/327973059 conn(0x7fcfbc073f30 msgr2=0x7fcfbc160080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.959+0000 7fcfc34b4640 1 -- 172.21.15.18:0/327973059 shutdown_connections 2024-09-21T07:11:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:11.959+0000 7fcfc34b4640 1 -- 172.21.15.18:0/327973059 wait complete. 2024-09-21T07:11:11.973 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:11:12.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.087+0000 7f12a8769640 1 -- 172.21.15.18:0/2495546073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a0162a40 msgr2=0x7f12a0162e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:12.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.087+0000 7f12a8769640 1 --2- 172.21.15.18:0/2495546073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a0162a40 0x7f12a0162e50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1298009830 tx=0x7f129802a510 comp rx=0 tx=0).stop 2024-09-21T07:11:12.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.087+0000 7f12a8769640 1 -- 172.21.15.18:0/2495546073 shutdown_connections 2024-09-21T07:11:12.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.087+0000 7f12a8769640 1 --2- 172.21.15.18:0/2495546073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a0162a40 0x7f12a0162e50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.087+0000 7f12a8769640 1 --2- 172.21.15.18:0/2495546073 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f12a015ef50 0x7f12a015c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.087+0000 7f12a8769640 1 -- 172.21.15.18:0/2495546073 >> 172.21.15.18:0/2495546073 conn(0x7f12a0073f30 msgr2=0x7f12a00b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:12.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.087+0000 7f12a8769640 1 -- 172.21.15.18:0/2495546073 shutdown_connections 2024-09-21T07:11:12.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.087+0000 7f12a8769640 1 -- 172.21.15.18:0/2495546073 wait complete. 2024-09-21T07:11:12.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.089+0000 7f12a8769640 1 Processor -- start 2024-09-21T07:11:12.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.089+0000 7f12a8769640 1 -- start start 2024-09-21T07:11:12.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.090+0000 7f12a8769640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a00cef70 0x7f12a0151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:12.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.090+0000 7f12a8769640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f12a015ef50 0x7f12a00ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:12.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.090+0000 7f12a8769640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a0162a40 0x7f12a00ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:12.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.090+0000 7f12a8769640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f12a00d11a0 con 0x7f12a0162a40 2024-09-21T07:11:12.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.090+0000 7f12a8769640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f12a00d1020 con 0x7f12a00cef70 2024-09-21T07:11:12.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.090+0000 7f12a8769640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f12a00d1320 con 0x7f12a015ef50 2024-09-21T07:11:12.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f12a6d06640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a0162a40 0x7f12a00ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:12.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f12a6d06640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a0162a40 0x7f12a00ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54150/0 (socket says 172.21.15.18:54150) 2024-09-21T07:11:12.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f12a6d06640 1 -- 172.21.15.18:0/445892935 learned_addr learned my addr 172.21.15.18:0/445892935 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:12.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f12a6505640 1 --2- 172.21.15.18:0/445892935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a00cef70 0x7f12a0151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:12.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f12a5d04640 1 --2- 172.21.15.18:0/445892935 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f12a015ef50 0x7f12a00ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:12.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f12a6d06640 1 -- 172.21.15.18:0/445892935 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f12a015ef50 msgr2=0x7f12a00ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:12.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f12a6d06640 1 --2- 172.21.15.18:0/445892935 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f12a015ef50 0x7f12a00ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f12a6d06640 1 -- 172.21.15.18:0/445892935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a00cef70 msgr2=0x7f12a0151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:12.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f12a6d06640 1 --2- 172.21.15.18:0/445892935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a00cef70 0x7f12a0151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f12a6d06640 1 -- 172.21.15.18:0/445892935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a0152250 con 0x7f12a0162a40 2024-09-21T07:11:12.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f12a6505640 1 --2- 172.21.15.18:0/445892935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a00cef70 0x7f12a0151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:12.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f12a6d06640 1 --2- 172.21.15.18:0/445892935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a0162a40 0x7f12a00ab660 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1298009950 tx=0x7f1298033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:12.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f129effd640 1 -- 172.21.15.18:0/445892935 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298031b50 con 0x7f12a0162a40 2024-09-21T07:11:12.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f129effd640 1 -- 172.21.15.18:0/445892935 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1298031de0 con 0x7f12a0162a40 2024-09-21T07:11:12.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f129effd640 1 -- 172.21.15.18:0/445892935 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298005280 con 0x7f12a0162a40 2024-09-21T07:11:12.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f12a8769640 1 -- 172.21.15.18:0/445892935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a00cb7c0 con 0x7f12a0162a40 2024-09-21T07:11:12.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.091+0000 7f12a8769640 1 -- 172.21.15.18:0/445892935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a00cbf40 con 0x7f12a0162a40 2024-09-21T07:11:12.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.092+0000 7f12a8769640 1 -- 172.21.15.18:0/445892935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a00d1800 con 0x7f12a0162a40 2024-09-21T07:11:12.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.093+0000 7f129effd640 1 -- 172.21.15.18:0/445892935 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1298005420 con 0x7f12a0162a40 2024-09-21T07:11:12.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.094+0000 7f129effd640 1 --2- 172.21.15.18:0/445892935 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f128c078b90 0x7f128c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:12.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.094+0000 7f129effd640 1 -- 172.21.15.18:0/445892935 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f12980bc220 con 0x7f12a0162a40 2024-09-21T07:11:12.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.094+0000 7f12a6505640 1 --2- 172.21.15.18:0/445892935 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f128c078b90 0x7f128c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:12.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.094+0000 7f12a6505640 1 --2- 172.21.15.18:0/445892935 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f128c078b90 0x7f128c07b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1290005fd0 tx=0x7f1290009480 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:12.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.098+0000 7f129effd640 1 -- 172.21.15.18:0/445892935 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f12a0152250 con 0x7f12a0162a40 2024-09-21T07:11:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.327+0000 7f12a8769640 1 -- 172.21.15.18:0/445892935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12a00cb9f0 con 0x7f12a0162a40 2024-09-21T07:11:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.328+0000 7f129effd640 1 -- 172.21.15.18:0/445892935 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5214 (secure 0 0 0) 0x7f129803f030 con 0x7f12a0162a40 2024-09-21T07:11:12.329 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:12.330 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"btime":"2024-09-21T07:10:46:409212+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/760501489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":760501489},{"type":"v1","addr":"172.21.15.49:6835","nonce":760501489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2249656343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2249656343},{"type":"v1","addr":"172.21.15.49:6837","nonce":2249656343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2651218421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2651218421},{"type":"v1","addr":"172.21.15.18:6834","nonce":2651218421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:10:42.833958+0000","modified":"2024-09-21T07:10:45.793498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2785506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2785506081},{"type":"v1","addr":"172.21.15.18:6835","nonce":2785506081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":1}]} 2024-09-21T07:11:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2024-09-21T07:11:12.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.330+0000 7f12a8769640 1 -- 172.21.15.18:0/445892935 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f128c078b90 msgr2=0x7f128c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:12.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.330+0000 7f12a8769640 1 --2- 172.21.15.18:0/445892935 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f128c078b90 0x7f128c07b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1290005fd0 tx=0x7f1290009480 comp rx=0 tx=0).stop 2024-09-21T07:11:12.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.330+0000 7f12a8769640 1 -- 172.21.15.18:0/445892935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a0162a40 msgr2=0x7f12a00ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:12.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.330+0000 7f12a8769640 1 --2- 172.21.15.18:0/445892935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a0162a40 0x7f12a00ab660 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1298009950 tx=0x7f1298033ba0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.330+0000 7f12a8769640 1 -- 172.21.15.18:0/445892935 shutdown_connections 2024-09-21T07:11:12.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.330+0000 7f12a8769640 1 --2- 172.21.15.18:0/445892935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a0162a40 0x7f12a00ab660 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.330+0000 7f12a8769640 1 --2- 172.21.15.18:0/445892935 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f128c078b90 0x7f128c07b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.330+0000 7f12a8769640 1 --2- 172.21.15.18:0/445892935 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f12a015ef50 0x7f12a00ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.330+0000 7f12a8769640 1 --2- 172.21.15.18:0/445892935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a00cef70 0x7f12a0151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.330+0000 7f12a8769640 1 -- 172.21.15.18:0/445892935 >> 172.21.15.18:0/445892935 conn(0x7f12a0073f30 msgr2=0x7f12a015cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.330+0000 7f12a8769640 1 -- 172.21.15.18:0/445892935 shutdown_connections 2024-09-21T07:11:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.330+0000 7f12a8769640 1 -- 172.21.15.18:0/445892935 wait complete. 2024-09-21T07:11:12.343 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:11:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.458+0000 7fc91528b640 1 -- 172.21.15.18:0/1047862271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9100cef70 msgr2=0x7fc9100d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.458+0000 7fc91528b640 1 --2- 172.21.15.18:0/1047862271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9100cef70 0x7fc9100d3040 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc9100d21f0 tx=0x7fc8f802a540 comp rx=0 tx=0).stop 2024-09-21T07:11:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.458+0000 7fc91528b640 1 -- 172.21.15.18:0/1047862271 shutdown_connections 2024-09-21T07:11:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.458+0000 7fc91528b640 1 --2- 172.21.15.18:0/1047862271 >> v2:172.21.15.49:3300/0 conn(0x7fc9100d3580 0x7fc910162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.458+0000 7fc91528b640 1 --2- 172.21.15.18:0/1047862271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9100cef70 0x7fc9100d3040 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.458+0000 7fc91528b640 1 --2- 172.21.15.18:0/1047862271 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc91015ef50 0x7fc91015c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.458+0000 7fc91528b640 1 -- 172.21.15.18:0/1047862271 >> 172.21.15.18:0/1047862271 conn(0x7fc910073f30 msgr2=0x7fc9100b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.458+0000 7fc91528b640 1 -- 172.21.15.18:0/1047862271 shutdown_connections 2024-09-21T07:11:12.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.458+0000 7fc91528b640 1 -- 172.21.15.18:0/1047862271 wait complete. 2024-09-21T07:11:12.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.460+0000 7fc91528b640 1 Processor -- start 2024-09-21T07:11:12.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.460+0000 7fc91528b640 1 -- start start 2024-09-21T07:11:12.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.461+0000 7fc91528b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9100cef70 0x7fc9100ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:12.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.461+0000 7fc91528b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9100d3580 0x7fc910151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:12.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.461+0000 7fc91528b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc91015ef50 0x7fc9100b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:12.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.461+0000 7fc91528b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc910163420 con 0x7fc9100d3580 2024-09-21T07:11:12.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.461+0000 7fc91528b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc9101632a0 con 0x7fc9100cef70 2024-09-21T07:11:12.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.461+0000 7fc91528b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fc9100d1020 con 0x7fc91015ef50 2024-09-21T07:11:12.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.461+0000 7fc90e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9100d3580 0x7fc910151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:12.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.461+0000 7fc90e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9100d3580 0x7fc910151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54166/0 (socket says 172.21.15.18:54166) 2024-09-21T07:11:12.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.461+0000 7fc90e7fc640 1 -- 172.21.15.18:0/299292448 learned_addr learned my addr 172.21.15.18:0/299292448 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:12.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.461+0000 7fc90effd640 1 --2- 172.21.15.18:0/299292448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9100cef70 0x7fc9100ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:12.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.461+0000 7fc90f7fe640 1 --2- 172.21.15.18:0/299292448 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc91015ef50 0x7fc9100b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:12.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.462+0000 7fc90e7fc640 1 -- 172.21.15.18:0/299292448 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc91015ef50 msgr2=0x7fc9100b8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:12.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.462+0000 7fc90e7fc640 1 --2- 172.21.15.18:0/299292448 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc91015ef50 0x7fc9100b8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.462+0000 7fc90e7fc640 1 -- 172.21.15.18:0/299292448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9100cef70 msgr2=0x7fc9100ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:12.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.462+0000 7fc90e7fc640 1 --2- 172.21.15.18:0/299292448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9100cef70 0x7fc9100ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.462+0000 7fc90e7fc640 1 -- 172.21.15.18:0/299292448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9100cbda0 con 0x7fc9100d3580 2024-09-21T07:11:12.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.462+0000 7fc90effd640 1 --2- 172.21.15.18:0/299292448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9100cef70 0x7fc9100ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:12.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.462+0000 7fc90e7fc640 1 --2- 172.21.15.18:0/299292448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9100d3580 0x7fc910151b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80099d0 tx=0x7fc8f80052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:12.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.462+0000 7fc9077fe640 1 -- 172.21.15.18:0/299292448 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8005cf0 con 0x7fc9100d3580 2024-09-21T07:11:12.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.462+0000 7fc9077fe640 1 -- 172.21.15.18:0/299292448 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8f8031c40 con 0x7fc9100d3580 2024-09-21T07:11:12.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.462+0000 7fc91528b640 1 -- 172.21.15.18:0/299292448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9100cc080 con 0x7fc9100d3580 2024-09-21T07:11:12.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.462+0000 7fc9077fe640 1 -- 172.21.15.18:0/299292448 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8033330 con 0x7fc9100d3580 2024-09-21T07:11:12.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.462+0000 7fc91528b640 1 -- 172.21.15.18:0/299292448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9100cc640 con 0x7fc9100d3580 2024-09-21T07:11:12.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.463+0000 7fc91528b640 1 -- 172.21.15.18:0/299292448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc910162a40 con 0x7fc9100d3580 2024-09-21T07:11:12.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.464+0000 7fc9077fe640 1 -- 172.21.15.18:0/299292448 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc8f80334d0 con 0x7fc9100d3580 2024-09-21T07:11:12.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.464+0000 7fc9077fe640 1 --2- 172.21.15.18:0/299292448 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc8f0078b90 0x7fc8f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:12.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.464+0000 7fc9077fe640 1 -- 172.21.15.18:0/299292448 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc8f80bc0d0 con 0x7fc9100d3580 2024-09-21T07:11:12.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.465+0000 7fc90effd640 1 --2- 172.21.15.18:0/299292448 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc8f0078b90 0x7fc8f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:12.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.465+0000 7fc90effd640 1 --2- 172.21.15.18:0/299292448 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc8f0078b90 0x7fc8f007b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc900005fd0 tx=0x7fc900009340 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:12.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.469+0000 7fc9077fe640 1 -- 172.21.15.18:0/299292448 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc8f803f030 con 0x7fc9100d3580 2024-09-21T07:11:12.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.658+0000 7fc91528b640 1 -- 172.21.15.18:0/299292448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9100cbb30 con 0x7fc9100d3580 2024-09-21T07:11:12.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.659+0000 7fc9077fe640 1 -- 172.21.15.18:0/299292448 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7fc8f80845a0 con 0x7fc9100d3580 2024-09-21T07:11:12.661 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:12.661 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:10:44.397635+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:40.463042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:41.734661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:12.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.661+0000 7fc91528b640 1 -- 172.21.15.18:0/299292448 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc8f0078b90 msgr2=0x7fc8f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:12.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.661+0000 7fc91528b640 1 --2- 172.21.15.18:0/299292448 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc8f0078b90 0x7fc8f007b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc900005fd0 tx=0x7fc900009340 comp rx=0 tx=0).stop 2024-09-21T07:11:12.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.661+0000 7fc91528b640 1 -- 172.21.15.18:0/299292448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9100d3580 msgr2=0x7fc910151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.661+0000 7fc91528b640 1 --2- 172.21.15.18:0/299292448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9100d3580 0x7fc910151b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80099d0 tx=0x7fc8f80052f0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.661+0000 7fc91528b640 1 -- 172.21.15.18:0/299292448 shutdown_connections 2024-09-21T07:11:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.661+0000 7fc91528b640 1 --2- 172.21.15.18:0/299292448 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc8f0078b90 0x7fc8f007b0a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.661+0000 7fc91528b640 1 --2- 172.21.15.18:0/299292448 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc91015ef50 0x7fc9100b8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.661+0000 7fc91528b640 1 --2- 172.21.15.18:0/299292448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9100d3580 0x7fc910151b80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.661+0000 7fc91528b640 1 --2- 172.21.15.18:0/299292448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9100cef70 0x7fc9100ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.661+0000 7fc91528b640 1 -- 172.21.15.18:0/299292448 >> 172.21.15.18:0/299292448 conn(0x7fc910073f30 msgr2=0x7fc9100d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.662+0000 7fc91528b640 1 -- 172.21.15.18:0/299292448 shutdown_connections 2024-09-21T07:11:12.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.662+0000 7fc91528b640 1 -- 172.21.15.18:0/299292448 wait complete. 2024-09-21T07:11:12.675 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:11:12.675 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:11:12.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.790+0000 7fbdc964d640 1 -- 172.21.15.18:0/1903502827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdac003ff0 msgr2=0x7fbdac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:12.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.790+0000 7fbdc964d640 1 --2- 172.21.15.18:0/1903502827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdac003ff0 0x7fbdac004800 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40b3fa0 tx=0x7fbdac005830 comp rx=0 tx=0).stop 2024-09-21T07:11:12.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.790+0000 7fbdc37fe640 1 -- 172.21.15.18:0/1903502827 reap_dead start 2024-09-21T07:11:12.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.790+0000 7fbdc964d640 1 -- 172.21.15.18:0/1903502827 shutdown_connections 2024-09-21T07:11:12.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.790+0000 7fbdc964d640 1 -- 172.21.15.18:0/1903502827 >> 172.21.15.18:0/1903502827 conn(0x7fbdc4073f30 msgr2=0x7fbdc40b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:12.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.791+0000 7fbdc964d640 1 -- 172.21.15.18:0/1903502827 shutdown_connections 2024-09-21T07:11:12.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.791+0000 7fbdc964d640 1 -- 172.21.15.18:0/1903502827 wait complete. 2024-09-21T07:11:12.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.792+0000 7fbdc964d640 1 Processor -- start 2024-09-21T07:11:12.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.793+0000 7fbdc964d640 1 -- start start 2024-09-21T07:11:12.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc964d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdac003ff0 0x7fbdc41f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:12.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc964d640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbdc41f6190 0x7fbdc40cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:12.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc964d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdc40cd910 0x7fbdc415cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:12.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc964d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4163100 con 0x7fbdac003ff0 2024-09-21T07:11:12.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc964d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4162f80 con 0x7fbdc40cd910 2024-09-21T07:11:12.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc964d640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc4163280 con 0x7fbdc41f6190 2024-09-21T07:11:12.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdac003ff0 0x7fbdc41f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:12.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdac003ff0 0x7fbdc41f5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54184/0 (socket says 172.21.15.18:54184) 2024-09-21T07:11:12.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc2ffd640 1 -- 172.21.15.18:0/823089572 learned_addr learned my addr 172.21.15.18:0/823089572 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:12.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc27fc640 1 --2- 172.21.15.18:0/823089572 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbdc41f6190 0x7fbdc40cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:12.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc37fe640 1 --2- 172.21.15.18:0/823089572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdc40cd910 0x7fbdc415cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:12.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc2ffd640 1 -- 172.21.15.18:0/823089572 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbdc41f6190 msgr2=0x7fbdc40cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:12.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc2ffd640 1 --2- 172.21.15.18:0/823089572 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbdc41f6190 0x7fbdc40cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc2ffd640 1 -- 172.21.15.18:0/823089572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdc40cd910 msgr2=0x7fbdc415cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:12.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc2ffd640 1 --2- 172.21.15.18:0/823089572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdc40cd910 0x7fbdc415cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:12.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc2ffd640 1 -- 172.21.15.18:0/823089572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc40cb9b0 con 0x7fbdac003ff0 2024-09-21T07:11:12.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc27fc640 1 --2- 172.21.15.18:0/823089572 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbdc41f6190 0x7fbdc40cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:12.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.794+0000 7fbdc2ffd640 1 --2- 172.21.15.18:0/823089572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdac003ff0 0x7fbdc41f5c50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4000fb0 tx=0x7fbdb400eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:12.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.795+0000 7fbdab7fe640 1 -- 172.21.15.18:0/823089572 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4015070 con 0x7fbdac003ff0 2024-09-21T07:11:12.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.795+0000 7fbdab7fe640 1 -- 172.21.15.18:0/823089572 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdb400ca60 con 0x7fbdac003ff0 2024-09-21T07:11:12.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.795+0000 7fbdc964d640 1 -- 172.21.15.18:0/823089572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc40cbc90 con 0x7fbdac003ff0 2024-09-21T07:11:12.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.795+0000 7fbdab7fe640 1 -- 172.21.15.18:0/823089572 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400ce30 con 0x7fbdac003ff0 2024-09-21T07:11:12.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.795+0000 7fbdc964d640 1 -- 172.21.15.18:0/823089572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc40cc250 con 0x7fbdac003ff0 2024-09-21T07:11:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.796+0000 7fbdc964d640 1 -- 172.21.15.18:0/823089572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc4162a40 con 0x7fbdac003ff0 2024-09-21T07:11:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.796+0000 7fbdab7fe640 1 -- 172.21.15.18:0/823089572 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbdb4018070 con 0x7fbdac003ff0 2024-09-21T07:11:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.797+0000 7fbdab7fe640 1 --2- 172.21.15.18:0/823089572 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbdb0078bc0 0x7fbdb007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.797+0000 7fbdab7fe640 1 -- 172.21.15.18:0/823089572 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbdb409b210 con 0x7fbdac003ff0 2024-09-21T07:11:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.797+0000 7fbdc27fc640 1 --2- 172.21.15.18:0/823089572 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbdb0078bc0 0x7fbdb007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.798+0000 7fbdc27fc640 1 --2- 172.21.15.18:0/823089572 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbdb0078bc0 0x7fbdb007b0d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8035000 tx=0x7fbdb802d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:12.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:12.801+0000 7fbdab7fe640 1 -- 172.21.15.18:0/823089572 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbdb4063650 con 0x7fbdac003ff0 2024-09-21T07:11:13.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.026+0000 7fbdc964d640 1 -- 172.21.15.18:0/823089572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbdc40d1680 con 0x7fbdac003ff0 2024-09-21T07:11:13.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.026+0000 7fbdab7fe640 1 -- 172.21.15.18:0/823089572 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5214 (secure 0 0 0) 0x7fbdb4062f50 con 0x7fbdac003ff0 2024-09-21T07:11:13.028 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:13.028 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"btime":"2024-09-21T07:10:46:409212+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/760501489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":760501489},{"type":"v1","addr":"172.21.15.49:6835","nonce":760501489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2249656343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2249656343},{"type":"v1","addr":"172.21.15.49:6837","nonce":2249656343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2651218421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2651218421},{"type":"v1","addr":"172.21.15.18:6834","nonce":2651218421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:10:42.833958+0000","modified":"2024-09-21T07:10:45.793498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2785506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2785506081},{"type":"v1","addr":"172.21.15.18:6835","nonce":2785506081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":1}]} 2024-09-21T07:11:13.028 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2024-09-21T07:11:13.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.028+0000 7fbdc964d640 1 -- 172.21.15.18:0/823089572 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbdb0078bc0 msgr2=0x7fbdb007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.028+0000 7fbdc964d640 1 --2- 172.21.15.18:0/823089572 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbdb0078bc0 0x7fbdb007b0d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8035000 tx=0x7fbdb802d040 comp rx=0 tx=0).stop 2024-09-21T07:11:13.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.028+0000 7fbdc964d640 1 -- 172.21.15.18:0/823089572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdac003ff0 msgr2=0x7fbdc41f5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.028+0000 7fbdc964d640 1 --2- 172.21.15.18:0/823089572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdac003ff0 0x7fbdc41f5c50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4000fb0 tx=0x7fbdb400eab0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.029+0000 7fbdc964d640 1 -- 172.21.15.18:0/823089572 shutdown_connections 2024-09-21T07:11:13.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.029+0000 7fbdc964d640 1 --2- 172.21.15.18:0/823089572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbdc40cd910 0x7fbdc415cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.029+0000 7fbdc964d640 1 --2- 172.21.15.18:0/823089572 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbdb0078bc0 0x7fbdb007b0d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.029+0000 7fbdc964d640 1 --2- 172.21.15.18:0/823089572 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbdc41f6190 0x7fbdc40cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.029+0000 7fbdc964d640 1 --2- 172.21.15.18:0/823089572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdac003ff0 0x7fbdc41f5c50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.029+0000 7fbdc964d640 1 -- 172.21.15.18:0/823089572 >> 172.21.15.18:0/823089572 conn(0x7fbdc4073f30 msgr2=0x7fbdc40b9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:13.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.029+0000 7fbdc964d640 1 -- 172.21.15.18:0/823089572 shutdown_connections 2024-09-21T07:11:13.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.029+0000 7fbdc964d640 1 -- 172.21.15.18:0/823089572 wait complete. 2024-09-21T07:11:13.042 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:11:13.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.156+0000 7fe2ddd57640 1 -- 172.21.15.18:0/636584766 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe2d815ef50 msgr2=0x7fe2d815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.156+0000 7fe2ddd57640 1 --2- 172.21.15.18:0/636584766 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe2d815ef50 0x7fe2d815c520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8005fd0 tx=0x7fe2c802a5d0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.157+0000 7fe2ddd57640 1 -- 172.21.15.18:0/636584766 shutdown_connections 2024-09-21T07:11:13.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.157+0000 7fe2ddd57640 1 --2- 172.21.15.18:0/636584766 >> v2:172.21.15.49:3300/0 conn(0x7fe2d8162a40 0x7fe2d8162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.157+0000 7fe2ddd57640 1 --2- 172.21.15.18:0/636584766 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe2d815ef50 0x7fe2d815c520 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.157+0000 7fe2ddd57640 1 -- 172.21.15.18:0/636584766 >> 172.21.15.18:0/636584766 conn(0x7fe2d8073f30 msgr2=0x7fe2d80b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:13.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.157+0000 7fe2ddd57640 1 -- 172.21.15.18:0/636584766 shutdown_connections 2024-09-21T07:11:13.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.157+0000 7fe2ddd57640 1 -- 172.21.15.18:0/636584766 wait complete. 2024-09-21T07:11:13.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.158+0000 7fe2ddd57640 1 Processor -- start 2024-09-21T07:11:13.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.159+0000 7fe2ddd57640 1 -- start start 2024-09-21T07:11:13.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.160+0000 7fe2ddd57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2d80cef70 0x7fe2d81f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.160+0000 7fe2ddd57640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2d815ef50 0x7fe2d815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.160+0000 7fe2ddd57640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe2d8162a40 0x7fe2d81f9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.160+0000 7fe2ddd57640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d80d11a0 con 0x7fe2d80cef70 2024-09-21T07:11:13.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.160+0000 7fe2ddd57640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d80d1020 con 0x7fe2d815ef50 2024-09-21T07:11:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.160+0000 7fe2ddd57640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d80d1320 con 0x7fe2d8162a40 2024-09-21T07:11:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.160+0000 7fe2d77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2d80cef70 0x7fe2d81f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.160+0000 7fe2d77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2d80cef70 0x7fe2d81f5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54192/0 (socket says 172.21.15.18:54192) 2024-09-21T07:11:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.160+0000 7fe2d77fe640 1 -- 172.21.15.18:0/2069935361 learned_addr learned my addr 172.21.15.18:0/2069935361 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.160+0000 7fe2d7fff640 1 --2- 172.21.15.18:0/2069935361 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe2d8162a40 0x7fe2d81f9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.160+0000 7fe2d6ffd640 1 --2- 172.21.15.18:0/2069935361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2d815ef50 0x7fe2d815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.160+0000 7fe2d77fe640 1 -- 172.21.15.18:0/2069935361 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe2d8162a40 msgr2=0x7fe2d81f9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.160+0000 7fe2d77fe640 1 --2- 172.21.15.18:0/2069935361 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe2d8162a40 0x7fe2d81f9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.161+0000 7fe2d77fe640 1 -- 172.21.15.18:0/2069935361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2d815ef50 msgr2=0x7fe2d815ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.161+0000 7fe2d77fe640 1 --2- 172.21.15.18:0/2069935361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2d815ef50 0x7fe2d815ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.161+0000 7fe2d77fe640 1 -- 172.21.15.18:0/2069935361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d81f6380 con 0x7fe2d80cef70 2024-09-21T07:11:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.161+0000 7fe2d77fe640 1 --2- 172.21.15.18:0/2069935361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2d80cef70 0x7fe2d81f5a60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8034040 tx=0x7fe2c80035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.161+0000 7fe2bffff640 1 -- 172.21.15.18:0/2069935361 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c803e030 con 0x7fe2d80cef70 2024-09-21T07:11:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.161+0000 7fe2bffff640 1 -- 172.21.15.18:0/2069935361 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2c8003ae0 con 0x7fe2d80cef70 2024-09-21T07:11:13.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.161+0000 7fe2ddd57640 1 -- 172.21.15.18:0/2069935361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d81f6660 con 0x7fe2d80cef70 2024-09-21T07:11:13.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.161+0000 7fe2bffff640 1 -- 172.21.15.18:0/2069935361 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8035040 con 0x7fe2d80cef70 2024-09-21T07:11:13.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.161+0000 7fe2ddd57640 1 -- 172.21.15.18:0/2069935361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d81f9350 con 0x7fe2d80cef70 2024-09-21T07:11:13.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.162+0000 7fe2ddd57640 1 -- 172.21.15.18:0/2069935361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d80d1800 con 0x7fe2d80cef70 2024-09-21T07:11:13.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.163+0000 7fe2bffff640 1 -- 172.21.15.18:0/2069935361 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe2c8041030 con 0x7fe2d80cef70 2024-09-21T07:11:13.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.163+0000 7fe2bffff640 1 --2- 172.21.15.18:0/2069935361 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe2c4078b90 0x7fe2c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.163+0000 7fe2bffff640 1 -- 172.21.15.18:0/2069935361 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe2c80bb160 con 0x7fe2d80cef70 2024-09-21T07:11:13.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.164+0000 7fe2d6ffd640 1 --2- 172.21.15.18:0/2069935361 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe2c4078b90 0x7fe2c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.164+0000 7fe2d6ffd640 1 --2- 172.21.15.18:0/2069935361 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe2c4078b90 0x7fe2c407b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80cb6d0 tx=0x7fe2cc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:13.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.168+0000 7fe2bffff640 1 -- 172.21.15.18:0/2069935361 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe2c8082ff0 con 0x7fe2d80cef70 2024-09-21T07:11:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.397+0000 7fe2ddd57640 1 -- 172.21.15.18:0/2069935361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2d815c040 con 0x7fe2d80cef70 2024-09-21T07:11:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.398+0000 7fe2bffff640 1 -- 172.21.15.18:0/2069935361 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5214 (secure 0 0 0) 0x7fe2c8087a20 con 0x7fe2d80cef70 2024-09-21T07:11:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:13.400 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"btime":"2024-09-21T07:10:46:409212+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4331,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/760501489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":760501489},{"type":"v1","addr":"172.21.15.49:6835","nonce":760501489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4334,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2249656343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2249656343},{"type":"v1","addr":"172.21.15.49:6837","nonce":2249656343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2651218421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2651218421},{"type":"v1","addr":"172.21.15.18:6834","nonce":2651218421}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:10:42.833958+0000","modified":"2024-09-21T07:10:45.793498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4395},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4395":{"gid":4395,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2785506081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2785506081},{"type":"v1","addr":"172.21.15.18:6835","nonce":2785506081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4395,"qdb_cluster":[4395]},"id":1}]} 2024-09-21T07:11:13.400 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2024-09-21T07:11:13.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.400+0000 7fe2ddd57640 1 -- 172.21.15.18:0/2069935361 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe2c4078b90 msgr2=0x7fe2c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.400+0000 7fe2ddd57640 1 --2- 172.21.15.18:0/2069935361 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe2c4078b90 0x7fe2c407b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80cb6d0 tx=0x7fe2cc009040 comp rx=0 tx=0).stop 2024-09-21T07:11:13.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.400+0000 7fe2ddd57640 1 -- 172.21.15.18:0/2069935361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2d80cef70 msgr2=0x7fe2d81f5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.400+0000 7fe2ddd57640 1 --2- 172.21.15.18:0/2069935361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2d80cef70 0x7fe2d81f5a60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8034040 tx=0x7fe2c80035f0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.400+0000 7fe2ddd57640 1 -- 172.21.15.18:0/2069935361 shutdown_connections 2024-09-21T07:11:13.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.400+0000 7fe2ddd57640 1 --2- 172.21.15.18:0/2069935361 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fe2c4078b90 0x7fe2c407b0a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.400+0000 7fe2ddd57640 1 --2- 172.21.15.18:0/2069935361 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fe2d8162a40 0x7fe2d81f9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.400+0000 7fe2ddd57640 1 --2- 172.21.15.18:0/2069935361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2d815ef50 0x7fe2d815ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.400+0000 7fe2ddd57640 1 --2- 172.21.15.18:0/2069935361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2d80cef70 0x7fe2d81f5a60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.400+0000 7fe2ddd57640 1 -- 172.21.15.18:0/2069935361 >> 172.21.15.18:0/2069935361 conn(0x7fe2d8073f30 msgr2=0x7fe2d815d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:13.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.401+0000 7fe2ddd57640 1 -- 172.21.15.18:0/2069935361 shutdown_connections 2024-09-21T07:11:13.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.401+0000 7fe2ddd57640 1 -- 172.21.15.18:0/2069935361 wait complete. 2024-09-21T07:11:13.414 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:11:13.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.528+0000 7f09fc5ad640 1 -- 172.21.15.18:0/3040858488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09f415ef50 msgr2=0x7f09f415c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.528+0000 7f09fc5ad640 1 --2- 172.21.15.18:0/3040858488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09f415ef50 0x7f09f415c520 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f09f40d2570 tx=0x7f09f002a560 comp rx=0 tx=0).stop 2024-09-21T07:11:13.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.528+0000 7f09fc5ad640 1 -- 172.21.15.18:0/3040858488 shutdown_connections 2024-09-21T07:11:13.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.528+0000 7f09fc5ad640 1 --2- 172.21.15.18:0/3040858488 >> v2:172.21.15.49:3300/0 conn(0x7f09f4162a40 0x7f09f4162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.528+0000 7f09fc5ad640 1 --2- 172.21.15.18:0/3040858488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09f415ef50 0x7f09f415c520 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.528+0000 7f09fc5ad640 1 -- 172.21.15.18:0/3040858488 >> 172.21.15.18:0/3040858488 conn(0x7f09f4073f30 msgr2=0x7f09f40b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:13.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.528+0000 7f09fc5ad640 1 -- 172.21.15.18:0/3040858488 shutdown_connections 2024-09-21T07:11:13.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.528+0000 7f09fc5ad640 1 -- 172.21.15.18:0/3040858488 wait complete. 2024-09-21T07:11:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.530+0000 7f09fc5ad640 1 Processor -- start 2024-09-21T07:11:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.530+0000 7f09fc5ad640 1 -- start start 2024-09-21T07:11:13.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fc5ad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09f40cef70 0x7f09f40ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fc5ad640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f09f415ef50 0x7f09f4151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fc5ad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f4162a40 0x7f09f40cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fc5ad640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f09f40d11a0 con 0x7f09f40cef70 2024-09-21T07:11:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fc5ad640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f09f40d1020 con 0x7f09f4162a40 2024-09-21T07:11:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fc5ad640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f09f40d1320 con 0x7f09f415ef50 2024-09-21T07:11:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fa349640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09f40cef70 0x7f09f40ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fa349640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09f40cef70 0x7f09f40ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54218/0 (socket says 172.21.15.18:54218) 2024-09-21T07:11:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fa349640 1 -- 172.21.15.18:0/1186098808 learned_addr learned my addr 172.21.15.18:0/1186098808 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fab4a640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f4162a40 0x7f09f40cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09f9b48640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f09f415ef50 0x7f09f4151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fa349640 1 -- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f09f415ef50 msgr2=0x7f09f4151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fa349640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f09f415ef50 0x7f09f4151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fa349640 1 -- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f4162a40 msgr2=0x7f09f40cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fa349640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f4162a40 0x7f09f40cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fa349640 1 -- 172.21.15.18:0/1186098808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f40cc4b0 con 0x7f09f40cef70 2024-09-21T07:11:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fab4a640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f4162a40 0x7f09f40cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09f9b48640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f09f415ef50 0x7f09f4151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fa349640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09f40cef70 0x7f09f40ad8f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009850 tx=0x7f09f0003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09eaffd640 1 -- 172.21.15.18:0/1186098808 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f003e030 con 0x7f09f40cef70 2024-09-21T07:11:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09eaffd640 1 -- 172.21.15.18:0/1186098808 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09f0003e00 con 0x7f09f40cef70 2024-09-21T07:11:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09fc5ad640 1 -- 172.21.15.18:0/1186098808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f40cc790 con 0x7f09f40cef70 2024-09-21T07:11:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.532+0000 7f09eaffd640 1 -- 172.21.15.18:0/1186098808 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f0035040 con 0x7f09f40cef70 2024-09-21T07:11:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.533+0000 7f09fc5ad640 1 -- 172.21.15.18:0/1186098808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f40cd990 con 0x7f09f40cef70 2024-09-21T07:11:13.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.534+0000 7f09fc5ad640 1 -- 172.21.15.18:0/1186098808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f40d0230 con 0x7f09f40cef70 2024-09-21T07:11:13.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.534+0000 7f09eaffd640 1 -- 172.21.15.18:0/1186098808 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f09f0041030 con 0x7f09f40cef70 2024-09-21T07:11:13.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.535+0000 7f09eaffd640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f09d8078bc0 0x7f09d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.535+0000 7f09eaffd640 1 -- 172.21.15.18:0/1186098808 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f09f00bb590 con 0x7f09f40cef70 2024-09-21T07:11:13.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.535+0000 7f09f9b48640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f09d8078bc0 0x7f09d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.536+0000 7f09f9b48640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f09d8078bc0 0x7f09d807b0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f09f40ab320 tx=0x7f09e4008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:13.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.539+0000 7f09eaffd640 1 -- 172.21.15.18:0/1186098808 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f09f40d0230 con 0x7f09f40cef70 2024-09-21T07:11:13.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.728+0000 7f09fc5ad640 1 -- 172.21.15.18:0/1186098808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09f40d17d0 con 0x7f09f40cef70 2024-09-21T07:11:13.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.730+0000 7f09eaffd640 1 -- 172.21.15.18:0/1186098808 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f09f00838b0 con 0x7f09f40cef70 2024-09-21T07:11:13.731 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:13.732 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:10:44.397635+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:10:40.463042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:10:41.734661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.732+0000 7f09fc5ad640 1 -- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f09d8078bc0 msgr2=0x7f09d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.732+0000 7f09fc5ad640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f09d8078bc0 0x7f09d807b0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f09f40ab320 tx=0x7f09e4008040 comp rx=0 tx=0).stop 2024-09-21T07:11:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.732+0000 7f09fc5ad640 1 -- 172.21.15.18:0/1186098808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09f40cef70 msgr2=0x7f09f40ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.732+0000 7f09fc5ad640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09f40cef70 0x7f09f40ad8f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009850 tx=0x7f09f0003910 comp rx=0 tx=0).stop 2024-09-21T07:11:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.732+0000 7f09fc5ad640 1 -- 172.21.15.18:0/1186098808 shutdown_connections 2024-09-21T07:11:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.732+0000 7f09fc5ad640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f4162a40 0x7f09f40cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.732+0000 7f09fc5ad640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f09d8078bc0 0x7f09d807b0d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.732+0000 7f09fc5ad640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f09f415ef50 0x7f09f4151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.732+0000 7f09fc5ad640 1 --2- 172.21.15.18:0/1186098808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09f40cef70 0x7f09f40ad8f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.732+0000 7f09fc5ad640 1 -- 172.21.15.18:0/1186098808 >> 172.21.15.18:0/1186098808 conn(0x7f09f4073f30 msgr2=0x7f09f415cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.732+0000 7f09fc5ad640 1 -- 172.21.15.18:0/1186098808 shutdown_connections 2024-09-21T07:11:13.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.732+0000 7f09fc5ad640 1 -- 172.21.15.18:0/1186098808 wait complete. 2024-09-21T07:11:13.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:11:13.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.861+0000 7fb9820c5640 1 -- 172.21.15.18:0/1943269357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb97c0d3580 msgr2=0x7fb97c162a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.861+0000 7fb9820c5640 1 --2- 172.21.15.18:0/1943269357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb97c0d3580 0x7fb97c162a40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb974005fd0 tx=0x7fb97402a8b0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.861+0000 7fb9820c5640 1 -- 172.21.15.18:0/1943269357 shutdown_connections 2024-09-21T07:11:13.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.861+0000 7fb9820c5640 1 --2- 172.21.15.18:0/1943269357 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb97c0d3580 0x7fb97c162a40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.861+0000 7fb9820c5640 1 --2- 172.21.15.18:0/1943269357 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb97c15c520 0x7fb97c0d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.861+0000 7fb9820c5640 1 -- 172.21.15.18:0/1943269357 >> 172.21.15.18:0/1943269357 conn(0x7fb97c073f30 msgr2=0x7fb97c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:13.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.861+0000 7fb9820c5640 1 -- 172.21.15.18:0/1943269357 shutdown_connections 2024-09-21T07:11:13.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.861+0000 7fb9820c5640 1 -- 172.21.15.18:0/1943269357 wait complete. 2024-09-21T07:11:13.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.863+0000 7fb9820c5640 1 Processor -- start 2024-09-21T07:11:13.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.863+0000 7fb9820c5640 1 -- start start 2024-09-21T07:11:13.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.864+0000 7fb9820c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb97c0d3580 0x7fb97c1f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.864+0000 7fb9820c5640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb97c15c520 0x7fb97c0acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.864+0000 7fb9820c5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb97c15ef50 0x7fb97c15ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.864+0000 7fb9820c5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb97c0d11a0 con 0x7fb97c0d3580 2024-09-21T07:11:13.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.864+0000 7fb9820c5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb97c0d1020 con 0x7fb97c15ef50 2024-09-21T07:11:13.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.864+0000 7fb9820c5640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fb97c0d1320 con 0x7fb97c15c520 2024-09-21T07:11:13.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.864+0000 7fb97b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb97c0d3580 0x7fb97c1f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.864+0000 7fb97b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb97c0d3580 0x7fb97c1f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54226/0 (socket says 172.21.15.18:54226) 2024-09-21T07:11:13.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.864+0000 7fb97b7fe640 1 -- 172.21.15.18:0/2745151355 learned_addr learned my addr 172.21.15.18:0/2745151355 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:13.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.864+0000 7fb97bfff640 1 --2- 172.21.15.18:0/2745151355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb97c15ef50 0x7fb97c15ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.864+0000 7fb97affd640 1 --2- 172.21.15.18:0/2745151355 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb97c15c520 0x7fb97c0acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.865+0000 7fb97b7fe640 1 -- 172.21.15.18:0/2745151355 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb97c15c520 msgr2=0x7fb97c0acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.865+0000 7fb97b7fe640 1 --2- 172.21.15.18:0/2745151355 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb97c15c520 0x7fb97c0acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.865+0000 7fb97b7fe640 1 -- 172.21.15.18:0/2745151355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb97c15ef50 msgr2=0x7fb97c15ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:13.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.865+0000 7fb97b7fe640 1 --2- 172.21.15.18:0/2745151355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb97c15ef50 0x7fb97c15ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:13.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.865+0000 7fb97b7fe640 1 -- 172.21.15.18:0/2745151355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97c1f6060 con 0x7fb97c0d3580 2024-09-21T07:11:13.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.865+0000 7fb97b7fe640 1 --2- 172.21.15.18:0/2745151355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb97c0d3580 0x7fb97c1f5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb96c00c3a0 tx=0x7fb96c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:13.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.865+0000 7fb963fff640 1 -- 172.21.15.18:0/2745151355 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96c017070 con 0x7fb97c0d3580 2024-09-21T07:11:13.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.865+0000 7fb963fff640 1 -- 172.21.15.18:0/2745151355 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb96c0053c0 con 0x7fb97c0d3580 2024-09-21T07:11:13.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.865+0000 7fb9820c5640 1 -- 172.21.15.18:0/2745151355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb97c1f6340 con 0x7fb97c0d3580 2024-09-21T07:11:13.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.865+0000 7fb963fff640 1 -- 172.21.15.18:0/2745151355 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96c003850 con 0x7fb97c0d3580 2024-09-21T07:11:13.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.865+0000 7fb9820c5640 1 -- 172.21.15.18:0/2745151355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb97c0ab330 con 0x7fb97c0d3580 2024-09-21T07:11:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.866+0000 7fb9820c5640 1 -- 172.21.15.18:0/2745151355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb97c0d17d0 con 0x7fb97c0d3580 2024-09-21T07:11:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.867+0000 7fb963fff640 1 -- 172.21.15.18:0/2745151355 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb96c01a070 con 0x7fb97c0d3580 2024-09-21T07:11:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.868+0000 7fb963fff640 1 --2- 172.21.15.18:0/2745151355 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb968078b90 0x7fb96807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.868+0000 7fb963fff640 1 -- 172.21.15.18:0/2745151355 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb96c09a050 con 0x7fb97c0d3580 2024-09-21T07:11:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.868+0000 7fb97affd640 1 --2- 172.21.15.18:0/2745151355 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb968078b90 0x7fb96807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.868+0000 7fb97affd640 1 --2- 172.21.15.18:0/2745151355 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb968078b90 0x7fb96807b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0b3370 tx=0x7fb9700091e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:13.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:13.872+0000 7fb963fff640 1 -- 172.21.15.18:0/2745151355 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb96c061e50 con 0x7fb97c0d3580 2024-09-21T07:11:14.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.097+0000 7fb9820c5640 1 -- 172.21.15.18:0/2745151355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb97c15e790 con 0x7fb97c0d3580 2024-09-21T07:11:14.099 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-21T07:11:14.098+0000 7fa1c73a1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:11:14.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.099+0000 7fb963fff640 1 -- 172.21.15.18:0/2745151355 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fb96c066880 con 0x7fb97c0d3580 2024-09-21T07:11:14.101 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:11:14.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.102+0000 7fb9820c5640 1 -- 172.21.15.18:0/2745151355 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb968078b90 msgr2=0x7fb96807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:14.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.102+0000 7fb9820c5640 1 --2- 172.21.15.18:0/2745151355 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb968078b90 0x7fb96807b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0b3370 tx=0x7fb9700091e0 comp rx=0 tx=0).stop 2024-09-21T07:11:14.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.102+0000 7fb9820c5640 1 -- 172.21.15.18:0/2745151355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb97c0d3580 msgr2=0x7fb97c1f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:14.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.102+0000 7fb9820c5640 1 --2- 172.21.15.18:0/2745151355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb97c0d3580 0x7fb97c1f5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb96c00c3a0 tx=0x7fb96c00c860 comp rx=0 tx=0).stop 2024-09-21T07:11:14.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.102+0000 7fb9820c5640 1 -- 172.21.15.18:0/2745151355 shutdown_connections 2024-09-21T07:11:14.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.102+0000 7fb9820c5640 1 --2- 172.21.15.18:0/2745151355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb97c15ef50 0x7fb97c15ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:14.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.102+0000 7fb9820c5640 1 --2- 172.21.15.18:0/2745151355 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb968078b90 0x7fb96807b0a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:14.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.102+0000 7fb9820c5640 1 --2- 172.21.15.18:0/2745151355 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb97c15c520 0x7fb97c0acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:14.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.102+0000 7fb9820c5640 1 --2- 172.21.15.18:0/2745151355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb97c0d3580 0x7fb97c1f5810 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:14.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.102+0000 7fb9820c5640 1 -- 172.21.15.18:0/2745151355 >> 172.21.15.18:0/2745151355 conn(0x7fb97c073f30 msgr2=0x7fb97c0b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:14.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.103+0000 7fb9820c5640 1 -- 172.21.15.18:0/2745151355 shutdown_connections 2024-09-21T07:11:14.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.103+0000 7fb9820c5640 1 -- 172.21.15.18:0/2745151355 wait complete. 2024-09-21T07:11:14.108 INFO:tasks.ceph.mds.a.smithi018.stderr: -6876> 2024-09-21T07:10:48.148+0000 7fe16b95a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:11:14.117 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:11:14.167 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-21T07:11:14.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.236+0000 7ffb74427640 1 -- 172.21.15.18:0/3172327446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb6c0d15a0 msgr2=0x7ffb6c0d2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:14.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.236+0000 7ffb74427640 1 --2- 172.21.15.18:0/3172327446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb6c0d15a0 0x7ffb6c0d2a30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffb64005fd0 tx=0x7ffb6402a530 comp rx=0 tx=0).stop 2024-09-21T07:11:14.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.236+0000 7ffb74427640 1 -- 172.21.15.18:0/3172327446 shutdown_connections 2024-09-21T07:11:14.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.236+0000 7ffb74427640 1 --2- 172.21.15.18:0/3172327446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb6c0d15a0 0x7ffb6c0d2a30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:14.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.236+0000 7ffb74427640 1 --2- 172.21.15.18:0/3172327446 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ffb6c15ea10 0x7ffb6c0d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:14.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.236+0000 7ffb74427640 1 -- 172.21.15.18:0/3172327446 >> 172.21.15.18:0/3172327446 conn(0x7ffb6c073f60 msgr2=0x7ffb6c0b6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:14.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.236+0000 7ffb74427640 1 -- 172.21.15.18:0/3172327446 shutdown_connections 2024-09-21T07:11:14.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.236+0000 7ffb74427640 1 -- 172.21.15.18:0/3172327446 wait complete. 2024-09-21T07:11:14.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.238+0000 7ffb74427640 1 Processor -- start 2024-09-21T07:11:14.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.238+0000 7ffb74427640 1 -- start start 2024-09-21T07:11:14.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.239+0000 7ffb74427640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb6c0b7a60 0x7ffb6c0c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:14.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.239+0000 7ffb74427640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ffb6c0d15a0 0x7ffb6c1f9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:14.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.239+0000 7ffb74427640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb6c15ea10 0x7ffb6c14a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:14.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.239+0000 7ffb74427640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c0d3440 con 0x7ffb6c15ea10 2024-09-21T07:11:14.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.239+0000 7ffb74427640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c0d32c0 con 0x7ffb6c0b7a60 2024-09-21T07:11:14.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.239+0000 7ffb74427640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6c0d35c0 con 0x7ffb6c0d15a0 2024-09-21T07:11:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.239+0000 7ffb729c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb6c15ea10 0x7ffb6c14a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.240+0000 7ffb729c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb6c15ea10 0x7ffb6c14a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54270/0 (socket says 172.21.15.18:54270) 2024-09-21T07:11:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.240+0000 7ffb729c4640 1 -- 172.21.15.18:0/2672650906 learned_addr learned my addr 172.21.15.18:0/2672650906 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.240+0000 7ffb719c2640 1 --2- 172.21.15.18:0/2672650906 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ffb6c0d15a0 0x7ffb6c1f9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.240+0000 7ffb721c3640 1 --2- 172.21.15.18:0/2672650906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb6c0b7a60 0x7ffb6c0c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.240+0000 7ffb729c4640 1 -- 172.21.15.18:0/2672650906 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ffb6c0d15a0 msgr2=0x7ffb6c1f9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.240+0000 7ffb729c4640 1 --2- 172.21.15.18:0/2672650906 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ffb6c0d15a0 0x7ffb6c1f9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.240+0000 7ffb729c4640 1 -- 172.21.15.18:0/2672650906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb6c0b7a60 msgr2=0x7ffb6c0c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.240+0000 7ffb729c4640 1 --2- 172.21.15.18:0/2672650906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb6c0b7a60 0x7ffb6c0c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.240+0000 7ffb729c4640 1 -- 172.21.15.18:0/2672650906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6c0c84c0 con 0x7ffb6c15ea10 2024-09-21T07:11:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.240+0000 7ffb729c4640 1 --2- 172.21.15.18:0/2672650906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb6c15ea10 0x7ffb6c14a8c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffb64034040 tx=0x7ffb64003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.240+0000 7ffb6affd640 1 -- 172.21.15.18:0/2672650906 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6403e030 con 0x7ffb6c15ea10 2024-09-21T07:11:14.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.240+0000 7ffb6affd640 1 -- 172.21.15.18:0/2672650906 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb64003d80 con 0x7ffb6c15ea10 2024-09-21T07:11:14.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.240+0000 7ffb74427640 1 -- 172.21.15.18:0/2672650906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6c0c87a0 con 0x7ffb6c15ea10 2024-09-21T07:11:14.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.240+0000 7ffb6affd640 1 -- 172.21.15.18:0/2672650906 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64035040 con 0x7ffb6c15ea10 2024-09-21T07:11:14.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.240+0000 7ffb74427640 1 -- 172.21.15.18:0/2672650906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb6c0c8d60 con 0x7ffb6c15ea10 2024-09-21T07:11:14.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.241+0000 7ffb74427640 1 -- 172.21.15.18:0/2672650906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb6c0b4150 con 0x7ffb6c15ea10 2024-09-21T07:11:14.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.242+0000 7ffb6affd640 1 -- 172.21.15.18:0/2672650906 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffb64041030 con 0x7ffb6c15ea10 2024-09-21T07:11:14.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.243+0000 7ffb6affd640 1 --2- 172.21.15.18:0/2672650906 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ffb58078b90 0x7ffb5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:14.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.243+0000 7ffb6affd640 1 -- 172.21.15.18:0/2672650906 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7ffb640bb520 con 0x7ffb6c15ea10 2024-09-21T07:11:14.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.243+0000 7ffb721c3640 1 --2- 172.21.15.18:0/2672650906 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ffb58078b90 0x7ffb5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:14.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.243+0000 7ffb721c3640 1 --2- 172.21.15.18:0/2672650906 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ffb58078b90 0x7ffb5807b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c006fd0 tx=0x7ffb5c009060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:14.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.247+0000 7ffb6affd640 1 -- 172.21.15.18:0/2672650906 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ffb6c0b4150 con 0x7ffb6c15ea10 2024-09-21T07:11:14.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:14.478+0000 7ffb74427640 1 -- 172.21.15.18:0/2672650906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ffb6c0d2a30 con 0x7ffb6c15ea10 2024-09-21T07:11:15.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.106+0000 7ffb6affd640 1 -- 172.21.15.18:0/2672650906 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7ffb640832b0 con 0x7ffb6c15ea10 2024-09-21T07:11:15.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.109+0000 7ffb74427640 1 -- 172.21.15.18:0/2672650906 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ffb58078b90 msgr2=0x7ffb5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:15.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.109+0000 7ffb74427640 1 --2- 172.21.15.18:0/2672650906 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ffb58078b90 0x7ffb5807b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c006fd0 tx=0x7ffb5c009060 comp rx=0 tx=0).stop 2024-09-21T07:11:15.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.109+0000 7ffb74427640 1 -- 172.21.15.18:0/2672650906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb6c15ea10 msgr2=0x7ffb6c14a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:15.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.109+0000 7ffb74427640 1 --2- 172.21.15.18:0/2672650906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb6c15ea10 0x7ffb6c14a8c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffb64034040 tx=0x7ffb64003890 comp rx=0 tx=0).stop 2024-09-21T07:11:15.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.109+0000 7ffb74427640 1 -- 172.21.15.18:0/2672650906 shutdown_connections 2024-09-21T07:11:15.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.109+0000 7ffb74427640 1 --2- 172.21.15.18:0/2672650906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb6c15ea10 0x7ffb6c14a8c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.109+0000 7ffb74427640 1 --2- 172.21.15.18:0/2672650906 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ffb58078b90 0x7ffb5807b0a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.109+0000 7ffb74427640 1 --2- 172.21.15.18:0/2672650906 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ffb6c0d15a0 0x7ffb6c1f9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.109+0000 7ffb74427640 1 --2- 172.21.15.18:0/2672650906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb6c0b7a60 0x7ffb6c0c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.109+0000 7ffb74427640 1 -- 172.21.15.18:0/2672650906 >> 172.21.15.18:0/2672650906 conn(0x7ffb6c073f60 msgr2=0x7ffb6c0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:15.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.109+0000 7ffb74427640 1 -- 172.21.15.18:0/2672650906 shutdown_connections 2024-09-21T07:11:15.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.109+0000 7ffb74427640 1 -- 172.21.15.18:0/2672650906 wait complete. 2024-09-21T07:11:15.125 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:11:15.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.252+0000 7f8a7c60e640 1 -- 172.21.15.18:0/3220013764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a60004800 msgr2=0x7f8a60004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:15.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.252+0000 7f8a7c60e640 1 --2- 172.21.15.18:0/3220013764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a60004800 0x7f8a60004c10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009b50 tx=0x7f8a60005830 comp rx=0 tx=0).stop 2024-09-21T07:11:15.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.252+0000 7f8a7c60e640 1 -- 172.21.15.18:0/3220013764 shutdown_connections 2024-09-21T07:11:15.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.252+0000 7f8a7c60e640 1 --2- 172.21.15.18:0/3220013764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a60004800 0x7f8a60004c10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.252+0000 7f8a7c60e640 1 -- 172.21.15.18:0/3220013764 >> 172.21.15.18:0/3220013764 conn(0x7f8a7409ba60 msgr2=0x7f8a740b78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:15.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.252+0000 7f8a7c60e640 1 -- 172.21.15.18:0/3220013764 shutdown_connections 2024-09-21T07:11:15.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.252+0000 7f8a7c60e640 1 -- 172.21.15.18:0/3220013764 wait complete. 2024-09-21T07:11:15.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.254+0000 7f8a7c60e640 1 Processor -- start 2024-09-21T07:11:15.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.254+0000 7f8a7c60e640 1 -- start start 2024-09-21T07:11:15.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.255+0000 7f8a7c60e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a60004800 0x7f8a7406e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:15.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.255+0000 7f8a7c60e640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8a7406cd40 0x7f8a74159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:15.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.255+0000 7f8a7c60e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a7415a2c0 0x7f8a7413ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:15.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.255+0000 7f8a7c60e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8a74070470 con 0x7f8a7415a2c0 2024-09-21T07:11:15.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.255+0000 7f8a7c60e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a74070fd0 con 0x7f8a60004800 2024-09-21T07:11:15.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.255+0000 7f8a7c60e640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f8a740705f0 con 0x7f8a7406cd40 2024-09-21T07:11:15.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.255+0000 7f8a7abab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a7415a2c0 0x7f8a7413ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:15.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.255+0000 7f8a7abab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a7415a2c0 0x7f8a7413ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54276/0 (socket says 172.21.15.18:54276) 2024-09-21T07:11:15.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.255+0000 7f8a7abab640 1 -- 172.21.15.18:0/3381898281 learned_addr learned my addr 172.21.15.18:0/3381898281 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:15.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.256+0000 7f8a79ba9640 1 --2- 172.21.15.18:0/3381898281 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8a7406cd40 0x7f8a74159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:15.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.256+0000 7f8a7a3aa640 1 --2- 172.21.15.18:0/3381898281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a60004800 0x7f8a7406e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:15.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.256+0000 7f8a7abab640 1 -- 172.21.15.18:0/3381898281 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8a7406cd40 msgr2=0x7f8a74159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:15.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.256+0000 7f8a7abab640 1 --2- 172.21.15.18:0/3381898281 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8a7406cd40 0x7f8a74159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.256+0000 7f8a7abab640 1 -- 172.21.15.18:0/3381898281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a60004800 msgr2=0x7f8a7406e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:15.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.256+0000 7f8a7abab640 1 --2- 172.21.15.18:0/3381898281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a60004800 0x7f8a7406e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:15.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.256+0000 7f8a7abab640 1 -- 172.21.15.18:0/3381898281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7406d420 con 0x7f8a7415a2c0 2024-09-21T07:11:15.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.256+0000 7f8a7a3aa640 1 --2- 172.21.15.18:0/3381898281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a60004800 0x7f8a7406e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:15.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.256+0000 7f8a7abab640 1 --2- 172.21.15.18:0/3381898281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a7415a2c0 0x7f8a7413ea50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8a7415aa90 tx=0x7f8a6c00eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:15.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.256+0000 7f8a6affd640 1 -- 172.21.15.18:0/3381898281 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00c970 con 0x7f8a7415a2c0 2024-09-21T07:11:15.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.256+0000 7f8a6affd640 1 -- 172.21.15.18:0/3381898281 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a6c018070 con 0x7f8a7415a2c0 2024-09-21T07:11:15.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.256+0000 7f8a7c60e640 1 -- 172.21.15.18:0/3381898281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7406d700 con 0x7f8a7415a2c0 2024-09-21T07:11:15.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.256+0000 7f8a6affd640 1 -- 172.21.15.18:0/3381898281 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00cea0 con 0x7f8a7415a2c0 2024-09-21T07:11:15.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.256+0000 7f8a7c60e640 1 -- 172.21.15.18:0/3381898281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a7406dcc0 con 0x7f8a7415a2c0 2024-09-21T07:11:15.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.257+0000 7f8a7c60e640 1 -- 172.21.15.18:0/3381898281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a740b18f0 con 0x7f8a7415a2c0 2024-09-21T07:11:15.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.258+0000 7f8a6affd640 1 -- 172.21.15.18:0/3381898281 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8a6c01d460 con 0x7f8a7415a2c0 2024-09-21T07:11:15.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.258+0000 7f8a6affd640 1 --2- 172.21.15.18:0/3381898281 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8a58078bc0 0x7f8a5807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:15.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.259+0000 7f8a6affd640 1 -- 172.21.15.18:0/3381898281 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f8a6c09b190 con 0x7f8a7415a2c0 2024-09-21T07:11:15.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.259+0000 7f8a7a3aa640 1 --2- 172.21.15.18:0/3381898281 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8a58078bc0 0x7f8a5807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:15.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.259+0000 7f8a7a3aa640 1 --2- 172.21.15.18:0/3381898281 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8a58078bc0 0x7f8a5807b0d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8a70000c00 tx=0x7f8a700067e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:15.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.263+0000 7f8a6affd640 1 -- 172.21.15.18:0/3381898281 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8a6c0634d0 con 0x7f8a7415a2c0 2024-09-21T07:11:15.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:15.457+0000 7f8a7c60e640 1 -- 172.21.15.18:0/3381898281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8a7415f1f0 con 0x7f8a7415a2c0 2024-09-21T07:11:16.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.107+0000 7f8a6affd640 1 -- 172.21.15.18:0/3381898281 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f8a6c062dd0 con 0x7f8a7415a2c0 2024-09-21T07:11:16.109 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:11:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.112+0000 7f8a7c60e640 1 -- 172.21.15.18:0/3381898281 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8a58078bc0 msgr2=0x7f8a5807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.113+0000 7f8a7c60e640 1 --2- 172.21.15.18:0/3381898281 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8a58078bc0 0x7f8a5807b0d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8a70000c00 tx=0x7f8a700067e0 comp rx=0 tx=0).stop 2024-09-21T07:11:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.113+0000 7f8a7c60e640 1 -- 172.21.15.18:0/3381898281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a7415a2c0 msgr2=0x7f8a7413ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.113+0000 7f8a7c60e640 1 --2- 172.21.15.18:0/3381898281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a7415a2c0 0x7f8a7413ea50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8a7415aa90 tx=0x7f8a6c00eae0 comp rx=0 tx=0).stop 2024-09-21T07:11:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.113+0000 7f8a7c60e640 1 -- 172.21.15.18:0/3381898281 shutdown_connections 2024-09-21T07:11:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.113+0000 7f8a7c60e640 1 --2- 172.21.15.18:0/3381898281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a7415a2c0 0x7f8a7413ea50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.113+0000 7f8a7c60e640 1 --2- 172.21.15.18:0/3381898281 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8a58078bc0 0x7f8a5807b0d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.113+0000 7f8a7c60e640 1 --2- 172.21.15.18:0/3381898281 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f8a7406cd40 0x7f8a74159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.113+0000 7f8a7c60e640 1 --2- 172.21.15.18:0/3381898281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a60004800 0x7f8a7406e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:16.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.113+0000 7f8a7c60e640 1 -- 172.21.15.18:0/3381898281 >> 172.21.15.18:0/3381898281 conn(0x7f8a7409ba60 msgr2=0x7f8a740b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:16.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.114+0000 7f8a7c60e640 1 -- 172.21.15.18:0/3381898281 shutdown_connections 2024-09-21T07:11:16.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.114+0000 7f8a7c60e640 1 -- 172.21.15.18:0/3381898281 wait complete. 2024-09-21T07:11:16.130 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:11:16.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.258+0000 7f494849b640 1 -- 172.21.15.18:0/288314653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f494015ef50 msgr2=0x7f494015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:16.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.258+0000 7f494849b640 1 --2- 172.21.15.18:0/288314653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f494015ef50 0x7f494015c520 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f493c005fd0 tx=0x7f493c02a530 comp rx=0 tx=0).stop 2024-09-21T07:11:16.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.258+0000 7f494849b640 1 -- 172.21.15.18:0/288314653 shutdown_connections 2024-09-21T07:11:16.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.258+0000 7f494849b640 1 --2- 172.21.15.18:0/288314653 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f49400cef70 0x7f49400d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:16.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.258+0000 7f494849b640 1 --2- 172.21.15.18:0/288314653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f494015ef50 0x7f494015c520 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:16.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.258+0000 7f494849b640 1 -- 172.21.15.18:0/288314653 >> 172.21.15.18:0/288314653 conn(0x7f4940073f30 msgr2=0x7f49400b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:16.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.258+0000 7f494849b640 1 -- 172.21.15.18:0/288314653 shutdown_connections 2024-09-21T07:11:16.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.258+0000 7f494849b640 1 -- 172.21.15.18:0/288314653 wait complete. 2024-09-21T07:11:16.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.260+0000 7f494849b640 1 Processor -- start 2024-09-21T07:11:16.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.260+0000 7f494849b640 1 -- start start 2024-09-21T07:11:16.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.261+0000 7f494849b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49400cef70 0x7f49400ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:16.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.261+0000 7f494849b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f49400d3580 0x7f4940151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:16.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.261+0000 7f494849b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f494015ef50 0x7f49400b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:16.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.261+0000 7f494849b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f49400d11a0 con 0x7f494015ef50 2024-09-21T07:11:16.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.261+0000 7f494849b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f49400d1020 con 0x7f49400cef70 2024-09-21T07:11:16.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.261+0000 7f494849b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f49400d1320 con 0x7f49400d3580 2024-09-21T07:11:16.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.261+0000 7f4946a38640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f494015ef50 0x7f49400b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:16.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.261+0000 7f4946a38640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f494015ef50 0x7f49400b54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54294/0 (socket says 172.21.15.18:54294) 2024-09-21T07:11:16.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.261+0000 7f4946a38640 1 -- 172.21.15.18:0/967967554 learned_addr learned my addr 172.21.15.18:0/967967554 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:16.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.262+0000 7f4946237640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49400cef70 0x7f49400ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:16.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.262+0000 7f4945a36640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f49400d3580 0x7f4940151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:16.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.262+0000 7f4946a38640 1 -- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f49400d3580 msgr2=0x7f4940151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:16.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.262+0000 7f4946a38640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f49400d3580 0x7f4940151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:16.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.262+0000 7f4946a38640 1 -- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49400cef70 msgr2=0x7f49400ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:16.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.262+0000 7f4946a38640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49400cef70 0x7f49400ab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:16.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.262+0000 7f4946a38640 1 -- 172.21.15.18:0/967967554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49400cd4f0 con 0x7f494015ef50 2024-09-21T07:11:16.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.262+0000 7f4946237640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49400cef70 0x7f49400ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:16.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.262+0000 7f4945a36640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f49400d3580 0x7f4940151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:16.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.262+0000 7f4946a38640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f494015ef50 0x7f49400b54b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f493800be60 tx=0x7f493800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:16.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.262+0000 7f4936ffd640 1 -- 172.21.15.18:0/967967554 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938019070 con 0x7f494015ef50 2024-09-21T07:11:16.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.262+0000 7f4936ffd640 1 -- 172.21.15.18:0/967967554 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4938014440 con 0x7f494015ef50 2024-09-21T07:11:16.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.262+0000 7f494849b640 1 -- 172.21.15.18:0/967967554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49400cd7d0 con 0x7f494015ef50 2024-09-21T07:11:16.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.262+0000 7f4936ffd640 1 -- 172.21.15.18:0/967967554 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49380148d0 con 0x7f494015ef50 2024-09-21T07:11:16.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.262+0000 7f494849b640 1 -- 172.21.15.18:0/967967554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49400cdd90 con 0x7f494015ef50 2024-09-21T07:11:16.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.263+0000 7f494849b640 1 -- 172.21.15.18:0/967967554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4940076850 con 0x7f494015ef50 2024-09-21T07:11:16.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.264+0000 7f4936ffd640 1 -- 172.21.15.18:0/967967554 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f493801c070 con 0x7f494015ef50 2024-09-21T07:11:16.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.265+0000 7f4936ffd640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4924078b90 0x7f492407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:16.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.265+0000 7f4936ffd640 1 -- 172.21.15.18:0/967967554 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7f493809abf0 con 0x7f494015ef50 2024-09-21T07:11:16.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.265+0000 7f4946237640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4924078b90 0x7f492407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:16.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.266+0000 7f4946237640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4924078b90 0x7f492407b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f493c033000 tx=0x7f493c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:16.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.269+0000 7f4936ffd640 1 -- 172.21.15.18:0/967967554 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4940076850 con 0x7f494015ef50 2024-09-21T07:11:16.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:16.455+0000 7f494849b640 1 -- 172.21.15.18:0/967967554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f49400d17d0 con 0x7f494015ef50 2024-09-21T07:11:17.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.112+0000 7f4936ffd640 1 -- 172.21.15.18:0/967967554 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7f4938063180 con 0x7f494015ef50 2024-09-21T07:11:17.114 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-21T07:11:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.117+0000 7f494849b640 1 -- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4924078b90 msgr2=0x7f492407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.117+0000 7f494849b640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4924078b90 0x7f492407b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f493c033000 tx=0x7f493c004730 comp rx=0 tx=0).stop 2024-09-21T07:11:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.117+0000 7f494849b640 1 -- 172.21.15.18:0/967967554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f494015ef50 msgr2=0x7f49400b54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.117+0000 7f494849b640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f494015ef50 0x7f49400b54b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f493800be60 tx=0x7f493800bf50 comp rx=0 tx=0).stop 2024-09-21T07:11:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.117+0000 7f494849b640 1 -- 172.21.15.18:0/967967554 shutdown_connections 2024-09-21T07:11:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.117+0000 7f494849b640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f494015ef50 0x7f49400b54b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.117+0000 7f494849b640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4924078b90 0x7f492407b0a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.117+0000 7f494849b640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f49400d3580 0x7f4940151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.117+0000 7f494849b640 1 --2- 172.21.15.18:0/967967554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49400cef70 0x7f49400ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.117+0000 7f494849b640 1 -- 172.21.15.18:0/967967554 >> 172.21.15.18:0/967967554 conn(0x7f4940073f30 msgr2=0x7f4940160080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.117+0000 7f494849b640 1 -- 172.21.15.18:0/967967554 shutdown_connections 2024-09-21T07:11:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.117+0000 7f494849b640 1 -- 172.21.15.18:0/967967554 wait complete. 2024-09-21T07:11:17.132 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:11:17.132 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:11:17.133 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:11:17.133 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:11:17.133 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:11:17.133 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:11:17.133 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:11:17.133 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:11:17.133 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:11:17.134 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:11:17.134 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:11:17.134 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:11:17.134 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:11:17.134 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:11:17.134 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:11:17.134 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:11:17.143 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:11:17.143 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:11:17.146 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:11:17.146 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:11:17.147 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:11:17.147 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:11:17.149 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:11:17.149 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:11:17.189 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:11:17.189 DEBUG:teuthology.parallel:result is None 2024-09-21T07:11:17.189 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:11:17.190 DEBUG:teuthology.parallel:result is None 2024-09-21T07:11:17.191 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:11:17.192 DEBUG:teuthology.parallel:result is None 2024-09-21T07:11:17.193 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:11:17.193 DEBUG:teuthology.parallel:result is None 2024-09-21T07:11:17.193 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:11:17.285 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-21T07:11:17.285 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-21T07:11:17.287 INFO:tasks.ceph.mds.b.smithi049.stdout:starting mds.b at 2024-09-21T07:11:17.288 INFO:tasks.ceph.mds.d.smithi049.stdout:starting mds.d at 2024-09-21T07:11:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.317+0000 7f6660869640 1 -- 172.21.15.18:0/3924316684 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f665c15ef50 msgr2=0x7f665c15c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.317+0000 7f6660869640 1 --2- 172.21.15.18:0/3924316684 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f665c15ef50 0x7f665c15c520 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f664c009830 tx=0x7f664c02a510 comp rx=0 tx=0).stop 2024-09-21T07:11:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.317+0000 7f6660869640 1 -- 172.21.15.18:0/3924316684 shutdown_connections 2024-09-21T07:11:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.317+0000 7f6660869640 1 --2- 172.21.15.18:0/3924316684 >> v2:172.21.15.18:3300/0 conn(0x7f665c162a40 0x7f665c162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.317+0000 7f6660869640 1 --2- 172.21.15.18:0/3924316684 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f665c15ef50 0x7f665c15c520 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.317+0000 7f6660869640 1 -- 172.21.15.18:0/3924316684 >> 172.21.15.18:0/3924316684 conn(0x7f665c073f30 msgr2=0x7f665c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.317+0000 7f6660869640 1 -- 172.21.15.18:0/3924316684 shutdown_connections 2024-09-21T07:11:17.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.318+0000 7f6660869640 1 -- 172.21.15.18:0/3924316684 wait complete. 2024-09-21T07:11:17.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.319+0000 7f6660869640 1 Processor -- start 2024-09-21T07:11:17.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.319+0000 7f6660869640 1 -- start start 2024-09-21T07:11:17.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f6660869640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f665c0cef70 0x7f665c0cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:17.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f6660869640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f665c15ef50 0x7f665c1f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:17.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f6660869640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c162a40 0x7f665c0b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:17.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f6660869640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f665c0d11a0 con 0x7f665c15ef50 2024-09-21T07:11:17.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f6660869640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f665c0d1020 con 0x7f665c162a40 2024-09-21T07:11:17.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f6660869640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f665c0d1320 con 0x7f665c0cef70 2024-09-21T07:11:17.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f6653fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f665c15ef50 0x7f665c1f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:17.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f665a59c640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f665c0cef70 0x7f665c0cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:17.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f6653fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f665c15ef50 0x7f665c1f84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50802/0 (socket says 172.21.15.18:50802) 2024-09-21T07:11:17.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f6653fff640 1 -- 172.21.15.18:0/2356875883 learned_addr learned my addr 172.21.15.18:0/2356875883 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:17.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f665ad9d640 1 --2- 172.21.15.18:0/2356875883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c162a40 0x7f665c0b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:17.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f6653fff640 1 -- 172.21.15.18:0/2356875883 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f665c0cef70 msgr2=0x7f665c0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:17.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f6653fff640 1 --2- 172.21.15.18:0/2356875883 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f665c0cef70 0x7f665c0cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:17.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f6653fff640 1 -- 172.21.15.18:0/2356875883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c162a40 msgr2=0x7f665c0b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:17.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f6653fff640 1 --2- 172.21.15.18:0/2356875883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c162a40 0x7f665c0b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:17.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.321+0000 7f6653fff640 1 -- 172.21.15.18:0/2356875883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c0cd110 con 0x7f665c15ef50 2024-09-21T07:11:17.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.322+0000 7f6653fff640 1 --2- 172.21.15.18:0/2356875883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f665c15ef50 0x7f665c1f84e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f664400c3c0 tx=0x7f664400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:17.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.322+0000 7f6652ffd640 1 -- 172.21.15.18:0/2356875883 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644017070 con 0x7f665c15ef50 2024-09-21T07:11:17.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.322+0000 7f6652ffd640 1 -- 172.21.15.18:0/2356875883 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66440035f0 con 0x7f665c15ef50 2024-09-21T07:11:17.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.322+0000 7f6660869640 1 -- 172.21.15.18:0/2356875883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665c0cd3f0 con 0x7f665c15ef50 2024-09-21T07:11:17.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.322+0000 7f6660869640 1 -- 172.21.15.18:0/2356875883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665c1f59b0 con 0x7f665c15ef50 2024-09-21T07:11:17.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.322+0000 7f6652ffd640 1 -- 172.21.15.18:0/2356875883 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644003a40 con 0x7f665c15ef50 2024-09-21T07:11:17.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.323+0000 7f6660869640 1 -- 172.21.15.18:0/2356875883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f665c0d1800 con 0x7f665c15ef50 2024-09-21T07:11:17.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.324+0000 7f6652ffd640 1 -- 172.21.15.18:0/2356875883 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f664401a070 con 0x7f665c15ef50 2024-09-21T07:11:17.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.325+0000 7f6652ffd640 1 --2- 172.21.15.18:0/2356875883 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f663c078bc0 0x7f663c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:17.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.325+0000 7f6652ffd640 1 -- 172.21.15.18:0/2356875883 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7f6644099f80 con 0x7f665c15ef50 2024-09-21T07:11:17.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.325+0000 7f665a59c640 1 --2- 172.21.15.18:0/2356875883 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f663c078bc0 0x7f663c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:17.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.325+0000 7f665a59c640 1 --2- 172.21.15.18:0/2356875883 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f663c078bc0 0x7f663c07b0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f664c034000 tx=0x7f664c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:17.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.329+0000 7f6652ffd640 1 -- 172.21.15.18:0/2356875883 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6644021020 con 0x7f665c15ef50 2024-09-21T07:11:17.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:17.529+0000 7f6660869640 1 -- 172.21.15.18:0/2356875883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f665c160c30 con 0x7f665c15ef50 2024-09-21T07:11:18.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.123+0000 7f6652ffd640 1 -- 172.21.15.18:0/2356875883 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7f66440620e0 con 0x7f665c15ef50 2024-09-21T07:11:18.125 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-09-21T07:11:18.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.126+0000 7f6660869640 1 -- 172.21.15.18:0/2356875883 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f663c078bc0 msgr2=0x7f663c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.126+0000 7f6660869640 1 --2- 172.21.15.18:0/2356875883 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f663c078bc0 0x7f663c07b0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f664c034000 tx=0x7f664c004730 comp rx=0 tx=0).stop 2024-09-21T07:11:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.126+0000 7f6660869640 1 -- 172.21.15.18:0/2356875883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f665c15ef50 msgr2=0x7f665c1f84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.126+0000 7f6660869640 1 --2- 172.21.15.18:0/2356875883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f665c15ef50 0x7f665c1f84e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f664400c3c0 tx=0x7f664400c880 comp rx=0 tx=0).stop 2024-09-21T07:11:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.126+0000 7f6660869640 1 -- 172.21.15.18:0/2356875883 shutdown_connections 2024-09-21T07:11:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.126+0000 7f6660869640 1 --2- 172.21.15.18:0/2356875883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f665c162a40 0x7f665c0b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.126+0000 7f6660869640 1 --2- 172.21.15.18:0/2356875883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f665c15ef50 0x7f665c1f84e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.126+0000 7f6660869640 1 --2- 172.21.15.18:0/2356875883 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f663c078bc0 0x7f663c07b0d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.126+0000 7f6660869640 1 --2- 172.21.15.18:0/2356875883 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f665c0cef70 0x7f665c0cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.126+0000 7f6660869640 1 -- 172.21.15.18:0/2356875883 >> 172.21.15.18:0/2356875883 conn(0x7f665c073f30 msgr2=0x7f665c160080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.126+0000 7f6660869640 1 -- 172.21.15.18:0/2356875883 shutdown_connections 2024-09-21T07:11:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.126+0000 7f6660869640 1 -- 172.21.15.18:0/2356875883 wait complete. 2024-09-21T07:11:18.141 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:11:18.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.257+0000 7fbe8cf8b640 1 -- 172.21.15.18:0/2770693523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8815ef50 msgr2=0x7fbe8815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:18.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.257+0000 7fbe8cf8b640 1 --2- 172.21.15.18:0/2770693523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8815ef50 0x7fbe8815c520 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbe880d2570 tx=0x7fbe7802a560 comp rx=0 tx=0).stop 2024-09-21T07:11:18.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.257+0000 7fbe8cf8b640 1 -- 172.21.15.18:0/2770693523 shutdown_connections 2024-09-21T07:11:18.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.257+0000 7fbe8cf8b640 1 --2- 172.21.15.18:0/2770693523 >> v2:172.21.15.49:3300/0 conn(0x7fbe88162a40 0x7fbe88162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.257+0000 7fbe8cf8b640 1 --2- 172.21.15.18:0/2770693523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8815ef50 0x7fbe8815c520 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.257+0000 7fbe8cf8b640 1 -- 172.21.15.18:0/2770693523 >> 172.21.15.18:0/2770693523 conn(0x7fbe88073f30 msgr2=0x7fbe880b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:18.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.257+0000 7fbe8cf8b640 1 -- 172.21.15.18:0/2770693523 shutdown_connections 2024-09-21T07:11:18.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.257+0000 7fbe8cf8b640 1 -- 172.21.15.18:0/2770693523 wait complete. 2024-09-21T07:11:18.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.259+0000 7fbe8cf8b640 1 Processor -- start 2024-09-21T07:11:18.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.259+0000 7fbe8cf8b640 1 -- start start 2024-09-21T07:11:18.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.260+0000 7fbe8cf8b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880cef70 0x7fbe880cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:18.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.260+0000 7fbe8cf8b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8815ef50 0x7fbe8814dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:18.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.260+0000 7fbe8cf8b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbe88162a40 0x7fbe880d4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:18.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.260+0000 7fbe8cf8b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbe880d11a0 con 0x7fbe8815ef50 2024-09-21T07:11:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.260+0000 7fbe8cf8b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbe880d1020 con 0x7fbe880cef70 2024-09-21T07:11:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.260+0000 7fbe8cf8b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fbe880d1320 con 0x7fbe88162a40 2024-09-21T07:11:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe85d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8815ef50 0x7fbe8814dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe85d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8815ef50 0x7fbe8814dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50816/0 (socket says 172.21.15.18:50816) 2024-09-21T07:11:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe85d9b640 1 -- 172.21.15.18:0/1227570791 learned_addr learned my addr 172.21.15.18:0/1227570791 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe8659c640 1 --2- 172.21.15.18:0/1227570791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880cef70 0x7fbe880cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe86d9d640 1 --2- 172.21.15.18:0/1227570791 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbe88162a40 0x7fbe880d4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe85d9b640 1 -- 172.21.15.18:0/1227570791 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbe88162a40 msgr2=0x7fbe880d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe85d9b640 1 --2- 172.21.15.18:0/1227570791 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbe88162a40 0x7fbe880d4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe85d9b640 1 -- 172.21.15.18:0/1227570791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880cef70 msgr2=0x7fbe880cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe85d9b640 1 --2- 172.21.15.18:0/1227570791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880cef70 0x7fbe880cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe85d9b640 1 -- 172.21.15.18:0/1227570791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe881e8de0 con 0x7fbe8815ef50 2024-09-21T07:11:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe8659c640 1 --2- 172.21.15.18:0/1227570791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880cef70 0x7fbe880cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe85d9b640 1 --2- 172.21.15.18:0/1227570791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8815ef50 0x7fbe8814dbb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000c410 tx=0x7fbe7000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:18.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe7effd640 1 -- 172.21.15.18:0/1227570791 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70017070 con 0x7fbe8815ef50 2024-09-21T07:11:18.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe7effd640 1 -- 172.21.15.18:0/1227570791 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe70005320 con 0x7fbe8815ef50 2024-09-21T07:11:18.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe8cf8b640 1 -- 172.21.15.18:0/1227570791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe881e90c0 con 0x7fbe8815ef50 2024-09-21T07:11:18.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe7effd640 1 -- 172.21.15.18:0/1227570791 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe700047f0 con 0x7fbe8815ef50 2024-09-21T07:11:18.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.261+0000 7fbe8cf8b640 1 -- 172.21.15.18:0/1227570791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe881e93a0 con 0x7fbe8815ef50 2024-09-21T07:11:18.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.262+0000 7fbe8cf8b640 1 -- 172.21.15.18:0/1227570791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe880d17d0 con 0x7fbe8815ef50 2024-09-21T07:11:18.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.263+0000 7fbe7effd640 1 -- 172.21.15.18:0/1227570791 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe7001a070 con 0x7fbe8815ef50 2024-09-21T07:11:18.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.264+0000 7fbe7effd640 1 --2- 172.21.15.18:0/1227570791 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbe68078b90 0x7fbe6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:18.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.264+0000 7fbe7effd640 1 -- 172.21.15.18:0/1227570791 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fbe7009a010 con 0x7fbe8815ef50 2024-09-21T07:11:18.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.264+0000 7fbe8659c640 1 --2- 172.21.15.18:0/1227570791 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbe68078b90 0x7fbe6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:18.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.265+0000 7fbe8659c640 1 --2- 172.21.15.18:0/1227570791 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbe68078b90 0x7fbe6807b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbe78033000 tx=0x7fbe78004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:18.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.268+0000 7fbe7effd640 1 -- 172.21.15.18:0/1227570791 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbe70062830 con 0x7fbe8815ef50 2024-09-21T07:11:18.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.531+0000 7fbe8cf8b640 1 -- 172.21.15.18:0/1227570791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fbe880d27e0 con 0x7fbe8815ef50 2024-09-21T07:11:18.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.532+0000 7fbe7effd640 1 -- 172.21.15.18:0/1227570791 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7fbe70062130 con 0x7fbe8815ef50 2024-09-21T07:11:18.533 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:18.534 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T07:11:18.534 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-09-21T07:11:18.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.534 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-09-21T07:11:18.534 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQA3ce5mK3ibMBAA7YebOqMbzm7WOKOimqHsTg==", 2024-09-21T07:11:18.534 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.534 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-21T07:11:18.534 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-21T07:11:18.534 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-21T07:11:18.534 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-21T07:11:18.534 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.535 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-09-21T07:11:18.535 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQA4ce5mbjFFAhAA2K6D9olAal5KgXqmWELojg==", 2024-09-21T07:11:18.535 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.535 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-21T07:11:18.535 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-21T07:11:18.535 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-21T07:11:18.535 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-21T07:11:18.535 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.535 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-09-21T07:11:18.535 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQA3ce5m+MZdOBAAFzOYOjjO6X0X6Q56X7MFxQ==", 2024-09-21T07:11:18.535 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.535 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-21T07:11:18.535 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-21T07:11:18.536 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-21T07:11:18.536 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-21T07:11:18.536 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.536 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-09-21T07:11:18.536 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQA4ce5mHFEbChAAl/342q1xMDq1eQUGpOaLRw==", 2024-09-21T07:11:18.536 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.536 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-21T07:11:18.536 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-21T07:11:18.536 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-21T07:11:18.536 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-21T07:11:18.536 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-09-21T07:11:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQA5ce5mLo2tLRAAbSAouEw3LrKhAotfyHDTpQ==", 2024-09-21T07:11:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-21T07:11:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-21T07:11:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-21T07:11:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-09-21T07:11:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQA9ce5mq9AJExAA4hrMJ2fG18IDgxHjQgnVaw==", 2024-09-21T07:11:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-21T07:11:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-21T07:11:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-21T07:11:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-09-21T07:11:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBAce5mU5PcMxAA0W/5NV6LL4oz3CL4Vz5g2A==", 2024-09-21T07:11:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-21T07:11:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-21T07:11:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-21T07:11:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-09-21T07:11:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBEce5majPWFxAAtM+5JisBb6qwbcOr+A9g9Q==", 2024-09-21T07:11:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-21T07:11:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-21T07:11:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-21T07:11:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-09-21T07:11:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBJce5mzwcCGRAAkG+tsd1wH6TL+nHVIoHHkQ==", 2024-09-21T07:11:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-21T07:11:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-21T07:11:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-21T07:11:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-09-21T07:11:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMce5mtttkKxAAec30vgfU90CAj72Hv4pHfQ==", 2024-09-21T07:11:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-21T07:11:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-21T07:11:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-21T07:11:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-09-21T07:11:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBQce5mEI9VARAARR+htWsJV4EXT9Qk1Rc9dw==", 2024-09-21T07:11:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-21T07:11:18.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-21T07:11:18.541 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-21T07:11:18.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.541 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-09-21T07:11:18.541 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBTce5mpDeWBBAANIi5lhBXRWVf7w1YxKc7ZQ==", 2024-09-21T07:11:18.541 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-21T07:11:18.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-21T07:11:18.541 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-21T07:11:18.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.542 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-09-21T07:11:18.542 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQA4ce5mJv7rDhAAkKNAHkkVH1tIbrRt3I1zBg==", 2024-09-21T07:11:18.542 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-21T07:11:18.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-21T07:11:18.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-21T07:11:18.542 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-21T07:11:18.542 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.542 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-09-21T07:11:18.542 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQA4ce5mLq/WFhAA6HHSKH0bTNiuPHtZUP/czg==", 2024-09-21T07:11:18.542 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-21T07:11:18.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-21T07:11:18.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-21T07:11:18.543 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-21T07:11:18.543 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.543 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-09-21T07:11:18.543 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQA4ce5muYPjEhAA1DSfHtawBY51YrYpoYoB1Q==", 2024-09-21T07:11:18.543 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-21T07:11:18.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-21T07:11:18.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-21T07:11:18.543 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-21T07:11:18.543 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.544 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-09-21T07:11:18.544 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQA4ce5mxGW3GhAAGAYa/ctLH45tnWV9GHiqYg==", 2024-09-21T07:11:18.544 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-21T07:11:18.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-21T07:11:18.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-21T07:11:18.544 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-21T07:11:18.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.544 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-09-21T07:11:18.544 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQA3ce5msS1/EhAAU5h/s5hpRwsSMWIqQmnE2Q==", 2024-09-21T07:11:18.544 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-21T07:11:18.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-21T07:11:18.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-21T07:11:18.545 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-21T07:11:18.545 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.545 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-mds", 2024-09-21T07:11:18.545 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBZce5mtOR6LBAAT04h48jmkY7OluPzpd9YPQ==", 2024-09-21T07:11:18.545 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-mds" 2024-09-21T07:11:18.545 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.545 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-mgr", 2024-09-21T07:11:18.545 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBZce5mk/d6LBAAEATuF0eMsR7X+SMMVZBsVA==", 2024-09-21T07:11:18.546 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-21T07:11:18.546 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.546 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-osd", 2024-09-21T07:11:18.546 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBZce5m7AV7LBAACHFKX384k2yYZOSmyzVpKw==", 2024-09-21T07:11:18.546 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-osd" 2024-09-21T07:11:18.546 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.546 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-rbd", 2024-09-21T07:11:18.546 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBZce5mQRV7LBAAE+pIoTRpN3m2q/+ulZk39w==", 2024-09-21T07:11:18.546 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-21T07:11:18.547 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.547 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-21T07:11:18.547 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBZce5mNCh7LBAAvh317ZWB6yiIRlT+zeaiJw==", 2024-09-21T07:11:18.547 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-21T07:11:18.547 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.547 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-rgw", 2024-09-21T07:11:18.547 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBZce5m2Dt7LBAAXso/IKsbSyaMcIWAN5BFaA==", 2024-09-21T07:11:18.547 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-21T07:11:18.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.548 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-09-21T07:11:18.548 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQA3ce5mo0CwLBAArojazCStHf7R8Fp6N8r6gg==", 2024-09-21T07:11:18.548 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-21T07:11:18.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-21T07:11:18.548 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-21T07:11:18.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:18.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:18.548 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-09-21T07:11:18.548 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQA3ce5mDa9EKBAA8u/yP/frJ9d2GvHkLfhthQ==", 2024-09-21T07:11:18.548 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-21T07:11:18.549 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-21T07:11:18.549 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-21T07:11:18.549 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-21T07:11:18.549 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.549 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:18.549 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-21T07:11:18.549 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T07:11:18.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.534+0000 7fbe8cf8b640 1 -- 172.21.15.18:0/1227570791 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbe68078b90 msgr2=0x7fbe6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:18.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.534+0000 7fbe8cf8b640 1 --2- 172.21.15.18:0/1227570791 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbe68078b90 0x7fbe6807b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbe78033000 tx=0x7fbe78004730 comp rx=0 tx=0).stop 2024-09-21T07:11:18.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.534+0000 7fbe8cf8b640 1 -- 172.21.15.18:0/1227570791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8815ef50 msgr2=0x7fbe8814dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:18.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.534+0000 7fbe8cf8b640 1 --2- 172.21.15.18:0/1227570791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8815ef50 0x7fbe8814dbb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000c410 tx=0x7fbe7000c8d0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.534+0000 7fbe8cf8b640 1 -- 172.21.15.18:0/1227570791 shutdown_connections 2024-09-21T07:11:18.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.534+0000 7fbe8cf8b640 1 --2- 172.21.15.18:0/1227570791 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbe68078b90 0x7fbe6807b0a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.534+0000 7fbe8cf8b640 1 --2- 172.21.15.18:0/1227570791 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbe88162a40 0x7fbe880d4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.534+0000 7fbe8cf8b640 1 --2- 172.21.15.18:0/1227570791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8815ef50 0x7fbe8814dbb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.534+0000 7fbe8cf8b640 1 --2- 172.21.15.18:0/1227570791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe880cef70 0x7fbe880cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.534+0000 7fbe8cf8b640 1 -- 172.21.15.18:0/1227570791 >> 172.21.15.18:0/1227570791 conn(0x7fbe88073f30 msgr2=0x7fbe880cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:18.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.534+0000 7fbe8cf8b640 1 -- 172.21.15.18:0/1227570791 shutdown_connections 2024-09-21T07:11:18.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.534+0000 7fbe8cf8b640 1 -- 172.21.15.18:0/1227570791 wait complete. 2024-09-21T07:11:18.551 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-21T07:11:18.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.668+0000 7f0c459a8640 1 -- 172.21.15.18:0/3192906866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c4015ef50 msgr2=0x7f0c4015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:18.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.668+0000 7f0c459a8640 1 --2- 172.21.15.18:0/3192906866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c4015ef50 0x7f0c4015c520 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0c400d21f0 tx=0x7f0c3002a580 comp rx=0 tx=0).stop 2024-09-21T07:11:18.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.668+0000 7f0c459a8640 1 -- 172.21.15.18:0/3192906866 shutdown_connections 2024-09-21T07:11:18.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.668+0000 7f0c459a8640 1 --2- 172.21.15.18:0/3192906866 >> v2:172.21.15.49:3300/0 conn(0x7f0c400d3580 0x7f0c40162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.668+0000 7f0c459a8640 1 --2- 172.21.15.18:0/3192906866 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0c400cef70 0x7f0c400d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.668+0000 7f0c459a8640 1 --2- 172.21.15.18:0/3192906866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c4015ef50 0x7f0c4015c520 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.668+0000 7f0c459a8640 1 -- 172.21.15.18:0/3192906866 >> 172.21.15.18:0/3192906866 conn(0x7f0c40073f30 msgr2=0x7f0c400b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:18.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.668+0000 7f0c459a8640 1 -- 172.21.15.18:0/3192906866 shutdown_connections 2024-09-21T07:11:18.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.668+0000 7f0c459a8640 1 -- 172.21.15.18:0/3192906866 wait complete. 2024-09-21T07:11:18.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.669+0000 7f0c459a8640 1 Processor -- start 2024-09-21T07:11:18.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.670+0000 7f0c459a8640 1 -- start start 2024-09-21T07:11:18.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c459a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c400cef70 0x7f0c4015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:18.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c459a8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400d3580 0x7f0c400ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:18.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c459a8640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0c4015ef50 0x7f0c401f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:18.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c459a8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0c40163420 con 0x7f0c400cef70 2024-09-21T07:11:18.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c459a8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0c401632a0 con 0x7f0c400d3580 2024-09-21T07:11:18.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c459a8640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f0c400d1020 con 0x7f0c4015ef50 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c3effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c400cef70 0x7f0c4015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c3effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c400cef70 0x7f0c4015aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50840/0 (socket says 172.21.15.18:50840) 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c3effd640 1 -- 172.21.15.18:0/2004518216 learned_addr learned my addr 172.21.15.18:0/2004518216 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c3effd640 1 -- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0c4015ef50 msgr2=0x7f0c401f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c3e7fc640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400d3580 0x7f0c400ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c3f7fe640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0c4015ef50 0x7f0c401f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c3effd640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0c4015ef50 0x7f0c401f57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c3effd640 1 -- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400d3580 msgr2=0x7f0c400ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c3effd640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400d3580 0x7f0c400ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c3effd640 1 -- 172.21.15.18:0/2004518216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c400cd3f0 con 0x7f0c400cef70 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c3f7fe640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0c4015ef50 0x7f0c401f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.671+0000 7f0c3e7fc640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400d3580 0x7f0c400ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.672+0000 7f0c3effd640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c400cef70 0x7f0c4015aed0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0c30034040 tx=0x7f0c300039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:18.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.672+0000 7f0c27fff640 1 -- 172.21.15.18:0/2004518216 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3003e030 con 0x7f0c400cef70 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.672+0000 7f0c27fff640 1 -- 172.21.15.18:0/2004518216 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c300047a0 con 0x7f0c400cef70 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.672+0000 7f0c27fff640 1 -- 172.21.15.18:0/2004518216 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c30035040 con 0x7f0c400cef70 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.672+0000 7f0c459a8640 1 -- 172.21.15.18:0/2004518216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c400cd6d0 con 0x7f0c400cef70 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.672+0000 7f0c459a8640 1 -- 172.21.15.18:0/2004518216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c400abaa0 con 0x7f0c400cef70 2024-09-21T07:11:18.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.673+0000 7f0c459a8640 1 -- 172.21.15.18:0/2004518216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c40162a40 con 0x7f0c400cef70 2024-09-21T07:11:18.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.674+0000 7f0c27fff640 1 -- 172.21.15.18:0/2004518216 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c30041030 con 0x7f0c400cef70 2024-09-21T07:11:18.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.674+0000 7f0c27fff640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0c2c078b90 0x7f0c2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:18.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.674+0000 7f0c27fff640 1 -- 172.21.15.18:0/2004518216 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f0c300bb210 con 0x7f0c400cef70 2024-09-21T07:11:18.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.675+0000 7f0c3e7fc640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0c2c078b90 0x7f0c2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:18.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.675+0000 7f0c3e7fc640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0c2c078b90 0x7f0c2c07b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0c400d0230 tx=0x7f0c34008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:18.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.679+0000 7f0c27fff640 1 -- 172.21.15.18:0/2004518216 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0c30083a30 con 0x7f0c400cef70 2024-09-21T07:11:18.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.943+0000 7f0c459a8640 1 -- 172.21.15.18:0/2004518216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f0c400cfbf0 con 0x7f0c400cef70 2024-09-21T07:11:18.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.946+0000 7f0c27fff640 1 -- 172.21.15.18:0/2004518216 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f0c30083330 con 0x7f0c400cef70 2024-09-21T07:11:18.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.948+0000 7f0c459a8640 1 -- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0c2c078b90 msgr2=0x7f0c2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:18.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.948+0000 7f0c459a8640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0c2c078b90 0x7f0c2c07b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0c400d0230 tx=0x7f0c34008040 comp rx=0 tx=0).stop 2024-09-21T07:11:18.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.948+0000 7f0c459a8640 1 -- 172.21.15.18:0/2004518216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c400cef70 msgr2=0x7f0c4015aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:18.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.948+0000 7f0c459a8640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c400cef70 0x7f0c4015aed0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0c30034040 tx=0x7f0c300039e0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.948+0000 7f0c459a8640 1 -- 172.21.15.18:0/2004518216 shutdown_connections 2024-09-21T07:11:18.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.948+0000 7f0c459a8640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0c2c078b90 0x7f0c2c07b0a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.948+0000 7f0c459a8640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f0c4015ef50 0x7f0c401f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.948+0000 7f0c459a8640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c400d3580 0x7f0c400ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.948+0000 7f0c459a8640 1 --2- 172.21.15.18:0/2004518216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c400cef70 0x7f0c4015aed0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:18.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.948+0000 7f0c459a8640 1 -- 172.21.15.18:0/2004518216 >> 172.21.15.18:0/2004518216 conn(0x7f0c40073f30 msgr2=0x7f0c400b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:18.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.948+0000 7f0c459a8640 1 -- 172.21.15.18:0/2004518216 shutdown_connections 2024-09-21T07:11:18.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:18.948+0000 7f0c459a8640 1 -- 172.21.15.18:0/2004518216 wait complete. 2024-09-21T07:11:18.961 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-21T07:11:19.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.076+0000 7fac5daf2640 1 -- 172.21.15.18:0/1028291857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac580b43e0 msgr2=0x7fac580cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:19.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.076+0000 7fac5daf2640 1 --2- 172.21.15.18:0/1028291857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac580b43e0 0x7fac580cecd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fac50005fd0 tx=0x7fac5002aa10 comp rx=0 tx=0).stop 2024-09-21T07:11:19.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.076+0000 7fac5daf2640 1 -- 172.21.15.18:0/1028291857 shutdown_connections 2024-09-21T07:11:19.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.076+0000 7fac5daf2640 1 --2- 172.21.15.18:0/1028291857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac580b43e0 0x7fac580cecd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.076+0000 7fac5daf2640 1 --2- 172.21.15.18:0/1028291857 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac5806f110 0x7fac5815c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.076+0000 7fac5daf2640 1 -- 172.21.15.18:0/1028291857 >> 172.21.15.18:0/1028291857 conn(0x7fac580b1fe0 msgr2=0x7fac580b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:19.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.076+0000 7fac5daf2640 1 -- 172.21.15.18:0/1028291857 shutdown_connections 2024-09-21T07:11:19.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.076+0000 7fac5daf2640 1 -- 172.21.15.18:0/1028291857 wait complete. 2024-09-21T07:11:19.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.078+0000 7fac5daf2640 1 Processor -- start 2024-09-21T07:11:19.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.078+0000 7fac5daf2640 1 -- start start 2024-09-21T07:11:19.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac5daf2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac5806e220 0x7fac581e6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:19.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac5daf2640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac5806f110 0x7fac581f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:19.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac5daf2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac581e7c20 0x7fac581f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac5daf2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fac580cf7e0 con 0x7fac581e7c20 2024-09-21T07:11:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac5daf2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fac580cf660 con 0x7fac5806e220 2024-09-21T07:11:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac5daf2640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fac580cf960 con 0x7fac5806f110 2024-09-21T07:11:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac57fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac581e7c20 0x7fac581f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac57fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac581e7c20 0x7fac581f5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50862/0 (socket says 172.21.15.18:50862) 2024-09-21T07:11:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac57fff640 1 -- 172.21.15.18:0/779452416 learned_addr learned my addr 172.21.15.18:0/779452416 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac577fe640 1 --2- 172.21.15.18:0/779452416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac5806e220 0x7fac581e6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac56ffd640 1 --2- 172.21.15.18:0/779452416 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac5806f110 0x7fac581f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac57fff640 1 -- 172.21.15.18:0/779452416 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac5806f110 msgr2=0x7fac581f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac57fff640 1 --2- 172.21.15.18:0/779452416 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac5806f110 0x7fac581f4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac57fff640 1 -- 172.21.15.18:0/779452416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac5806e220 msgr2=0x7fac581e6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac57fff640 1 --2- 172.21.15.18:0/779452416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac5806e220 0x7fac581e6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac57fff640 1 -- 172.21.15.18:0/779452416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac580c9660 con 0x7fac581e7c20 2024-09-21T07:11:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac57fff640 1 --2- 172.21.15.18:0/779452416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac581e7c20 0x7fac581f5340 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fac50006010 tx=0x7fac50003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac3ffff640 1 -- 172.21.15.18:0/779452416 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50046070 con 0x7fac581e7c20 2024-09-21T07:11:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac3ffff640 1 -- 172.21.15.18:0/779452416 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac50004540 con 0x7fac581e7c20 2024-09-21T07:11:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.080+0000 7fac5daf2640 1 -- 172.21.15.18:0/779452416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac580cbfc0 con 0x7fac581e7c20 2024-09-21T07:11:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.081+0000 7fac3ffff640 1 -- 172.21.15.18:0/779452416 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50033070 con 0x7fac581e7c20 2024-09-21T07:11:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.081+0000 7fac5daf2640 1 -- 172.21.15.18:0/779452416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac581e7700 con 0x7fac581e7c20 2024-09-21T07:11:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.081+0000 7fac5daf2640 1 -- 172.21.15.18:0/779452416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac580c98d0 con 0x7fac581e7c20 2024-09-21T07:11:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.082+0000 7fac3ffff640 1 -- 172.21.15.18:0/779452416 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fac50049070 con 0x7fac581e7c20 2024-09-21T07:11:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.083+0000 7fac3ffff640 1 --2- 172.21.15.18:0/779452416 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fac44078b90 0x7fac4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:19.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.083+0000 7fac3ffff640 1 -- 172.21.15.18:0/779452416 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fac500bbb30 con 0x7fac581e7c20 2024-09-21T07:11:19.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.083+0000 7fac577fe640 1 --2- 172.21.15.18:0/779452416 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fac44078b90 0x7fac4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:19.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.084+0000 7fac577fe640 1 --2- 172.21.15.18:0/779452416 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fac44078b90 0x7fac4407b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fac4800bb50 tx=0x7fac4800b2e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:19.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.087+0000 7fac3ffff640 1 -- 172.21.15.18:0/779452416 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fac5003e070 con 0x7fac581e7c20 2024-09-21T07:11:19.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.357+0000 7fac5daf2640 1 -- 172.21.15.18:0/779452416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fac580cfe10 con 0x7fac581e7c20 2024-09-21T07:11:19.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.360+0000 7fac3ffff640 1 -- 172.21.15.18:0/779452416 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fac50083c70 con 0x7fac581e7c20 2024-09-21T07:11:19.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.362+0000 7fac5daf2640 1 -- 172.21.15.18:0/779452416 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fac44078b90 msgr2=0x7fac4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:19.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.362+0000 7fac5daf2640 1 --2- 172.21.15.18:0/779452416 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fac44078b90 0x7fac4407b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fac4800bb50 tx=0x7fac4800b2e0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.362+0000 7fac5daf2640 1 -- 172.21.15.18:0/779452416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac581e7c20 msgr2=0x7fac581f5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:19.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.362+0000 7fac5daf2640 1 --2- 172.21.15.18:0/779452416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac581e7c20 0x7fac581f5340 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fac50006010 tx=0x7fac50003f10 comp rx=0 tx=0).stop 2024-09-21T07:11:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.362+0000 7fac5daf2640 1 -- 172.21.15.18:0/779452416 shutdown_connections 2024-09-21T07:11:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.362+0000 7fac5daf2640 1 --2- 172.21.15.18:0/779452416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac581e7c20 0x7fac581f5340 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.362+0000 7fac5daf2640 1 --2- 172.21.15.18:0/779452416 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fac44078b90 0x7fac4407b0a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.362+0000 7fac5daf2640 1 --2- 172.21.15.18:0/779452416 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac5806f110 0x7fac581f4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.362+0000 7fac5daf2640 1 --2- 172.21.15.18:0/779452416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac5806e220 0x7fac581e6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.362+0000 7fac5daf2640 1 -- 172.21.15.18:0/779452416 >> 172.21.15.18:0/779452416 conn(0x7fac580b1fe0 msgr2=0x7fac580d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.363+0000 7fac5daf2640 1 -- 172.21.15.18:0/779452416 shutdown_connections 2024-09-21T07:11:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.363+0000 7fac5daf2640 1 -- 172.21.15.18:0/779452416 wait complete. 2024-09-21T07:11:19.376 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-21T07:11:19.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.493+0000 7f4817f51640 1 -- 172.21.15.18:0/4198889291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47f8004d40 msgr2=0x7f47f80051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:19.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.493+0000 7f4817f51640 1 --2- 172.21.15.18:0/4198889291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47f8004d40 0x7f47f80051b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4808009b20 tx=0x7f47f8005830 comp rx=0 tx=0).stop 2024-09-21T07:11:19.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.493+0000 7f48164ee640 1 -- 172.21.15.18:0/4198889291 reap_dead start 2024-09-21T07:11:19.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.493+0000 7f4817f51640 1 -- 172.21.15.18:0/4198889291 shutdown_connections 2024-09-21T07:11:19.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.493+0000 7f4817f51640 1 -- 172.21.15.18:0/4198889291 >> 172.21.15.18:0/4198889291 conn(0x7f4810074240 msgr2=0x7f481006cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:19.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.493+0000 7f4817f51640 1 -- 172.21.15.18:0/4198889291 shutdown_connections 2024-09-21T07:11:19.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.493+0000 7f4817f51640 1 -- 172.21.15.18:0/4198889291 wait complete. 2024-09-21T07:11:19.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.495+0000 7f4817f51640 1 Processor -- start 2024-09-21T07:11:19.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.495+0000 7f4817f51640 1 -- start start 2024-09-21T07:11:19.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.496+0000 7f4817f51640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481014b250 0x7f48101411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:19.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.496+0000 7f4817f51640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4810141720 0x7f4810141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:19.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.496+0000 7f4817f51640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4810157780 0x7f4810157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:19.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.496+0000 7f4817f51640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f48100d08f0 con 0x7f481014b250 2024-09-21T07:11:19.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.496+0000 7f4817f51640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f48100cf2e0 con 0x7f4810141720 2024-09-21T07:11:19.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.496+0000 7f4817f51640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f48100d0a70 con 0x7f4810157780 2024-09-21T07:11:19.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.496+0000 7f4815ced640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481014b250 0x7f48101411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:19.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.496+0000 7f4815ced640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481014b250 0x7f48101411e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50874/0 (socket says 172.21.15.18:50874) 2024-09-21T07:11:19.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.496+0000 7f4815ced640 1 -- 172.21.15.18:0/2787632156 learned_addr learned my addr 172.21.15.18:0/2787632156 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:19.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.496+0000 7f48164ee640 1 --2- 172.21.15.18:0/2787632156 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4810157780 0x7f4810157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:19.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.496+0000 7f48154ec640 1 --2- 172.21.15.18:0/2787632156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4810141720 0x7f4810141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:19.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.497+0000 7f4815ced640 1 -- 172.21.15.18:0/2787632156 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4810157780 msgr2=0x7f4810157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:19.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.497+0000 7f4815ced640 1 --2- 172.21.15.18:0/2787632156 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4810157780 0x7f4810157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.497+0000 7f4815ced640 1 -- 172.21.15.18:0/2787632156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4810141720 msgr2=0x7f4810141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:19.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.497+0000 7f4815ced640 1 --2- 172.21.15.18:0/2787632156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4810141720 0x7f4810141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.497+0000 7f4815ced640 1 -- 172.21.15.18:0/2787632156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4810158aa0 con 0x7f481014b250 2024-09-21T07:11:19.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.497+0000 7f4815ced640 1 --2- 172.21.15.18:0/2787632156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481014b250 0x7f48101411e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4800001390 tx=0x7f48000067a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:19.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.497+0000 7f480e7fc640 1 -- 172.21.15.18:0/2787632156 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480000fb10 con 0x7f481014b250 2024-09-21T07:11:19.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.497+0000 7f480e7fc640 1 -- 172.21.15.18:0/2787632156 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4800016020 con 0x7f481014b250 2024-09-21T07:11:19.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.497+0000 7f4817f51640 1 -- 172.21.15.18:0/2787632156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4810158d80 con 0x7f481014b250 2024-09-21T07:11:19.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.497+0000 7f480e7fc640 1 -- 172.21.15.18:0/2787632156 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4800011430 con 0x7f481014b250 2024-09-21T07:11:19.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.497+0000 7f4817f51640 1 -- 172.21.15.18:0/2787632156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4810142070 con 0x7f481014b250 2024-09-21T07:11:19.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.498+0000 7f4817f51640 1 -- 172.21.15.18:0/2787632156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4810076620 con 0x7f481014b250 2024-09-21T07:11:19.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.499+0000 7f480e7fc640 1 -- 172.21.15.18:0/2787632156 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f48000115d0 con 0x7f481014b250 2024-09-21T07:11:19.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.500+0000 7f480e7fc640 1 --2- 172.21.15.18:0/2787632156 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f47fc078b90 0x7f47fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:19.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.500+0000 7f480e7fc640 1 -- 172.21.15.18:0/2787632156 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f480009b780 con 0x7f481014b250 2024-09-21T07:11:19.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.500+0000 7f48154ec640 1 --2- 172.21.15.18:0/2787632156 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f47fc078b90 0x7f47fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:19.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.501+0000 7f48154ec640 1 --2- 172.21.15.18:0/2787632156 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f47fc078b90 0x7f47fc07b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f481014b6e0 tx=0x7f4804006b10 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:19.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.504+0000 7f480e7fc640 1 -- 172.21.15.18:0/2787632156 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4810076620 con 0x7f481014b250 2024-09-21T07:11:19.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.763+0000 7f4817f51640 1 -- 172.21.15.18:0/2787632156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f48100d1000 con 0x7f481014b250 2024-09-21T07:11:19.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.766+0000 7f480e7fc640 1 -- 172.21.15.18:0/2787632156 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f4800020020 con 0x7f481014b250 2024-09-21T07:11:19.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.768+0000 7f4817f51640 1 -- 172.21.15.18:0/2787632156 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f47fc078b90 msgr2=0x7f47fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:19.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.768+0000 7f4817f51640 1 --2- 172.21.15.18:0/2787632156 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f47fc078b90 0x7f47fc07b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f481014b6e0 tx=0x7f4804006b10 comp rx=0 tx=0).stop 2024-09-21T07:11:19.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.768+0000 7f4817f51640 1 -- 172.21.15.18:0/2787632156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481014b250 msgr2=0x7f48101411e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:19.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.768+0000 7f4817f51640 1 --2- 172.21.15.18:0/2787632156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481014b250 0x7f48101411e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4800001390 tx=0x7f48000067a0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.768+0000 7f4817f51640 1 -- 172.21.15.18:0/2787632156 shutdown_connections 2024-09-21T07:11:19.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.768+0000 7f4817f51640 1 --2- 172.21.15.18:0/2787632156 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f47fc078b90 0x7f47fc07b0a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.768+0000 7f4817f51640 1 --2- 172.21.15.18:0/2787632156 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4810157780 0x7f4810157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.768+0000 7f4817f51640 1 --2- 172.21.15.18:0/2787632156 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4810141720 0x7f4810141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.768+0000 7f4817f51640 1 --2- 172.21.15.18:0/2787632156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481014b250 0x7f48101411e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.768+0000 7f4817f51640 1 -- 172.21.15.18:0/2787632156 >> 172.21.15.18:0/2787632156 conn(0x7f4810074240 msgr2=0x7f481015bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:19.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.768+0000 7f4817f51640 1 -- 172.21.15.18:0/2787632156 shutdown_connections 2024-09-21T07:11:19.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.768+0000 7f4817f51640 1 -- 172.21.15.18:0/2787632156 wait complete. 2024-09-21T07:11:19.781 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-21T07:11:19.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.897+0000 7f0949fda640 1 -- 172.21.15.18:0/2882658226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440b6200 msgr2=0x7f094406dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:19.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.897+0000 7f0949fda640 1 --2- 172.21.15.18:0/2882658226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440b6200 0x7f094406dd50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0944074bb0 tx=0x7f093802a4d0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.897+0000 7f0949fda640 1 -- 172.21.15.18:0/2882658226 shutdown_connections 2024-09-21T07:11:19.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.897+0000 7f0949fda640 1 --2- 172.21.15.18:0/2882658226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440b6200 0x7f094406dd50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.897+0000 7f0949fda640 1 --2- 172.21.15.18:0/2882658226 >> v2:172.21.15.49:3300/0 conn(0x7f09441525f0 0x7f09440b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.897+0000 7f0949fda640 1 -- 172.21.15.18:0/2882658226 >> 172.21.15.18:0/2882658226 conn(0x7f0944073340 msgr2=0x7f0944073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:19.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.897+0000 7f0949fda640 1 -- 172.21.15.18:0/2882658226 shutdown_connections 2024-09-21T07:11:19.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.897+0000 7f0949fda640 1 -- 172.21.15.18:0/2882658226 wait complete. 2024-09-21T07:11:19.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.899+0000 7f0949fda640 1 Processor -- start 2024-09-21T07:11:19.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.899+0000 7f0949fda640 1 -- start start 2024-09-21T07:11:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0949fda640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f094406e290 0x7f094414e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0949fda640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440b6200 0x7f0944158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0949fda640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f09441525f0 0x7f0944159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0949fda640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f094415f9b0 con 0x7f09440b6200 2024-09-21T07:11:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0949fda640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f09440b54c0 con 0x7f094406e290 2024-09-21T07:11:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0949fda640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f094415fb30 con 0x7f09441525f0 2024-09-21T07:11:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0942ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440b6200 0x7f0944158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0942ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440b6200 0x7f0944158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50888/0 (socket says 172.21.15.18:50888) 2024-09-21T07:11:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0942ffd640 1 -- 172.21.15.18:0/217456302 learned_addr learned my addr 172.21.15.18:0/217456302 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f09437fe640 1 --2- 172.21.15.18:0/217456302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f094406e290 0x7f094414e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0943fff640 1 --2- 172.21.15.18:0/217456302 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f09441525f0 0x7f0944159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0942ffd640 1 -- 172.21.15.18:0/217456302 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f09441525f0 msgr2=0x7f0944159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0942ffd640 1 --2- 172.21.15.18:0/217456302 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f09441525f0 0x7f0944159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0942ffd640 1 -- 172.21.15.18:0/217456302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f094406e290 msgr2=0x7f094414e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0942ffd640 1 --2- 172.21.15.18:0/217456302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f094406e290 0x7f094414e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0942ffd640 1 -- 172.21.15.18:0/217456302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0944157a50 con 0x7f09440b6200 2024-09-21T07:11:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.901+0000 7f0942ffd640 1 --2- 172.21.15.18:0/217456302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440b6200 0x7f0944158af0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0938034040 tx=0x7f09380039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.902+0000 7f092bfff640 1 -- 172.21.15.18:0/217456302 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093803e030 con 0x7f09440b6200 2024-09-21T07:11:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.902+0000 7f092bfff640 1 -- 172.21.15.18:0/217456302 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09380047a0 con 0x7f09440b6200 2024-09-21T07:11:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.902+0000 7f092bfff640 1 -- 172.21.15.18:0/217456302 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938035040 con 0x7f09440b6200 2024-09-21T07:11:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.902+0000 7f0949fda640 1 -- 172.21.15.18:0/217456302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0944157d30 con 0x7f09440b6200 2024-09-21T07:11:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.902+0000 7f0949fda640 1 -- 172.21.15.18:0/217456302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09441582f0 con 0x7f09440b6200 2024-09-21T07:11:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.903+0000 7f0949fda640 1 -- 172.21.15.18:0/217456302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09440766f0 con 0x7f09440b6200 2024-09-21T07:11:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.903+0000 7f092bfff640 1 -- 172.21.15.18:0/217456302 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0938041030 con 0x7f09440b6200 2024-09-21T07:11:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.904+0000 7f092bfff640 1 --2- 172.21.15.18:0/217456302 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0930078b90 0x7f093007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.904+0000 7f092bfff640 1 -- 172.21.15.18:0/217456302 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f09380bb220 con 0x7f09440b6200 2024-09-21T07:11:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.904+0000 7f09437fe640 1 --2- 172.21.15.18:0/217456302 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0930078b90 0x7f093007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.905+0000 7f09437fe640 1 --2- 172.21.15.18:0/217456302 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0930078b90 0x7f093007b0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0934005fd0 tx=0x7f0934009610 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:19.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:19.909+0000 7f092bfff640 1 -- 172.21.15.18:0/217456302 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0938083240 con 0x7f09440b6200 2024-09-21T07:11:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.169+0000 7f0949fda640 1 -- 172.21.15.18:0/217456302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f094415ff90 con 0x7f09440b6200 2024-09-21T07:11:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.171+0000 7f092bfff640 1 -- 172.21.15.18:0/217456302 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f09380b9e20 con 0x7f09440b6200 2024-09-21T07:11:20.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.173+0000 7f0949fda640 1 -- 172.21.15.18:0/217456302 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0930078b90 msgr2=0x7f093007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.173+0000 7f0949fda640 1 --2- 172.21.15.18:0/217456302 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0930078b90 0x7f093007b0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0934005fd0 tx=0x7f0934009610 comp rx=0 tx=0).stop 2024-09-21T07:11:20.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.173+0000 7f0949fda640 1 -- 172.21.15.18:0/217456302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440b6200 msgr2=0x7f0944158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.173+0000 7f0949fda640 1 --2- 172.21.15.18:0/217456302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440b6200 0x7f0944158af0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0938034040 tx=0x7f09380039e0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.173+0000 7f0949fda640 1 -- 172.21.15.18:0/217456302 shutdown_connections 2024-09-21T07:11:20.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.173+0000 7f0949fda640 1 --2- 172.21.15.18:0/217456302 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0930078b90 0x7f093007b0a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.173+0000 7f0949fda640 1 --2- 172.21.15.18:0/217456302 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f09441525f0 0x7f0944159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.173+0000 7f0949fda640 1 --2- 172.21.15.18:0/217456302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440b6200 0x7f0944158af0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.173+0000 7f0949fda640 1 --2- 172.21.15.18:0/217456302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f094406e290 0x7f094414e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.173+0000 7f0949fda640 1 -- 172.21.15.18:0/217456302 >> 172.21.15.18:0/217456302 conn(0x7f0944073340 msgr2=0x7f094415e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:20.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.174+0000 7f0949fda640 1 -- 172.21.15.18:0/217456302 shutdown_connections 2024-09-21T07:11:20.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.174+0000 7f0949fda640 1 -- 172.21.15.18:0/217456302 wait complete. 2024-09-21T07:11:20.187 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-21T07:11:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.302+0000 7f90b563f640 1 -- 172.21.15.18:0/2869908617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b00d3580 msgr2=0x7f90b0162a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.302+0000 7f90b563f640 1 --2- 172.21.15.18:0/2869908617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b00d3580 0x7f90b0162a40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f90a8005fd0 tx=0x7f90a802a5d0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.302+0000 7f90b563f640 1 -- 172.21.15.18:0/2869908617 shutdown_connections 2024-09-21T07:11:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.302+0000 7f90b563f640 1 --2- 172.21.15.18:0/2869908617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b00d3580 0x7f90b0162a40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.302+0000 7f90b563f640 1 --2- 172.21.15.18:0/2869908617 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f90b015c520 0x7f90b00d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.302+0000 7f90b563f640 1 -- 172.21.15.18:0/2869908617 >> 172.21.15.18:0/2869908617 conn(0x7f90b0073f30 msgr2=0x7f90b00b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.302+0000 7f90b563f640 1 -- 172.21.15.18:0/2869908617 shutdown_connections 2024-09-21T07:11:20.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.302+0000 7f90b563f640 1 -- 172.21.15.18:0/2869908617 wait complete. 2024-09-21T07:11:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.304+0000 7f90b563f640 1 Processor -- start 2024-09-21T07:11:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.304+0000 7f90b563f640 1 -- start start 2024-09-21T07:11:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90b563f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90b00d3580 0x7f90b01f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90b563f640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f90b015c520 0x7f90b00acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90b563f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b015ef50 0x7f90b015ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90b563f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f90b00d11a0 con 0x7f90b00d3580 2024-09-21T07:11:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90b563f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f90b00d1020 con 0x7f90b015ef50 2024-09-21T07:11:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90b563f640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f90b00d1320 con 0x7f90b015c520 2024-09-21T07:11:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90aeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90b00d3580 0x7f90b01f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90aeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90b00d3580 0x7f90b01f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50904/0 (socket says 172.21.15.18:50904) 2024-09-21T07:11:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90aeffd640 1 -- 172.21.15.18:0/1899465138 learned_addr learned my addr 172.21.15.18:0/1899465138 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90ae7fc640 1 --2- 172.21.15.18:0/1899465138 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f90b015c520 0x7f90b00acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90af7fe640 1 --2- 172.21.15.18:0/1899465138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b015ef50 0x7f90b015ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:20.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90aeffd640 1 -- 172.21.15.18:0/1899465138 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f90b015c520 msgr2=0x7f90b00acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90aeffd640 1 --2- 172.21.15.18:0/1899465138 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f90b015c520 0x7f90b00acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90aeffd640 1 -- 172.21.15.18:0/1899465138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b015ef50 msgr2=0x7f90b015ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90aeffd640 1 --2- 172.21.15.18:0/1899465138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b015ef50 0x7f90b015ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90aeffd640 1 -- 172.21.15.18:0/1899465138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b01f6060 con 0x7f90b00d3580 2024-09-21T07:11:20.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90aeffd640 1 --2- 172.21.15.18:0/1899465138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90b00d3580 0x7f90b01f5810 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c730 tx=0x7f90a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:20.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90977fe640 1 -- 172.21.15.18:0/1899465138 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0003b70 con 0x7f90b00d3580 2024-09-21T07:11:20.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.306+0000 7f90977fe640 1 -- 172.21.15.18:0/1899465138 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90a0003d30 con 0x7f90b00d3580 2024-09-21T07:11:20.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.307+0000 7f90977fe640 1 -- 172.21.15.18:0/1899465138 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a000aab0 con 0x7f90b00d3580 2024-09-21T07:11:20.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.307+0000 7f90b563f640 1 -- 172.21.15.18:0/1899465138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b01f6340 con 0x7f90b00d3580 2024-09-21T07:11:20.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.307+0000 7f90b563f640 1 -- 172.21.15.18:0/1899465138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b00ab330 con 0x7f90b00d3580 2024-09-21T07:11:20.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.308+0000 7f90b563f640 1 -- 172.21.15.18:0/1899465138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b00d17d0 con 0x7f90b00d3580 2024-09-21T07:11:20.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.308+0000 7f90977fe640 1 -- 172.21.15.18:0/1899465138 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f90a000ac50 con 0x7f90b00d3580 2024-09-21T07:11:20.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.309+0000 7f90977fe640 1 --2- 172.21.15.18:0/1899465138 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f909c078b90 0x7f909c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:20.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.309+0000 7f90977fe640 1 -- 172.21.15.18:0/1899465138 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f90a009a650 con 0x7f90b00d3580 2024-09-21T07:11:20.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.309+0000 7f90ae7fc640 1 --2- 172.21.15.18:0/1899465138 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f909c078b90 0x7f909c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:20.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.310+0000 7f90ae7fc640 1 --2- 172.21.15.18:0/1899465138 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f909c078b90 0x7f909c07b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f90b00b3370 tx=0x7f90a4005f30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:20.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.314+0000 7f90977fe640 1 -- 172.21.15.18:0/1899465138 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f90a0062820 con 0x7f90b00d3580 2024-09-21T07:11:20.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.576+0000 7f90b563f640 1 -- 172.21.15.18:0/1899465138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f90b015e790 con 0x7f90b00d3580 2024-09-21T07:11:20.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.579+0000 7f90977fe640 1 -- 172.21.15.18:0/1899465138 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f90a0067250 con 0x7f90b00d3580 2024-09-21T07:11:20.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.581+0000 7f90b563f640 1 -- 172.21.15.18:0/1899465138 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f909c078b90 msgr2=0x7f909c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.581+0000 7f90b563f640 1 --2- 172.21.15.18:0/1899465138 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f909c078b90 0x7f909c07b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f90b00b3370 tx=0x7f90a4005f30 comp rx=0 tx=0).stop 2024-09-21T07:11:20.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.581+0000 7f90b563f640 1 -- 172.21.15.18:0/1899465138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90b00d3580 msgr2=0x7f90b01f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.581+0000 7f90b563f640 1 --2- 172.21.15.18:0/1899465138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90b00d3580 0x7f90b01f5810 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c730 tx=0x7f90a000cbf0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.581+0000 7f90b563f640 1 -- 172.21.15.18:0/1899465138 shutdown_connections 2024-09-21T07:11:20.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.581+0000 7f90b563f640 1 --2- 172.21.15.18:0/1899465138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90b015ef50 0x7f90b015ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.581+0000 7f90b563f640 1 --2- 172.21.15.18:0/1899465138 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f909c078b90 0x7f909c07b0a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.581+0000 7f90b563f640 1 --2- 172.21.15.18:0/1899465138 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f90b015c520 0x7f90b00acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.581+0000 7f90b563f640 1 --2- 172.21.15.18:0/1899465138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90b00d3580 0x7f90b01f5810 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.581+0000 7f90b563f640 1 -- 172.21.15.18:0/1899465138 >> 172.21.15.18:0/1899465138 conn(0x7f90b0073f30 msgr2=0x7f90b00b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:20.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.581+0000 7f90b563f640 1 -- 172.21.15.18:0/1899465138 shutdown_connections 2024-09-21T07:11:20.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.581+0000 7f90b563f640 1 -- 172.21.15.18:0/1899465138 wait complete. 2024-09-21T07:11:20.594 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-21T07:11:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.710+0000 7fbf790b6640 1 -- 172.21.15.18:0/4102053825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf7415ef50 msgr2=0x7fbf7415c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.710+0000 7fbf790b6640 1 --2- 172.21.15.18:0/4102053825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf7415ef50 0x7fbf7415c520 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbf740d1fb0 tx=0x7fbf6402aa30 comp rx=0 tx=0).stop 2024-09-21T07:11:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.710+0000 7fbf790b6640 1 -- 172.21.15.18:0/4102053825 shutdown_connections 2024-09-21T07:11:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.710+0000 7fbf790b6640 1 --2- 172.21.15.18:0/4102053825 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbf740d3580 0x7fbf74162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.710+0000 7fbf790b6640 1 --2- 172.21.15.18:0/4102053825 >> v2:172.21.15.49:3300/0 conn(0x7fbf740cef70 0x7fbf740d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.710+0000 7fbf790b6640 1 --2- 172.21.15.18:0/4102053825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf7415ef50 0x7fbf7415c520 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.710+0000 7fbf790b6640 1 -- 172.21.15.18:0/4102053825 >> 172.21.15.18:0/4102053825 conn(0x7fbf74073f30 msgr2=0x7fbf740b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.710+0000 7fbf790b6640 1 -- 172.21.15.18:0/4102053825 shutdown_connections 2024-09-21T07:11:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.710+0000 7fbf790b6640 1 -- 172.21.15.18:0/4102053825 wait complete. 2024-09-21T07:11:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.712+0000 7fbf790b6640 1 Processor -- start 2024-09-21T07:11:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.712+0000 7fbf790b6640 1 -- start start 2024-09-21T07:11:20.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.713+0000 7fbf790b6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf740cef70 0x7fbf740b80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:20.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.713+0000 7fbf790b6640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbf740d3580 0x7fbf741f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:20.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.713+0000 7fbf790b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf7415ef50 0x7fbf740ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:20.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.713+0000 7fbf790b6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbf74163310 con 0x7fbf740cef70 2024-09-21T07:11:20.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.713+0000 7fbf790b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbf74163190 con 0x7fbf7415ef50 2024-09-21T07:11:20.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.713+0000 7fbf790b6640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fbf740d1020 con 0x7fbf740d3580 2024-09-21T07:11:20.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.713+0000 7fbf72d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf740cef70 0x7fbf740b80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:20.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.713+0000 7fbf72d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf740cef70 0x7fbf740b80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50934/0 (socket says 172.21.15.18:50934) 2024-09-21T07:11:20.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.713+0000 7fbf72d9d640 1 -- 172.21.15.18:0/3937792407 learned_addr learned my addr 172.21.15.18:0/3937792407 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:20.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.714+0000 7fbf7259c640 1 --2- 172.21.15.18:0/3937792407 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbf740d3580 0x7fbf741f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:20.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.714+0000 7fbf7359e640 1 --2- 172.21.15.18:0/3937792407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf7415ef50 0x7fbf740ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:20.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.714+0000 7fbf72d9d640 1 -- 172.21.15.18:0/3937792407 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbf740d3580 msgr2=0x7fbf741f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.714+0000 7fbf72d9d640 1 --2- 172.21.15.18:0/3937792407 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbf740d3580 0x7fbf741f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.714+0000 7fbf72d9d640 1 -- 172.21.15.18:0/3937792407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf7415ef50 msgr2=0x7fbf740ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.714+0000 7fbf72d9d640 1 --2- 172.21.15.18:0/3937792407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf7415ef50 0x7fbf740ab7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.714+0000 7fbf72d9d640 1 -- 172.21.15.18:0/3937792407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf740b8bb0 con 0x7fbf740cef70 2024-09-21T07:11:20.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.714+0000 7fbf7259c640 1 --2- 172.21.15.18:0/3937792407 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbf740d3580 0x7fbf741f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:20.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.714+0000 7fbf72d9d640 1 --2- 172.21.15.18:0/3937792407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf740cef70 0x7fbf740b80f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009d60 tx=0x7fbf64003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:20.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.714+0000 7fbf5b7fe640 1 -- 172.21.15.18:0/3937792407 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf64033050 con 0x7fbf740cef70 2024-09-21T07:11:20.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.714+0000 7fbf5b7fe640 1 -- 172.21.15.18:0/3937792407 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf640044f0 con 0x7fbf740cef70 2024-09-21T07:11:20.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.714+0000 7fbf790b6640 1 -- 172.21.15.18:0/3937792407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf740b8e90 con 0x7fbf740cef70 2024-09-21T07:11:20.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.714+0000 7fbf5b7fe640 1 -- 172.21.15.18:0/3937792407 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf64038450 con 0x7fbf740cef70 2024-09-21T07:11:20.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.714+0000 7fbf790b6640 1 -- 172.21.15.18:0/3937792407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf740b9450 con 0x7fbf740cef70 2024-09-21T07:11:20.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.715+0000 7fbf790b6640 1 -- 172.21.15.18:0/3937792407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf74162a40 con 0x7fbf740cef70 2024-09-21T07:11:20.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.716+0000 7fbf5b7fe640 1 -- 172.21.15.18:0/3937792407 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf64036070 con 0x7fbf740cef70 2024-09-21T07:11:20.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.716+0000 7fbf5b7fe640 1 --2- 172.21.15.18:0/3937792407 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbf60078b90 0x7fbf6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:20.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.717+0000 7fbf5b7fe640 1 -- 172.21.15.18:0/3937792407 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fbf640bbf60 con 0x7fbf740cef70 2024-09-21T07:11:20.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.717+0000 7fbf7259c640 1 --2- 172.21.15.18:0/3937792407 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbf60078b90 0x7fbf6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:20.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.717+0000 7fbf7259c640 1 --2- 172.21.15.18:0/3937792407 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbf60078b90 0x7fbf6007b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbf68005fd0 tx=0x7fbf68005e60 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:20.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.721+0000 7fbf5b7fe640 1 -- 172.21.15.18:0/3937792407 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbf64084660 con 0x7fbf740cef70 2024-09-21T07:11:20.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.982+0000 7fbf790b6640 1 -- 172.21.15.18:0/3937792407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fbf740cfbf0 con 0x7fbf740cef70 2024-09-21T07:11:20.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.985+0000 7fbf5b7fe640 1 -- 172.21.15.18:0/3937792407 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fbf64083f60 con 0x7fbf740cef70 2024-09-21T07:11:20.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.987+0000 7fbf790b6640 1 -- 172.21.15.18:0/3937792407 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbf60078b90 msgr2=0x7fbf6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.987+0000 7fbf790b6640 1 --2- 172.21.15.18:0/3937792407 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbf60078b90 0x7fbf6007b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbf68005fd0 tx=0x7fbf68005e60 comp rx=0 tx=0).stop 2024-09-21T07:11:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.987+0000 7fbf790b6640 1 -- 172.21.15.18:0/3937792407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf740cef70 msgr2=0x7fbf740b80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.987+0000 7fbf790b6640 1 --2- 172.21.15.18:0/3937792407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf740cef70 0x7fbf740b80f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009d60 tx=0x7fbf64003f10 comp rx=0 tx=0).stop 2024-09-21T07:11:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.987+0000 7fbf790b6640 1 -- 172.21.15.18:0/3937792407 shutdown_connections 2024-09-21T07:11:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.987+0000 7fbf790b6640 1 --2- 172.21.15.18:0/3937792407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf7415ef50 0x7fbf740ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.987+0000 7fbf790b6640 1 --2- 172.21.15.18:0/3937792407 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbf60078b90 0x7fbf6007b0a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.987+0000 7fbf790b6640 1 --2- 172.21.15.18:0/3937792407 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbf740d3580 0x7fbf741f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.987+0000 7fbf790b6640 1 --2- 172.21.15.18:0/3937792407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf740cef70 0x7fbf740b80f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.987+0000 7fbf790b6640 1 -- 172.21.15.18:0/3937792407 >> 172.21.15.18:0/3937792407 conn(0x7fbf74073f30 msgr2=0x7fbf7415cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.987+0000 7fbf790b6640 1 -- 172.21.15.18:0/3937792407 shutdown_connections 2024-09-21T07:11:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:20.987+0000 7fbf790b6640 1 -- 172.21.15.18:0/3937792407 wait complete. 2024-09-21T07:11:21.000 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:11:21.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.115+0000 7fee6daf9640 1 -- 172.21.15.18:0/3624149168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee6815ef50 msgr2=0x7fee6815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:21.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.115+0000 7fee6daf9640 1 --2- 172.21.15.18:0/3624149168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee6815ef50 0x7fee6815c520 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fee58005fd0 tx=0x7fee5802a5d0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.115+0000 7fee6daf9640 1 -- 172.21.15.18:0/3624149168 shutdown_connections 2024-09-21T07:11:21.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.115+0000 7fee6daf9640 1 --2- 172.21.15.18:0/3624149168 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee68162a40 0x7fee68162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.115+0000 7fee6daf9640 1 --2- 172.21.15.18:0/3624149168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee6815ef50 0x7fee6815c520 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.115+0000 7fee6daf9640 1 -- 172.21.15.18:0/3624149168 >> 172.21.15.18:0/3624149168 conn(0x7fee68073f30 msgr2=0x7fee680b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:21.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.115+0000 7fee6daf9640 1 -- 172.21.15.18:0/3624149168 shutdown_connections 2024-09-21T07:11:21.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.115+0000 7fee6daf9640 1 -- 172.21.15.18:0/3624149168 wait complete. 2024-09-21T07:11:21.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.117+0000 7fee6daf9640 1 Processor -- start 2024-09-21T07:11:21.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.117+0000 7fee6daf9640 1 -- start start 2024-09-21T07:11:21.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.118+0000 7fee6daf9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee680cef70 0x7fee681f9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:21.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.118+0000 7fee6daf9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee6815ef50 0x7fee6815ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:21.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.118+0000 7fee6daf9640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee68162a40 0x7fee680b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:21.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.118+0000 7fee6daf9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fee680d11a0 con 0x7fee6815ef50 2024-09-21T07:11:21.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.118+0000 7fee6daf9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fee680d1020 con 0x7fee680cef70 2024-09-21T07:11:21.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.118+0000 7fee6daf9640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fee680d1320 con 0x7fee68162a40 2024-09-21T07:11:21.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.118+0000 7fee66ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee6815ef50 0x7fee6815ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:21.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.119+0000 7fee66ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee6815ef50 0x7fee6815ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50960/0 (socket says 172.21.15.18:50960) 2024-09-21T07:11:21.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.119+0000 7fee66ffd640 1 -- 172.21.15.18:0/2887360363 learned_addr learned my addr 172.21.15.18:0/2887360363 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:21.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.119+0000 7fee677fe640 1 --2- 172.21.15.18:0/2887360363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee680cef70 0x7fee681f9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:21.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.119+0000 7fee67fff640 1 --2- 172.21.15.18:0/2887360363 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee68162a40 0x7fee680b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:21.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.119+0000 7fee66ffd640 1 -- 172.21.15.18:0/2887360363 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee68162a40 msgr2=0x7fee680b8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:21.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.119+0000 7fee66ffd640 1 --2- 172.21.15.18:0/2887360363 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee68162a40 0x7fee680b8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.119+0000 7fee66ffd640 1 -- 172.21.15.18:0/2887360363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee680cef70 msgr2=0x7fee681f9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:21.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.119+0000 7fee66ffd640 1 --2- 172.21.15.18:0/2887360363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee680cef70 0x7fee681f9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.119+0000 7fee66ffd640 1 -- 172.21.15.18:0/2887360363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee680abd70 con 0x7fee6815ef50 2024-09-21T07:11:21.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.119+0000 7fee66ffd640 1 --2- 172.21.15.18:0/2887360363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee6815ef50 0x7fee6815ab10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00c390 tx=0x7fee5c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:21.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.119+0000 7fee4ffff640 1 -- 172.21.15.18:0/2887360363 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c017070 con 0x7fee6815ef50 2024-09-21T07:11:21.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.119+0000 7fee4ffff640 1 -- 172.21.15.18:0/2887360363 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee5c0053c0 con 0x7fee6815ef50 2024-09-21T07:11:21.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.119+0000 7fee4ffff640 1 -- 172.21.15.18:0/2887360363 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c003850 con 0x7fee6815ef50 2024-09-21T07:11:21.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.119+0000 7fee6daf9640 1 -- 172.21.15.18:0/2887360363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee681f9a90 con 0x7fee6815ef50 2024-09-21T07:11:21.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.119+0000 7fee6daf9640 1 -- 172.21.15.18:0/2887360363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee681f58a0 con 0x7fee6815ef50 2024-09-21T07:11:21.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.120+0000 7fee6daf9640 1 -- 172.21.15.18:0/2887360363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee680ab350 con 0x7fee6815ef50 2024-09-21T07:11:21.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.121+0000 7fee4ffff640 1 -- 172.21.15.18:0/2887360363 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee5c01a070 con 0x7fee6815ef50 2024-09-21T07:11:21.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.122+0000 7fee4ffff640 1 --2- 172.21.15.18:0/2887360363 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee54078b90 0x7fee5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:21.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.122+0000 7fee4ffff640 1 -- 172.21.15.18:0/2887360363 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fee5c099d80 con 0x7fee6815ef50 2024-09-21T07:11:21.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.122+0000 7fee677fe640 1 --2- 172.21.15.18:0/2887360363 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee54078b90 0x7fee5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:21.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.123+0000 7fee677fe640 1 --2- 172.21.15.18:0/2887360363 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee54078b90 0x7fee5407b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fee58033000 tx=0x7fee58004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:21.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.126+0000 7fee4ffff640 1 -- 172.21.15.18:0/2887360363 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fee681f9a90 con 0x7fee6815ef50 2024-09-21T07:11:21.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.317+0000 7fee6daf9640 1 -- 172.21.15.18:0/2887360363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fee680d17d0 con 0x7fee6815ef50 2024-09-21T07:11:21.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.318+0000 7fee4ffff640 1 -- 172.21.15.18:0/2887360363 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7fee5c061ec0 con 0x7fee6815ef50 2024-09-21T07:11:21.320 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:21.320 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-21T07:11:21.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:21.320 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-21T07:11:21.320 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-21T07:11:21.320 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:21.320 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-21T07:11:21.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.320+0000 7fee6daf9640 1 -- 172.21.15.18:0/2887360363 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee54078b90 msgr2=0x7fee5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:21.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.320+0000 7fee6daf9640 1 --2- 172.21.15.18:0/2887360363 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee54078b90 0x7fee5407b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fee58033000 tx=0x7fee58004730 comp rx=0 tx=0).stop 2024-09-21T07:11:21.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.320+0000 7fee6daf9640 1 -- 172.21.15.18:0/2887360363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee6815ef50 msgr2=0x7fee6815ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:21.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.320+0000 7fee6daf9640 1 --2- 172.21.15.18:0/2887360363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee6815ef50 0x7fee6815ab10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00c390 tx=0x7fee5c00c850 comp rx=0 tx=0).stop 2024-09-21T07:11:21.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.320+0000 7fee6daf9640 1 -- 172.21.15.18:0/2887360363 shutdown_connections 2024-09-21T07:11:21.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.320+0000 7fee6daf9640 1 --2- 172.21.15.18:0/2887360363 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee54078b90 0x7fee5407b0a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.320+0000 7fee6daf9640 1 --2- 172.21.15.18:0/2887360363 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee68162a40 0x7fee680b8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.320+0000 7fee6daf9640 1 --2- 172.21.15.18:0/2887360363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee6815ef50 0x7fee6815ab10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.320+0000 7fee6daf9640 1 --2- 172.21.15.18:0/2887360363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee680cef70 0x7fee681f9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.320+0000 7fee6daf9640 1 -- 172.21.15.18:0/2887360363 >> 172.21.15.18:0/2887360363 conn(0x7fee68073f30 msgr2=0x7fee680b6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:21.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.320+0000 7fee6daf9640 1 -- 172.21.15.18:0/2887360363 shutdown_connections 2024-09-21T07:11:21.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.320+0000 7fee6daf9640 1 -- 172.21.15.18:0/2887360363 wait complete. 2024-09-21T07:11:21.333 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:11:21.333 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:11:21.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.452+0000 7f597309d640 1 -- 172.21.15.18:0/46233013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0d30a0 msgr2=0x7f596c15c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:21.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.452+0000 7f597309d640 1 --2- 172.21.15.18:0/46233013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0d30a0 0x7f596c15c360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f596c08d860 tx=0x7f595c02a560 comp rx=0 tx=0).stop 2024-09-21T07:11:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.452+0000 7f597309d640 1 -- 172.21.15.18:0/46233013 shutdown_connections 2024-09-21T07:11:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.452+0000 7f597309d640 1 --2- 172.21.15.18:0/46233013 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f596c0d34b0 0x7f596c0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.452+0000 7f597309d640 1 --2- 172.21.15.18:0/46233013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0d30a0 0x7f596c15c360 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.452+0000 7f597309d640 1 --2- 172.21.15.18:0/46233013 >> v2:172.21.15.49:3300/0 conn(0x7f596c162630 0x7f596c0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.452+0000 7f597309d640 1 -- 172.21.15.18:0/46233013 >> 172.21.15.18:0/46233013 conn(0x7f596c073e20 msgr2=0x7f596c06cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.452+0000 7f597309d640 1 -- 172.21.15.18:0/46233013 shutdown_connections 2024-09-21T07:11:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.452+0000 7f597309d640 1 -- 172.21.15.18:0/46233013 wait complete. 2024-09-21T07:11:21.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.454+0000 7f597309d640 1 Processor -- start 2024-09-21T07:11:21.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.454+0000 7f597309d640 1 -- start start 2024-09-21T07:11:21.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f597309d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0d30a0 0x7f596c1e8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:21.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f597309d640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f596c0d34b0 0x7f596c157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:21.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f597309d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f596c162630 0x7f596c159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:21.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f597309d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f596c0d18f0 con 0x7f596c0d30a0 2024-09-21T07:11:21.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f597309d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f596c0d1770 con 0x7f596c162630 2024-09-21T07:11:21.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f597309d640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f596c0d1a70 con 0x7f596c0d34b0 2024-09-21T07:11:21.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f5970e39640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0d30a0 0x7f596c1e8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:21.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f5970e39640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0d30a0 0x7f596c1e8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50990/0 (socket says 172.21.15.18:50990) 2024-09-21T07:11:21.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f5970e39640 1 -- 172.21.15.18:0/370873694 learned_addr learned my addr 172.21.15.18:0/370873694 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f596bfff640 1 --2- 172.21.15.18:0/370873694 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f596c0d34b0 0x7f596c157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f597163a640 1 --2- 172.21.15.18:0/370873694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f596c162630 0x7f596c159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f5970e39640 1 -- 172.21.15.18:0/370873694 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f596c0d34b0 msgr2=0x7f596c157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f5970e39640 1 --2- 172.21.15.18:0/370873694 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f596c0d34b0 0x7f596c157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f5970e39640 1 -- 172.21.15.18:0/370873694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f596c162630 msgr2=0x7f596c159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f5970e39640 1 --2- 172.21.15.18:0/370873694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f596c162630 0x7f596c159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f5970e39640 1 -- 172.21.15.18:0/370873694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c158210 con 0x7f596c0d30a0 2024-09-21T07:11:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f597163a640 1 --2- 172.21.15.18:0/370873694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f596c162630 0x7f596c159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.456+0000 7f5970e39640 1 --2- 172.21.15.18:0/370873694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0d30a0 0x7f596c1e8ed0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f595400c9a0 tx=0x7f595400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.457+0000 7f59697fa640 1 -- 172.21.15.18:0/370873694 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5954007bb0 con 0x7f596c0d30a0 2024-09-21T07:11:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.457+0000 7f59697fa640 1 -- 172.21.15.18:0/370873694 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5954007e40 con 0x7f596c0d30a0 2024-09-21T07:11:21.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.457+0000 7f597309d640 1 -- 172.21.15.18:0/370873694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596c1e9cc0 con 0x7f596c0d30a0 2024-09-21T07:11:21.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.457+0000 7f59697fa640 1 -- 172.21.15.18:0/370873694 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5954005280 con 0x7f596c0d30a0 2024-09-21T07:11:21.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.457+0000 7f597309d640 1 -- 172.21.15.18:0/370873694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596c1ea770 con 0x7f596c0d30a0 2024-09-21T07:11:21.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.458+0000 7f597309d640 1 -- 172.21.15.18:0/370873694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f596c0d1020 con 0x7f596c0d30a0 2024-09-21T07:11:21.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.459+0000 7f59697fa640 1 -- 172.21.15.18:0/370873694 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5954005420 con 0x7f596c0d30a0 2024-09-21T07:11:21.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.459+0000 7f59697fa640 1 --2- 172.21.15.18:0/370873694 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f594c078b90 0x7f594c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:21.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.459+0000 7f59697fa640 1 -- 172.21.15.18:0/370873694 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f595409ad60 con 0x7f596c0d30a0 2024-09-21T07:11:21.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.459+0000 7f596bfff640 1 --2- 172.21.15.18:0/370873694 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f594c078b90 0x7f594c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:21.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.460+0000 7f596bfff640 1 --2- 172.21.15.18:0/370873694 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f594c078b90 0x7f594c07b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f595c033000 tx=0x7f595c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:21.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.464+0000 7f59697fa640 1 -- 172.21.15.18:0/370873694 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5954014030 con 0x7f596c0d30a0 2024-09-21T07:11:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:21.651+0000 7f597309d640 1 -- 172.21.15.18:0/370873694 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f596c069870 con 0x7f596c0d30a0 2024-09-21T07:11:22.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.178+0000 7f59697fa640 1 -- 172.21.15.18:0/370873694 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7f59540636d0 con 0x7f596c0d30a0 2024-09-21T07:11:22.180 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-21T07:11:22.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.181+0000 7f597309d640 1 -- 172.21.15.18:0/370873694 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f594c078b90 msgr2=0x7f594c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:22.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.181+0000 7f597309d640 1 --2- 172.21.15.18:0/370873694 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f594c078b90 0x7f594c07b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f595c033000 tx=0x7f595c004730 comp rx=0 tx=0).stop 2024-09-21T07:11:22.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.181+0000 7f597309d640 1 -- 172.21.15.18:0/370873694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0d30a0 msgr2=0x7f596c1e8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:22.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.181+0000 7f597309d640 1 --2- 172.21.15.18:0/370873694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0d30a0 0x7f596c1e8ed0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f595400c9a0 tx=0x7f595400ce60 comp rx=0 tx=0).stop 2024-09-21T07:11:22.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.181+0000 7f597309d640 1 -- 172.21.15.18:0/370873694 shutdown_connections 2024-09-21T07:11:22.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.181+0000 7f597309d640 1 --2- 172.21.15.18:0/370873694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f596c162630 0x7f596c159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:22.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.181+0000 7f597309d640 1 --2- 172.21.15.18:0/370873694 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f594c078b90 0x7f594c07b0a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:22.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.181+0000 7f597309d640 1 --2- 172.21.15.18:0/370873694 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f596c0d34b0 0x7f596c157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:22.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.181+0000 7f597309d640 1 --2- 172.21.15.18:0/370873694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0d30a0 0x7f596c1e8ed0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:22.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.181+0000 7f597309d640 1 -- 172.21.15.18:0/370873694 >> 172.21.15.18:0/370873694 conn(0x7f596c073e20 msgr2=0x7f596c15ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:22.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.182+0000 7f597309d640 1 -- 172.21.15.18:0/370873694 shutdown_connections 2024-09-21T07:11:22.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.182+0000 7f597309d640 1 -- 172.21.15.18:0/370873694 wait complete. 2024-09-21T07:11:22.200 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:11:22.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.326+0000 7fede27ba640 1 -- 172.21.15.18:0/53630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc15ef50 msgr2=0x7feddc15c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:22.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.326+0000 7fede27ba640 1 --2- 172.21.15.18:0/53630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc15ef50 0x7feddc15c520 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fedcc005fd0 tx=0x7fedcc02a530 comp rx=0 tx=0).stop 2024-09-21T07:11:22.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.326+0000 7fede27ba640 1 -- 172.21.15.18:0/53630 shutdown_connections 2024-09-21T07:11:22.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.326+0000 7fede27ba640 1 --2- 172.21.15.18:0/53630 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7feddc0cef70 0x7feddc0d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:22.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.326+0000 7fede27ba640 1 --2- 172.21.15.18:0/53630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc15ef50 0x7feddc15c520 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:22.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.326+0000 7fede27ba640 1 -- 172.21.15.18:0/53630 >> 172.21.15.18:0/53630 conn(0x7feddc073f30 msgr2=0x7feddc0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:22.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.326+0000 7fede27ba640 1 -- 172.21.15.18:0/53630 shutdown_connections 2024-09-21T07:11:22.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.326+0000 7fede27ba640 1 -- 172.21.15.18:0/53630 wait complete. 2024-09-21T07:11:22.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.328+0000 7fede27ba640 1 Processor -- start 2024-09-21T07:11:22.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.328+0000 7fede27ba640 1 -- start start 2024-09-21T07:11:22.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.329+0000 7fede27ba640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7feddc0cef70 0x7feddc0b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:22.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.329+0000 7fede27ba640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feddc0d3580 0x7feddc158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:22.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.329+0000 7fede27ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc15ef50 0x7feddc0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:22.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.329+0000 7fede27ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feddc0d11a0 con 0x7feddc15ef50 2024-09-21T07:11:22.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.329+0000 7fede27ba640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7feddc0d1020 con 0x7feddc0d3580 2024-09-21T07:11:22.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.329+0000 7fede27ba640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7feddc0d1320 con 0x7feddc0cef70 2024-09-21T07:11:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.329+0000 7fede0d57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc15ef50 0x7feddc0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.329+0000 7fede0d57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc15ef50 0x7feddc0cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51010/0 (socket says 172.21.15.18:51010) 2024-09-21T07:11:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.329+0000 7fede0d57640 1 -- 172.21.15.18:0/2771456783 learned_addr learned my addr 172.21.15.18:0/2771456783 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.329+0000 7feddb7fe640 1 --2- 172.21.15.18:0/2771456783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feddc0d3580 0x7feddc158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.330+0000 7feddbfff640 1 --2- 172.21.15.18:0/2771456783 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7feddc0cef70 0x7feddc0b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.330+0000 7fede0d57640 1 -- 172.21.15.18:0/2771456783 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7feddc0cef70 msgr2=0x7feddc0b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.330+0000 7fede0d57640 1 --2- 172.21.15.18:0/2771456783 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7feddc0cef70 0x7feddc0b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.330+0000 7fede0d57640 1 -- 172.21.15.18:0/2771456783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feddc0d3580 msgr2=0x7feddc158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.330+0000 7fede0d57640 1 --2- 172.21.15.18:0/2771456783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feddc0d3580 0x7feddc158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.330+0000 7fede0d57640 1 -- 172.21.15.18:0/2771456783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feddc1f5950 con 0x7feddc15ef50 2024-09-21T07:11:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.330+0000 7fede0d57640 1 --2- 172.21.15.18:0/2771456783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc15ef50 0x7feddc0cb7c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fedd400be90 tx=0x7fedd400bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.330+0000 7fedd8ff9640 1 -- 172.21.15.18:0/2771456783 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4019070 con 0x7feddc15ef50 2024-09-21T07:11:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.330+0000 7fedd8ff9640 1 -- 172.21.15.18:0/2771456783 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedd4014440 con 0x7feddc15ef50 2024-09-21T07:11:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.330+0000 7fede27ba640 1 -- 172.21.15.18:0/2771456783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feddc0b6080 con 0x7feddc15ef50 2024-09-21T07:11:22.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.330+0000 7fedd8ff9640 1 -- 172.21.15.18:0/2771456783 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd40148d0 con 0x7feddc15ef50 2024-09-21T07:11:22.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.330+0000 7fede27ba640 1 -- 172.21.15.18:0/2771456783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feddc0b4170 con 0x7feddc15ef50 2024-09-21T07:11:22.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.331+0000 7fede27ba640 1 -- 172.21.15.18:0/2771456783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feddc0b5df0 con 0x7feddc15ef50 2024-09-21T07:11:22.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.332+0000 7fedd8ff9640 1 -- 172.21.15.18:0/2771456783 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fedd401c070 con 0x7feddc15ef50 2024-09-21T07:11:22.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.333+0000 7fedd8ff9640 1 --2- 172.21.15.18:0/2771456783 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fedc8078bc0 0x7fedc807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:22.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.333+0000 7fedd8ff9640 1 -- 172.21.15.18:0/2771456783 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7fedd409aa90 con 0x7feddc15ef50 2024-09-21T07:11:22.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.333+0000 7feddbfff640 1 --2- 172.21.15.18:0/2771456783 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fedc8078bc0 0x7fedc807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:22.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.333+0000 7feddbfff640 1 --2- 172.21.15.18:0/2771456783 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fedc8078bc0 0x7fedc807b0d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fedcc033000 tx=0x7fedcc004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:22.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.338+0000 7fedd8ff9640 1 -- 172.21.15.18:0/2771456783 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7feddc1f5950 con 0x7feddc15ef50 2024-09-21T07:11:22.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:22.526+0000 7fede27ba640 1 -- 172.21.15.18:0/2771456783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7feddc15c750 con 0x7feddc15ef50 2024-09-21T07:11:23.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.184+0000 7fedd8ff9640 1 -- 172.21.15.18:0/2771456783 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7fedd4062a60 con 0x7feddc15ef50 2024-09-21T07:11:23.186 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-21T07:11:23.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.188+0000 7fede27ba640 1 -- 172.21.15.18:0/2771456783 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fedc8078bc0 msgr2=0x7fedc807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.188+0000 7fede27ba640 1 --2- 172.21.15.18:0/2771456783 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fedc8078bc0 0x7fedc807b0d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fedcc033000 tx=0x7fedcc004730 comp rx=0 tx=0).stop 2024-09-21T07:11:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.189+0000 7fede27ba640 1 -- 172.21.15.18:0/2771456783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc15ef50 msgr2=0x7feddc0cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.189+0000 7fede27ba640 1 --2- 172.21.15.18:0/2771456783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc15ef50 0x7feddc0cb7c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fedd400be90 tx=0x7fedd400bf80 comp rx=0 tx=0).stop 2024-09-21T07:11:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.189+0000 7fede27ba640 1 -- 172.21.15.18:0/2771456783 shutdown_connections 2024-09-21T07:11:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.189+0000 7fede27ba640 1 --2- 172.21.15.18:0/2771456783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc15ef50 0x7feddc0cb7c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.189+0000 7fede27ba640 1 --2- 172.21.15.18:0/2771456783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feddc0d3580 0x7feddc158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.189+0000 7fede27ba640 1 --2- 172.21.15.18:0/2771456783 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fedc8078bc0 0x7fedc807b0d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.189+0000 7fede27ba640 1 --2- 172.21.15.18:0/2771456783 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7feddc0cef70 0x7feddc0b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.189+0000 7fede27ba640 1 -- 172.21.15.18:0/2771456783 >> 172.21.15.18:0/2771456783 conn(0x7feddc073f30 msgr2=0x7feddc15cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:23.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.190+0000 7fede27ba640 1 -- 172.21.15.18:0/2771456783 shutdown_connections 2024-09-21T07:11:23.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.190+0000 7fede27ba640 1 -- 172.21.15.18:0/2771456783 wait complete. 2024-09-21T07:11:23.221 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:11:23.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.345+0000 7f2d6d35f640 1 -- 172.21.15.18:0/1549553988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d6815ef50 msgr2=0x7f2d6815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:23.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.345+0000 7f2d6d35f640 1 --2- 172.21.15.18:0/1549553988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d6815ef50 0x7f2d6815c520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009830 tx=0x7f2d5802a510 comp rx=0 tx=0).stop 2024-09-21T07:11:23.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.345+0000 7f2d6d35f640 1 -- 172.21.15.18:0/1549553988 shutdown_connections 2024-09-21T07:11:23.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.345+0000 7f2d6d35f640 1 --2- 172.21.15.18:0/1549553988 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2d680cef70 0x7f2d680d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.345+0000 7f2d6d35f640 1 --2- 172.21.15.18:0/1549553988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d6815ef50 0x7f2d6815c520 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.345+0000 7f2d6d35f640 1 -- 172.21.15.18:0/1549553988 >> 172.21.15.18:0/1549553988 conn(0x7f2d68073f30 msgr2=0x7f2d680b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:23.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.345+0000 7f2d6d35f640 1 -- 172.21.15.18:0/1549553988 shutdown_connections 2024-09-21T07:11:23.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.345+0000 7f2d6d35f640 1 -- 172.21.15.18:0/1549553988 wait complete. 2024-09-21T07:11:23.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.347+0000 7f2d6d35f640 1 Processor -- start 2024-09-21T07:11:23.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.347+0000 7f2d6d35f640 1 -- start start 2024-09-21T07:11:23.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.348+0000 7f2d6d35f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d680cef70 0x7f2d6815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:23.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.348+0000 7f2d6d35f640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2d680d3580 0x7f2d68151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:23.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.348+0000 7f2d6d35f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d6815ef50 0x7f2d680ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:23.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.348+0000 7f2d6d35f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2d680d11a0 con 0x7f2d680cef70 2024-09-21T07:11:23.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.348+0000 7f2d6d35f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2d680d1020 con 0x7f2d6815ef50 2024-09-21T07:11:23.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.348+0000 7f2d6d35f640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f2d680d1320 con 0x7f2d680d3580 2024-09-21T07:11:23.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.349+0000 7f2d66ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d680cef70 0x7f2d6815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:23.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.349+0000 7f2d66ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d680cef70 0x7f2d6815aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51014/0 (socket says 172.21.15.18:51014) 2024-09-21T07:11:23.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.349+0000 7f2d66ffd640 1 -- 172.21.15.18:0/202985921 learned_addr learned my addr 172.21.15.18:0/202985921 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:23.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.349+0000 7f2d667fc640 1 --2- 172.21.15.18:0/202985921 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2d680d3580 0x7f2d68151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:23.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.349+0000 7f2d677fe640 1 --2- 172.21.15.18:0/202985921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d6815ef50 0x7f2d680ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:23.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.349+0000 7f2d66ffd640 1 -- 172.21.15.18:0/202985921 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2d680d3580 msgr2=0x7f2d68151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:23.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.349+0000 7f2d66ffd640 1 --2- 172.21.15.18:0/202985921 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2d680d3580 0x7f2d68151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.349+0000 7f2d66ffd640 1 -- 172.21.15.18:0/202985921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d6815ef50 msgr2=0x7f2d680ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:23.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.349+0000 7f2d66ffd640 1 --2- 172.21.15.18:0/202985921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d6815ef50 0x7f2d680ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:23.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.349+0000 7f2d66ffd640 1 -- 172.21.15.18:0/202985921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d680cd310 con 0x7f2d680cef70 2024-09-21T07:11:23.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.349+0000 7f2d66ffd640 1 --2- 172.21.15.18:0/202985921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d680cef70 0x7f2d6815aed0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2d5802ab00 tx=0x7f2d58033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:23.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.350+0000 7f2d5f7fe640 1 -- 172.21.15.18:0/202985921 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58031d60 con 0x7f2d680cef70 2024-09-21T07:11:23.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.350+0000 7f2d5f7fe640 1 -- 172.21.15.18:0/202985921 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d58033e10 con 0x7f2d680cef70 2024-09-21T07:11:23.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.350+0000 7f2d6d35f640 1 -- 172.21.15.18:0/202985921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d680cd5f0 con 0x7f2d680cef70 2024-09-21T07:11:23.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.350+0000 7f2d5f7fe640 1 -- 172.21.15.18:0/202985921 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58005260 con 0x7f2d680cef70 2024-09-21T07:11:23.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.350+0000 7f2d6d35f640 1 -- 172.21.15.18:0/202985921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d680abf30 con 0x7f2d680cef70 2024-09-21T07:11:23.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.351+0000 7f2d6d35f640 1 -- 172.21.15.18:0/202985921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d680d17d0 con 0x7f2d680cef70 2024-09-21T07:11:23.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.351+0000 7f2d5f7fe640 1 -- 172.21.15.18:0/202985921 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2d58005400 con 0x7f2d680cef70 2024-09-21T07:11:23.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.352+0000 7f2d5f7fe640 1 --2- 172.21.15.18:0/202985921 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2d48078bc0 0x7f2d4807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:23.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.352+0000 7f2d5f7fe640 1 -- 172.21.15.18:0/202985921 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7f2d580bbca0 con 0x7f2d680cef70 2024-09-21T07:11:23.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.352+0000 7f2d667fc640 1 --2- 172.21.15.18:0/202985921 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2d48078bc0 0x7f2d4807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:23.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.353+0000 7f2d667fc640 1 --2- 172.21.15.18:0/202985921 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2d48078bc0 0x7f2d4807b0d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2d680d0230 tx=0x7f2d50005f30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:23.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.357+0000 7f2d5f7fe640 1 -- 172.21.15.18:0/202985921 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2d5803f030 con 0x7f2d680cef70 2024-09-21T07:11:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:23.586+0000 7f2d6d35f640 1 -- 172.21.15.18:0/202985921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2d680d4130 con 0x7f2d680cef70 2024-09-21T07:11:24.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.185+0000 7f2d5f7fe640 1 -- 172.21.15.18:0/202985921 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f2d58083b90 con 0x7f2d680cef70 2024-09-21T07:11:24.187 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 4 and data pool 5 2024-09-21T07:11:24.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.189+0000 7f2d6d35f640 1 -- 172.21.15.18:0/202985921 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2d48078bc0 msgr2=0x7f2d4807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:24.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.189+0000 7f2d6d35f640 1 --2- 172.21.15.18:0/202985921 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2d48078bc0 0x7f2d4807b0d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2d680d0230 tx=0x7f2d50005f30 comp rx=0 tx=0).stop 2024-09-21T07:11:24.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.189+0000 7f2d6d35f640 1 -- 172.21.15.18:0/202985921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d680cef70 msgr2=0x7f2d6815aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:24.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.189+0000 7f2d6d35f640 1 --2- 172.21.15.18:0/202985921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d680cef70 0x7f2d6815aed0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2d5802ab00 tx=0x7f2d58033c20 comp rx=0 tx=0).stop 2024-09-21T07:11:24.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.190+0000 7f2d6d35f640 1 -- 172.21.15.18:0/202985921 shutdown_connections 2024-09-21T07:11:24.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.190+0000 7f2d6d35f640 1 --2- 172.21.15.18:0/202985921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d6815ef50 0x7f2d680ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.190+0000 7f2d6d35f640 1 --2- 172.21.15.18:0/202985921 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2d48078bc0 0x7f2d4807b0d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.190+0000 7f2d6d35f640 1 --2- 172.21.15.18:0/202985921 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2d680d3580 0x7f2d68151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.190+0000 7f2d6d35f640 1 --2- 172.21.15.18:0/202985921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d680cef70 0x7f2d6815aed0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.191+0000 7f2d6d35f640 1 -- 172.21.15.18:0/202985921 >> 172.21.15.18:0/202985921 conn(0x7f2d68073f30 msgr2=0x7f2d6815cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:24.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.191+0000 7f2d6d35f640 1 -- 172.21.15.18:0/202985921 shutdown_connections 2024-09-21T07:11:24.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.191+0000 7f2d6d35f640 1 -- 172.21.15.18:0/202985921 wait complete. 2024-09-21T07:11:24.228 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:11:24.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.346+0000 7fc98004d640 1 -- 172.21.15.18:0/1005311613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9780cef70 msgr2=0x7fc9780d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:24.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.346+0000 7fc98004d640 1 --2- 172.21.15.18:0/1005311613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9780cef70 0x7fc9780d3040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc97806dd50 tx=0x7fc96802a540 comp rx=0 tx=0).stop 2024-09-21T07:11:24.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.347+0000 7fc98004d640 1 -- 172.21.15.18:0/1005311613 shutdown_connections 2024-09-21T07:11:24.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.347+0000 7fc98004d640 1 --2- 172.21.15.18:0/1005311613 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc9780d3580 0x7fc978162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.347+0000 7fc98004d640 1 --2- 172.21.15.18:0/1005311613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9780cef70 0x7fc9780d3040 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.347+0000 7fc98004d640 1 --2- 172.21.15.18:0/1005311613 >> v2:172.21.15.49:3300/0 conn(0x7fc97815ef50 0x7fc97815c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.347+0000 7fc98004d640 1 -- 172.21.15.18:0/1005311613 >> 172.21.15.18:0/1005311613 conn(0x7fc978073f30 msgr2=0x7fc9780b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:24.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.347+0000 7fc98004d640 1 -- 172.21.15.18:0/1005311613 shutdown_connections 2024-09-21T07:11:24.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.347+0000 7fc98004d640 1 -- 172.21.15.18:0/1005311613 wait complete. 2024-09-21T07:11:24.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.348+0000 7fc98004d640 1 Processor -- start 2024-09-21T07:11:24.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.348+0000 7fc98004d640 1 -- start start 2024-09-21T07:11:24.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc98004d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9780cef70 0x7fc978151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:24.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc98004d640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc9780d3580 0x7fc9781f9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:24.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc98004d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc97815ef50 0x7fc9781f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:24.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc98004d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc978163310 con 0x7fc97815ef50 2024-09-21T07:11:24.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc98004d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc978163190 con 0x7fc9780cef70 2024-09-21T07:11:24.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc98004d640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fc9780d1020 con 0x7fc9780d3580 2024-09-21T07:11:24.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc97e5ea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc97815ef50 0x7fc9781f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:24.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc97e5ea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc97815ef50 0x7fc9781f6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51018/0 (socket says 172.21.15.18:51018) 2024-09-21T07:11:24.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc97e5ea640 1 -- 172.21.15.18:0/3058885097 learned_addr learned my addr 172.21.15.18:0/3058885097 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:24.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc97dde9640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9780cef70 0x7fc978151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:24.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc97d5e8640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc9780d3580 0x7fc9781f9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:24.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc97e5ea640 1 -- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc9780d3580 msgr2=0x7fc9781f9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:24.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc97e5ea640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc9780d3580 0x7fc9781f9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc97e5ea640 1 -- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9780cef70 msgr2=0x7fc978151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:24.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc97e5ea640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9780cef70 0x7fc978151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc97e5ea640 1 -- 172.21.15.18:0/3058885097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9781f9a30 con 0x7fc97815ef50 2024-09-21T07:11:24.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc97d5e8640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc9780d3580 0x7fc9781f9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:24.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.350+0000 7fc97dde9640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9780cef70 0x7fc978151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:24.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.351+0000 7fc97e5ea640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc97815ef50 0x7fc9781f6470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc97000cab0 tx=0x7fc97000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:24.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.351+0000 7fc96e7fc640 1 -- 172.21.15.18:0/3058885097 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970007d30 con 0x7fc97815ef50 2024-09-21T07:11:24.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.351+0000 7fc96e7fc640 1 -- 172.21.15.18:0/3058885097 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc97000f450 con 0x7fc97815ef50 2024-09-21T07:11:24.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.351+0000 7fc98004d640 1 -- 172.21.15.18:0/3058885097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9781f9d10 con 0x7fc97815ef50 2024-09-21T07:11:24.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.351+0000 7fc96e7fc640 1 -- 172.21.15.18:0/3058885097 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97000f8a0 con 0x7fc97815ef50 2024-09-21T07:11:24.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.351+0000 7fc98004d640 1 -- 172.21.15.18:0/3058885097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9781f69b0 con 0x7fc97815ef50 2024-09-21T07:11:24.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.352+0000 7fc98004d640 1 -- 172.21.15.18:0/3058885097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9781f97a0 con 0x7fc97815ef50 2024-09-21T07:11:24.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.352+0000 7fc96e7fc640 1 -- 172.21.15.18:0/3058885097 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc970018400 con 0x7fc97815ef50 2024-09-21T07:11:24.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.353+0000 7fc96e7fc640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc95c078bc0 0x7fc95c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:24.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.353+0000 7fc96e7fc640 1 -- 172.21.15.18:0/3058885097 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc97009b6b0 con 0x7fc97815ef50 2024-09-21T07:11:24.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.353+0000 7fc97dde9640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc95c078bc0 0x7fc95c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:24.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.354+0000 7fc97dde9640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc95c078bc0 0x7fc95c07b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc97400ab40 tx=0x7fc97400a520 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:24.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.358+0000 7fc96e7fc640 1 -- 172.21.15.18:0/3058885097 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc970014030 con 0x7fc97815ef50 2024-09-21T07:11:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.546+0000 7fc98004d640 1 -- 172.21.15.18:0/3058885097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9781f5a60 con 0x7fc97815ef50 2024-09-21T07:11:24.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.548+0000 7fc96e7fc640 1 -- 172.21.15.18:0/3058885097 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16718 (secure 0 0 0) 0x7fc970063af0 con 0x7fc97815ef50 2024-09-21T07:11:24.550 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:24.550 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":31,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:11:23.587928+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:11:21.656195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T07:11:22.531227+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.550+0000 7fc98004d640 1 -- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc95c078bc0 msgr2=0x7fc95c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.550+0000 7fc98004d640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc95c078bc0 0x7fc95c07b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc97400ab40 tx=0x7fc97400a520 comp rx=0 tx=0).stop 2024-09-21T07:11:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.550+0000 7fc98004d640 1 -- 172.21.15.18:0/3058885097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc97815ef50 msgr2=0x7fc9781f6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.550+0000 7fc98004d640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc97815ef50 0x7fc9781f6470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc97000cab0 tx=0x7fc97000cf70 comp rx=0 tx=0).stop 2024-09-21T07:11:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.550+0000 7fc98004d640 1 -- 172.21.15.18:0/3058885097 shutdown_connections 2024-09-21T07:11:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.550+0000 7fc98004d640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc97815ef50 0x7fc9781f6470 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.550+0000 7fc98004d640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc95c078bc0 0x7fc95c07b0d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.550+0000 7fc98004d640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc9780d3580 0x7fc9781f9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.550+0000 7fc98004d640 1 --2- 172.21.15.18:0/3058885097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9780cef70 0x7fc978151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.550+0000 7fc98004d640 1 -- 172.21.15.18:0/3058885097 >> 172.21.15.18:0/3058885097 conn(0x7fc978073f30 msgr2=0x7fc97815cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.550+0000 7fc98004d640 1 -- 172.21.15.18:0/3058885097 shutdown_connections 2024-09-21T07:11:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.550+0000 7fc98004d640 1 -- 172.21.15.18:0/3058885097 wait complete. 2024-09-21T07:11:24.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:11:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.678+0000 7f38174bd640 1 -- 172.21.15.18:0/203617038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381015ef50 msgr2=0x7f381015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.678+0000 7f38174bd640 1 --2- 172.21.15.18:0/203617038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381015ef50 0x7f381015c520 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f38100d2570 tx=0x7f380c02a580 comp rx=0 tx=0).stop 2024-09-21T07:11:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.678+0000 7f38174bd640 1 -- 172.21.15.18:0/203617038 shutdown_connections 2024-09-21T07:11:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.678+0000 7f38174bd640 1 --2- 172.21.15.18:0/203617038 >> v2:172.21.15.49:3300/0 conn(0x7f3810162a40 0x7f3810162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.678+0000 7f38174bd640 1 --2- 172.21.15.18:0/203617038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381015ef50 0x7f381015c520 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.678+0000 7f38174bd640 1 -- 172.21.15.18:0/203617038 >> 172.21.15.18:0/203617038 conn(0x7f3810073f30 msgr2=0x7f38100b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.678+0000 7f38174bd640 1 -- 172.21.15.18:0/203617038 shutdown_connections 2024-09-21T07:11:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.678+0000 7f38174bd640 1 -- 172.21.15.18:0/203617038 wait complete. 2024-09-21T07:11:24.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.680+0000 7f38174bd640 1 Processor -- start 2024-09-21T07:11:24.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.680+0000 7f38174bd640 1 -- start start 2024-09-21T07:11:24.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f38174bd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38100cef70 0x7f38101f9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:24.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f38174bd640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f381015ef50 0x7f38100ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:24.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f38174bd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3810162a40 0x7f38100d4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:24.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f38174bd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38100d11a0 con 0x7f38100cef70 2024-09-21T07:11:24.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f38174bd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f38100d1020 con 0x7f3810162a40 2024-09-21T07:11:24.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f38174bd640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f38100d1320 con 0x7f381015ef50 2024-09-21T07:11:24.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f3815259640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38100cef70 0x7f38101f9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:24.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f3815259640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38100cef70 0x7f38101f9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51034/0 (socket says 172.21.15.18:51034) 2024-09-21T07:11:24.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f3815259640 1 -- 172.21.15.18:0/3917786948 learned_addr learned my addr 172.21.15.18:0/3917786948 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:24.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f3815a5a640 1 --2- 172.21.15.18:0/3917786948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3810162a40 0x7f38100d4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:24.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f3815259640 1 -- 172.21.15.18:0/3917786948 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f381015ef50 msgr2=0x7f38100ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:24.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f3815259640 1 --2- 172.21.15.18:0/3917786948 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f381015ef50 0x7f38100ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f3815259640 1 -- 172.21.15.18:0/3917786948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3810162a40 msgr2=0x7f38100d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:24.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f3815259640 1 --2- 172.21.15.18:0/3917786948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3810162a40 0x7f38100d4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f3815259640 1 -- 172.21.15.18:0/3917786948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38101f5a50 con 0x7f38100cef70 2024-09-21T07:11:24.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.681+0000 7f3815259640 1 --2- 172.21.15.18:0/3917786948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38100cef70 0x7f38101f9a50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f380c000c00 tx=0x7f380c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:24.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.682+0000 7f3805ffb640 1 -- 172.21.15.18:0/3917786948 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c03e030 con 0x7f38100cef70 2024-09-21T07:11:24.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.682+0000 7f3805ffb640 1 -- 172.21.15.18:0/3917786948 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f380c0047a0 con 0x7f38100cef70 2024-09-21T07:11:24.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.682+0000 7f38174bd640 1 -- 172.21.15.18:0/3917786948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38101e9290 con 0x7f38100cef70 2024-09-21T07:11:24.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.682+0000 7f3805ffb640 1 -- 172.21.15.18:0/3917786948 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c035040 con 0x7f38100cef70 2024-09-21T07:11:24.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.682+0000 7f38174bd640 1 -- 172.21.15.18:0/3917786948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38101f5ff0 con 0x7f38100cef70 2024-09-21T07:11:24.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.683+0000 7f38174bd640 1 -- 172.21.15.18:0/3917786948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38100d1810 con 0x7f38100cef70 2024-09-21T07:11:24.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.684+0000 7f3805ffb640 1 -- 172.21.15.18:0/3917786948 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f380c041030 con 0x7f38100cef70 2024-09-21T07:11:24.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.684+0000 7f3805ffb640 1 --2- 172.21.15.18:0/3917786948 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f37f4078b90 0x7f37f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:24.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.684+0000 7f3805ffb640 1 -- 172.21.15.18:0/3917786948 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f380c0bb590 con 0x7f38100cef70 2024-09-21T07:11:24.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.684+0000 7f3814a58640 1 --2- 172.21.15.18:0/3917786948 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f37f4078b90 0x7f37f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:24.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.685+0000 7f3814a58640 1 --2- 172.21.15.18:0/3917786948 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f37f4078b90 0x7f37f407b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f38101ea760 tx=0x7f3800006b90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:24.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.689+0000 7f3805ffb640 1 -- 172.21.15.18:0/3917786948 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f380c083a60 con 0x7f38100cef70 2024-09-21T07:11:24.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.877+0000 7f38174bd640 1 -- 172.21.15.18:0/3917786948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f381015be50 con 0x7f38100cef70 2024-09-21T07:11:24.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.878+0000 7f3805ffb640 1 -- 172.21.15.18:0/3917786948 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16718 (secure 0 0 0) 0x7f380c083360 con 0x7f38100cef70 2024-09-21T07:11:24.880 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:24.880 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":31,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:11:23.587928+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:11:21.656195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T07:11:22.531227+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.880+0000 7f38174bd640 1 -- 172.21.15.18:0/3917786948 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f37f4078b90 msgr2=0x7f37f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.880+0000 7f38174bd640 1 --2- 172.21.15.18:0/3917786948 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f37f4078b90 0x7f37f407b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f38101ea760 tx=0x7f3800006b90 comp rx=0 tx=0).stop 2024-09-21T07:11:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.880+0000 7f38174bd640 1 -- 172.21.15.18:0/3917786948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38100cef70 msgr2=0x7f38101f9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.880+0000 7f38174bd640 1 --2- 172.21.15.18:0/3917786948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38100cef70 0x7f38101f9a50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f380c000c00 tx=0x7f380c0039e0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.880+0000 7f38174bd640 1 -- 172.21.15.18:0/3917786948 shutdown_connections 2024-09-21T07:11:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.880+0000 7f38174bd640 1 --2- 172.21.15.18:0/3917786948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3810162a40 0x7f38100d4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.880+0000 7f38174bd640 1 --2- 172.21.15.18:0/3917786948 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f37f4078b90 0x7f37f407b0a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.880+0000 7f38174bd640 1 --2- 172.21.15.18:0/3917786948 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f381015ef50 0x7f38100ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.880+0000 7f38174bd640 1 --2- 172.21.15.18:0/3917786948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38100cef70 0x7f38101f9a50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.880+0000 7f38174bd640 1 -- 172.21.15.18:0/3917786948 >> 172.21.15.18:0/3917786948 conn(0x7f3810073f30 msgr2=0x7f38100cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.880+0000 7f38174bd640 1 -- 172.21.15.18:0/3917786948 shutdown_connections 2024-09-21T07:11:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:24.880+0000 7f38174bd640 1 -- 172.21.15.18:0/3917786948 wait complete. 2024-09-21T07:11:24.894 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:11:25.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.011+0000 7f6deb98b640 1 -- 172.21.15.18:0/195843360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6de40cef70 msgr2=0x7f6de40d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:25.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.011+0000 7f6deb98b640 1 --2- 172.21.15.18:0/195843360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6de40cef70 0x7f6de40d3040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009820 tx=0x7f6dd802a510 comp rx=0 tx=0).stop 2024-09-21T07:11:25.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.011+0000 7f6deb98b640 1 -- 172.21.15.18:0/195843360 shutdown_connections 2024-09-21T07:11:25.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.011+0000 7f6deb98b640 1 --2- 172.21.15.18:0/195843360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6de40cef70 0x7f6de40d3040 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:25.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.011+0000 7f6deb98b640 1 --2- 172.21.15.18:0/195843360 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6de415ef50 0x7f6de415c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:25.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.011+0000 7f6deb98b640 1 -- 172.21.15.18:0/195843360 >> 172.21.15.18:0/195843360 conn(0x7f6de4073f30 msgr2=0x7f6de40b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:25.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.011+0000 7f6deb98b640 1 -- 172.21.15.18:0/195843360 shutdown_connections 2024-09-21T07:11:25.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.011+0000 7f6deb98b640 1 -- 172.21.15.18:0/195843360 wait complete. 2024-09-21T07:11:25.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.013+0000 7f6deb98b640 1 Processor -- start 2024-09-21T07:11:25.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.013+0000 7f6deb98b640 1 -- start start 2024-09-21T07:11:25.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.014+0000 7f6deb98b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6de40cef70 0x7f6de40cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:25.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.014+0000 7f6deb98b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6de40d3580 0x7f6de40cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:25.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.014+0000 7f6deb98b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6de415ef50 0x7f6de40ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:25.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.014+0000 7f6deb98b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6de40d11a0 con 0x7f6de40d3580 2024-09-21T07:11:25.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.014+0000 7f6deb98b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6de40d1020 con 0x7f6de415ef50 2024-09-21T07:11:25.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.014+0000 7f6deb98b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f6de40d1320 con 0x7f6de40cef70 2024-09-21T07:11:25.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.014+0000 7f6de8f26640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6de40d3580 0x7f6de40cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:25.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.014+0000 7f6de8f26640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6de40d3580 0x7f6de40cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51042/0 (socket says 172.21.15.18:51042) 2024-09-21T07:11:25.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.014+0000 7f6de8f26640 1 -- 172.21.15.18:0/3036489492 learned_addr learned my addr 172.21.15.18:0/3036489492 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:25.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.014+0000 7f6de9727640 1 --2- 172.21.15.18:0/3036489492 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6de40cef70 0x7f6de40cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:25.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.014+0000 7f6de9f28640 1 --2- 172.21.15.18:0/3036489492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6de415ef50 0x7f6de40ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:25.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.015+0000 7f6de8f26640 1 -- 172.21.15.18:0/3036489492 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6de40cef70 msgr2=0x7f6de40cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:25.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.015+0000 7f6de8f26640 1 --2- 172.21.15.18:0/3036489492 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6de40cef70 0x7f6de40cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:25.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.015+0000 7f6de8f26640 1 -- 172.21.15.18:0/3036489492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6de415ef50 msgr2=0x7f6de40ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:25.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.015+0000 7f6de8f26640 1 --2- 172.21.15.18:0/3036489492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6de415ef50 0x7f6de40ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:25.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.015+0000 7f6de8f26640 1 -- 172.21.15.18:0/3036489492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de40ce2b0 con 0x7f6de40d3580 2024-09-21T07:11:25.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.015+0000 7f6de8f26640 1 --2- 172.21.15.18:0/3036489492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6de40d3580 0x7f6de40cc980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6dd802ab00 tx=0x7f6dd8004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:25.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.015+0000 7f6de1ffb640 1 -- 172.21.15.18:0/3036489492 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8031d60 con 0x7f6de40d3580 2024-09-21T07:11:25.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.015+0000 7f6de1ffb640 1 -- 172.21.15.18:0/3036489492 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dd80330d0 con 0x7f6de40d3580 2024-09-21T07:11:25.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.015+0000 7f6deb98b640 1 -- 172.21.15.18:0/3036489492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de40cb960 con 0x7f6de40d3580 2024-09-21T07:11:25.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.015+0000 7f6de1ffb640 1 -- 172.21.15.18:0/3036489492 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8033500 con 0x7f6de40d3580 2024-09-21T07:11:25.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.015+0000 7f6deb98b640 1 -- 172.21.15.18:0/3036489492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de40ab1b0 con 0x7f6de40d3580 2024-09-21T07:11:25.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.016+0000 7f6deb98b640 1 -- 172.21.15.18:0/3036489492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de40ce020 con 0x7f6de40d3580 2024-09-21T07:11:25.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.017+0000 7f6de1ffb640 1 -- 172.21.15.18:0/3036489492 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6dd803b410 con 0x7f6de40d3580 2024-09-21T07:11:25.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.017+0000 7f6de1ffb640 1 --2- 172.21.15.18:0/3036489492 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6dd0078bc0 0x7f6dd007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:25.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.017+0000 7f6de1ffb640 1 -- 172.21.15.18:0/3036489492 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f6dd80bc070 con 0x7f6de40d3580 2024-09-21T07:11:25.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.018+0000 7f6de9727640 1 --2- 172.21.15.18:0/3036489492 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6dd0078bc0 0x7f6dd007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:25.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.018+0000 7f6de9727640 1 --2- 172.21.15.18:0/3036489492 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6dd0078bc0 0x7f6dd007b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4005fd0 tx=0x7f6dd4009660 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:25.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.022+0000 7f6de1ffb640 1 -- 172.21.15.18:0/3036489492 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6dd803f030 con 0x7f6de40d3580 2024-09-21T07:11:25.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:25.248+0000 7f6deb98b640 1 -- 172.21.15.18:0/3036489492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6de40d17d0 con 0x7f6de40d3580 2024-09-21T07:11:26.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.211+0000 7f6de1ffb640 1 -- 172.21.15.18:0/3036489492 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f6dd8083dc0 con 0x7f6de40d3580 2024-09-21T07:11:26.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.216+0000 7f6deb98b640 1 -- 172.21.15.18:0/3036489492 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6dd0078bc0 msgr2=0x7f6dd007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:26.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.216+0000 7f6deb98b640 1 --2- 172.21.15.18:0/3036489492 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6dd0078bc0 0x7f6dd007b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4005fd0 tx=0x7f6dd4009660 comp rx=0 tx=0).stop 2024-09-21T07:11:26.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.216+0000 7f6deb98b640 1 -- 172.21.15.18:0/3036489492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6de40d3580 msgr2=0x7f6de40cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:26.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.216+0000 7f6deb98b640 1 --2- 172.21.15.18:0/3036489492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6de40d3580 0x7f6de40cc980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6dd802ab00 tx=0x7f6dd8004ac0 comp rx=0 tx=0).stop 2024-09-21T07:11:26.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.216+0000 7f6deb98b640 1 -- 172.21.15.18:0/3036489492 shutdown_connections 2024-09-21T07:11:26.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.216+0000 7f6deb98b640 1 --2- 172.21.15.18:0/3036489492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6de415ef50 0x7f6de40ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:26.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.216+0000 7f6deb98b640 1 --2- 172.21.15.18:0/3036489492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6de40d3580 0x7f6de40cc980 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:26.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.216+0000 7f6deb98b640 1 --2- 172.21.15.18:0/3036489492 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6dd0078bc0 0x7f6dd007b0d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:26.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.216+0000 7f6deb98b640 1 --2- 172.21.15.18:0/3036489492 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6de40cef70 0x7f6de40cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:26.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.216+0000 7f6deb98b640 1 -- 172.21.15.18:0/3036489492 >> 172.21.15.18:0/3036489492 conn(0x7f6de4073f30 msgr2=0x7f6de4160080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:26.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.216+0000 7f6deb98b640 1 -- 172.21.15.18:0/3036489492 shutdown_connections 2024-09-21T07:11:26.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.216+0000 7f6deb98b640 1 -- 172.21.15.18:0/3036489492 wait complete. 2024-09-21T07:11:26.231 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:11:26.231 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:11:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.357+0000 7f66df230640 1 -- 172.21.15.18:0/3033367109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66d80b4760 msgr2=0x7f66d8153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.357+0000 7f66df230640 1 --2- 172.21.15.18:0/3033367109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66d80b4760 0x7f66d8153900 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f66c8005fd0 tx=0x7f66c802a5d0 comp rx=0 tx=0).stop 2024-09-21T07:11:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.357+0000 7f66df230640 1 -- 172.21.15.18:0/3033367109 shutdown_connections 2024-09-21T07:11:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.357+0000 7f66df230640 1 --2- 172.21.15.18:0/3033367109 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f66d815db80 0x7f66d80b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.357+0000 7f66df230640 1 --2- 172.21.15.18:0/3033367109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66d80b4760 0x7f66d8153900 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.357+0000 7f66df230640 1 -- 172.21.15.18:0/3033367109 >> 172.21.15.18:0/3033367109 conn(0x7f66d80b78b0 msgr2=0x7f66d80b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:26.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.357+0000 7f66df230640 1 -- 172.21.15.18:0/3033367109 shutdown_connections 2024-09-21T07:11:26.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.357+0000 7f66df230640 1 -- 172.21.15.18:0/3033367109 wait complete. 2024-09-21T07:11:26.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.359+0000 7f66df230640 1 Processor -- start 2024-09-21T07:11:26.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.359+0000 7f66df230640 1 -- start start 2024-09-21T07:11:26.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.360+0000 7f66df230640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f66d80b4760 0x7f66d8144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:26.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.360+0000 7f66df230640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66d815d060 0x7f66d81e7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:26.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.360+0000 7f66df230640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66d815db80 0x7f66d81e65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:26.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.360+0000 7f66df230640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f66d80b6190 con 0x7f66d815db80 2024-09-21T07:11:26.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.360+0000 7f66df230640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f66d80b6010 con 0x7f66d815d060 2024-09-21T07:11:26.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.360+0000 7f66df230640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f66d80b6310 con 0x7f66d80b4760 2024-09-21T07:11:26.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66dd7cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66d815db80 0x7f66d81e65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:26.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66dd7cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66d815db80 0x7f66d81e65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60064/0 (socket says 172.21.15.18:60064) 2024-09-21T07:11:26.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66dd7cd640 1 -- 172.21.15.18:0/3622630757 learned_addr learned my addr 172.21.15.18:0/3622630757 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:26.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66dcfcc640 1 --2- 172.21.15.18:0/3622630757 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f66d80b4760 0x7f66d8144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:26.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66d7fff640 1 --2- 172.21.15.18:0/3622630757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66d815d060 0x7f66d81e7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:26.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66dd7cd640 1 -- 172.21.15.18:0/3622630757 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f66d80b4760 msgr2=0x7f66d8144f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:26.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66dd7cd640 1 --2- 172.21.15.18:0/3622630757 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f66d80b4760 0x7f66d8144f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:26.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66dd7cd640 1 -- 172.21.15.18:0/3622630757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66d815d060 msgr2=0x7f66d81e7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:26.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66dd7cd640 1 --2- 172.21.15.18:0/3622630757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66d815d060 0x7f66d81e7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:26.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66dd7cd640 1 -- 172.21.15.18:0/3622630757 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d81528a0 con 0x7f66d815db80 2024-09-21T07:11:26.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66dd7cd640 1 --2- 172.21.15.18:0/3622630757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66d815db80 0x7f66d81e65c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f66d000e990 tx=0x7f66d000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:26.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66d57fa640 1 -- 172.21.15.18:0/3622630757 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0004d20 con 0x7f66d815db80 2024-09-21T07:11:26.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66d57fa640 1 -- 172.21.15.18:0/3622630757 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66d000caa0 con 0x7f66d815db80 2024-09-21T07:11:26.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66df230640 1 -- 172.21.15.18:0/3622630757 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d81e5e00 con 0x7f66d815db80 2024-09-21T07:11:26.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66d57fa640 1 -- 172.21.15.18:0/3622630757 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0005020 con 0x7f66d815db80 2024-09-21T07:11:26.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.361+0000 7f66df230640 1 -- 172.21.15.18:0/3622630757 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d8154a30 con 0x7f66d815db80 2024-09-21T07:11:26.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.362+0000 7f66df230640 1 -- 172.21.15.18:0/3622630757 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d80b67c0 con 0x7f66d815db80 2024-09-21T07:11:26.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.363+0000 7f66d57fa640 1 -- 172.21.15.18:0/3622630757 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66d00051c0 con 0x7f66d815db80 2024-09-21T07:11:26.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.363+0000 7f66d57fa640 1 --2- 172.21.15.18:0/3622630757 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f66c4078b90 0x7f66c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:26.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.364+0000 7f66d57fa640 1 -- 172.21.15.18:0/3622630757 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f66d009b5b0 con 0x7f66d815db80 2024-09-21T07:11:26.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.364+0000 7f66dcfcc640 1 --2- 172.21.15.18:0/3622630757 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f66c4078b90 0x7f66c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:26.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.364+0000 7f66dcfcc640 1 --2- 172.21.15.18:0/3622630757 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f66c4078b90 0x7f66c407b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f66c8033000 tx=0x7f66c8004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:26.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.368+0000 7f66d57fa640 1 -- 172.21.15.18:0/3622630757 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f66d0016030 con 0x7f66d815db80 2024-09-21T07:11:26.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:26.594+0000 7f66df230640 1 -- 172.21.15.18:0/3622630757 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f66d80b06b0 con 0x7f66d815db80 2024-09-21T07:11:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.213+0000 7f66d57fa640 1 -- 172.21.15.18:0/3622630757 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f66d0063410 con 0x7f66d815db80 2024-09-21T07:11:27.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.216+0000 7f66df230640 1 -- 172.21.15.18:0/3622630757 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f66c4078b90 msgr2=0x7f66c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.216+0000 7f66df230640 1 --2- 172.21.15.18:0/3622630757 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f66c4078b90 0x7f66c407b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f66c8033000 tx=0x7f66c8004730 comp rx=0 tx=0).stop 2024-09-21T07:11:27.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.216+0000 7f66df230640 1 -- 172.21.15.18:0/3622630757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66d815db80 msgr2=0x7f66d81e65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.216+0000 7f66df230640 1 --2- 172.21.15.18:0/3622630757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66d815db80 0x7f66d81e65c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f66d000e990 tx=0x7f66d000ee50 comp rx=0 tx=0).stop 2024-09-21T07:11:27.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.216+0000 7f66df230640 1 -- 172.21.15.18:0/3622630757 shutdown_connections 2024-09-21T07:11:27.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.216+0000 7f66df230640 1 --2- 172.21.15.18:0/3622630757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66d815db80 0x7f66d81e65c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.216+0000 7f66df230640 1 --2- 172.21.15.18:0/3622630757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66d815d060 0x7f66d81e7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.216+0000 7f66df230640 1 --2- 172.21.15.18:0/3622630757 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f66c4078b90 0x7f66c407b0a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.216+0000 7f66df230640 1 --2- 172.21.15.18:0/3622630757 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f66d80b4760 0x7f66d8144f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.216+0000 7f66df230640 1 -- 172.21.15.18:0/3622630757 >> 172.21.15.18:0/3622630757 conn(0x7f66d80b78b0 msgr2=0x7f66d80afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:27.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.216+0000 7f66df230640 1 -- 172.21.15.18:0/3622630757 shutdown_connections 2024-09-21T07:11:27.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.217+0000 7f66df230640 1 -- 172.21.15.18:0/3622630757 wait complete. 2024-09-21T07:11:27.232 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:11:27.232 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:11:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.355+0000 7fcc9deec640 1 -- 172.21.15.18:0/612374570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc80004d40 msgr2=0x7fcc80005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.355+0000 7fcc9deec640 1 --2- 172.21.15.18:0/612374570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc80004d40 0x7fcc80005190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcc980b7300 tx=0x7fcc80005830 comp rx=0 tx=0).stop 2024-09-21T07:11:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.355+0000 7fcc97fff640 1 -- 172.21.15.18:0/612374570 reap_dead start 2024-09-21T07:11:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.355+0000 7fcc9deec640 1 -- 172.21.15.18:0/612374570 shutdown_connections 2024-09-21T07:11:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.355+0000 7fcc9deec640 1 -- 172.21.15.18:0/612374570 >> 172.21.15.18:0/612374570 conn(0x7fcc98073f30 msgr2=0x7fcc980b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.355+0000 7fcc9deec640 1 -- 172.21.15.18:0/612374570 shutdown_connections 2024-09-21T07:11:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.355+0000 7fcc9deec640 1 -- 172.21.15.18:0/612374570 wait complete. 2024-09-21T07:11:27.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.357+0000 7fcc9deec640 1 Processor -- start 2024-09-21T07:11:27.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.357+0000 7fcc9deec640 1 -- start start 2024-09-21T07:11:27.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.358+0000 7fcc9deec640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc981f9700 0x7fcc980ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:27.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.358+0000 7fcc9deec640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc980b2c80 0x7fcc980ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:27.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.358+0000 7fcc9deec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc980b3090 0x7fcc980cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:27.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.358+0000 7fcc9deec640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcc98162fd0 con 0x7fcc981f9700 2024-09-21T07:11:27.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.358+0000 7fcc9deec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcc98162e50 con 0x7fcc980b3090 2024-09-21T07:11:27.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.358+0000 7fcc9deec640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fcc98163150 con 0x7fcc980b2c80 2024-09-21T07:11:27.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.358+0000 7fcc977fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc981f9700 0x7fcc980ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:27.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.358+0000 7fcc977fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc981f9700 0x7fcc980ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60078/0 (socket says 172.21.15.18:60078) 2024-09-21T07:11:27.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.358+0000 7fcc977fe640 1 -- 172.21.15.18:0/4464551 learned_addr learned my addr 172.21.15.18:0/4464551 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:27.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.359+0000 7fcc96ffd640 1 --2- 172.21.15.18:0/4464551 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc980b2c80 0x7fcc980ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:27.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.359+0000 7fcc97fff640 1 --2- 172.21.15.18:0/4464551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc980b3090 0x7fcc980cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:27.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.359+0000 7fcc977fe640 1 -- 172.21.15.18:0/4464551 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc980b2c80 msgr2=0x7fcc980ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.359+0000 7fcc977fe640 1 --2- 172.21.15.18:0/4464551 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc980b2c80 0x7fcc980ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.359+0000 7fcc977fe640 1 -- 172.21.15.18:0/4464551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc980b3090 msgr2=0x7fcc980cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.359+0000 7fcc977fe640 1 --2- 172.21.15.18:0/4464551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc980b3090 0x7fcc980cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.359+0000 7fcc977fe640 1 -- 172.21.15.18:0/4464551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc981f56e0 con 0x7fcc981f9700 2024-09-21T07:11:27.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.359+0000 7fcc977fe640 1 --2- 172.21.15.18:0/4464551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc981f9700 0x7fcc980ca7d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcc88004fd0 tx=0x7fcc8800ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:27.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.359+0000 7fcc7ffff640 1 -- 172.21.15.18:0/4464551 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88015070 con 0x7fcc981f9700 2024-09-21T07:11:27.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.359+0000 7fcc7ffff640 1 -- 172.21.15.18:0/4464551 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc88010980 con 0x7fcc981f9700 2024-09-21T07:11:27.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.359+0000 7fcc9deec640 1 -- 172.21.15.18:0/4464551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc981f59c0 con 0x7fcc981f9700 2024-09-21T07:11:27.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.359+0000 7fcc7ffff640 1 -- 172.21.15.18:0/4464551 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88010dd0 con 0x7fcc981f9700 2024-09-21T07:11:27.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.359+0000 7fcc9deec640 1 -- 172.21.15.18:0/4464551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc981f5f80 con 0x7fcc981f9700 2024-09-21T07:11:27.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.360+0000 7fcc9deec640 1 -- 172.21.15.18:0/4464551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc981f63c0 con 0x7fcc981f9700 2024-09-21T07:11:27.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.361+0000 7fcc7ffff640 1 -- 172.21.15.18:0/4464551 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc88018070 con 0x7fcc981f9700 2024-09-21T07:11:27.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.362+0000 7fcc7ffff640 1 --2- 172.21.15.18:0/4464551 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcc84078b90 0x7fcc8407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:27.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.362+0000 7fcc7ffff640 1 -- 172.21.15.18:0/4464551 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fcc8809b000 con 0x7fcc981f9700 2024-09-21T07:11:27.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.362+0000 7fcc96ffd640 1 --2- 172.21.15.18:0/4464551 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcc84078b90 0x7fcc8407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:27.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.362+0000 7fcc96ffd640 1 --2- 172.21.15.18:0/4464551 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcc84078b90 0x7fcc8407b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c006fd0 tx=0x7fcc8c006db0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:27.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.366+0000 7fcc7ffff640 1 -- 172.21.15.18:0/4464551 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcc88062e70 con 0x7fcc981f9700 2024-09-21T07:11:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.590+0000 7fcc9deec640 1 -- 172.21.15.18:0/4464551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc980b39e0 con 0x7fcc981f9700 2024-09-21T07:11:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.591+0000 7fcc7ffff640 1 -- 172.21.15.18:0/4464551 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5220 (secure 0 0 0) 0x7fcc880678a0 con 0x7fcc981f9700 2024-09-21T07:11:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:27.593 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"btime":"2024-09-21T07:11:27:212589+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/492466681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":492466681},{"type":"v1","addr":"172.21.15.18:6834","nonce":492466681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4777,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/2411496903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2411496903},{"type":"v1","addr":"172.21.15.18:6835","nonce":2411496903}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4780,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2997359476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2997359476},{"type":"v1","addr":"172.21.15.49:6836","nonce":2997359476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:11:23.587887+0000","modified":"2024-09-21T07:11:26.595981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3575557854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3575557854},{"type":"v1","addr":"172.21.15.49:6837","nonce":3575557854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4905,"qdb_cluster":[4905]},"id":2}]} 2024-09-21T07:11:27.593 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 17 2024-09-21T07:11:27.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.593+0000 7fcc9deec640 1 -- 172.21.15.18:0/4464551 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcc84078b90 msgr2=0x7fcc8407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.593+0000 7fcc9deec640 1 --2- 172.21.15.18:0/4464551 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcc84078b90 0x7fcc8407b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c006fd0 tx=0x7fcc8c006db0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.593+0000 7fcc9deec640 1 -- 172.21.15.18:0/4464551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc981f9700 msgr2=0x7fcc980ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.593+0000 7fcc9deec640 1 --2- 172.21.15.18:0/4464551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc981f9700 0x7fcc980ca7d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcc88004fd0 tx=0x7fcc8800ea20 comp rx=0 tx=0).stop 2024-09-21T07:11:27.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.593+0000 7fcc9deec640 1 -- 172.21.15.18:0/4464551 shutdown_connections 2024-09-21T07:11:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.593+0000 7fcc9deec640 1 --2- 172.21.15.18:0/4464551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc980b3090 0x7fcc980cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.593+0000 7fcc9deec640 1 --2- 172.21.15.18:0/4464551 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcc84078b90 0x7fcc8407b0a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.593+0000 7fcc9deec640 1 --2- 172.21.15.18:0/4464551 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc980b2c80 0x7fcc980ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.593+0000 7fcc9deec640 1 --2- 172.21.15.18:0/4464551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc981f9700 0x7fcc980ca7d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.593+0000 7fcc9deec640 1 -- 172.21.15.18:0/4464551 >> 172.21.15.18:0/4464551 conn(0x7fcc98073f30 msgr2=0x7fcc98161670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.593+0000 7fcc9deec640 1 -- 172.21.15.18:0/4464551 shutdown_connections 2024-09-21T07:11:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.593+0000 7fcc9deec640 1 -- 172.21.15.18:0/4464551 wait complete. 2024-09-21T07:11:27.606 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:11:27.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.722+0000 7f3697dc6640 1 -- 172.21.15.18:0/3641584982 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f369015ef50 msgr2=0x7f369015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.722+0000 7f3697dc6640 1 --2- 172.21.15.18:0/3641584982 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f369015ef50 0x7f369015c520 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f368c009830 tx=0x7f368c02a510 comp rx=0 tx=0).stop 2024-09-21T07:11:27.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.722+0000 7f3697dc6640 1 -- 172.21.15.18:0/3641584982 shutdown_connections 2024-09-21T07:11:27.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.722+0000 7f3697dc6640 1 --2- 172.21.15.18:0/3641584982 >> v2:172.21.15.49:3300/0 conn(0x7f36900cef70 0x7f36900d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.722+0000 7f3697dc6640 1 --2- 172.21.15.18:0/3641584982 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f369015ef50 0x7f369015c520 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.722+0000 7f3697dc6640 1 -- 172.21.15.18:0/3641584982 >> 172.21.15.18:0/3641584982 conn(0x7f3690073f30 msgr2=0x7f36900b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:27.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.722+0000 7f3697dc6640 1 -- 172.21.15.18:0/3641584982 shutdown_connections 2024-09-21T07:11:27.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.722+0000 7f3697dc6640 1 -- 172.21.15.18:0/3641584982 wait complete. 2024-09-21T07:11:27.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.724+0000 7f3697dc6640 1 Processor -- start 2024-09-21T07:11:27.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.724+0000 7f3697dc6640 1 -- start start 2024-09-21T07:11:27.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3697dc6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36900cef70 0x7f369015ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:27.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3697dc6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36900d3580 0x7f36900abf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:27.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3697dc6640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f369015ef50 0x7f36900b90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:27.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3697dc6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f36900d11a0 con 0x7f36900d3580 2024-09-21T07:11:27.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3697dc6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f36900d1020 con 0x7f36900cef70 2024-09-21T07:11:27.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3697dc6640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f36900d1320 con 0x7f369015ef50 2024-09-21T07:11:27.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3695361640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36900d3580 0x7f36900abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:27.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3695361640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36900d3580 0x7f36900abf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60080/0 (socket says 172.21.15.18:60080) 2024-09-21T07:11:27.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3695361640 1 -- 172.21.15.18:0/2867893588 learned_addr learned my addr 172.21.15.18:0/2867893588 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:27.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3695b62640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36900cef70 0x7f369015ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:27.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3696363640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f369015ef50 0x7f36900b90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:27.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3695361640 1 -- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f369015ef50 msgr2=0x7f36900b90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3695361640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f369015ef50 0x7f36900b90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3695361640 1 -- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36900cef70 msgr2=0x7f369015ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3695361640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36900cef70 0x7f369015ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3695361640 1 -- 172.21.15.18:0/2867893588 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36900cb960 con 0x7f36900d3580 2024-09-21T07:11:27.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3695b62640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36900cef70 0x7f369015ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:27.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.725+0000 7f3696363640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f369015ef50 0x7f36900b90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:27.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.726+0000 7f3695361640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36900d3580 0x7f36900abf20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f368000e9f0 tx=0x7f368000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:27.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.726+0000 7f36867fc640 1 -- 172.21.15.18:0/2867893588 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368000cd80 con 0x7f36900d3580 2024-09-21T07:11:27.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.726+0000 7f36867fc640 1 -- 172.21.15.18:0/2867893588 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3680004020 con 0x7f36900d3580 2024-09-21T07:11:27.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.726+0000 7f3697dc6640 1 -- 172.21.15.18:0/2867893588 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36900cbc40 con 0x7f36900d3580 2024-09-21T07:11:27.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.726+0000 7f36867fc640 1 -- 172.21.15.18:0/2867893588 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3680004450 con 0x7f36900d3580 2024-09-21T07:11:27.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.726+0000 7f3697dc6640 1 -- 172.21.15.18:0/2867893588 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36900cc200 con 0x7f36900d3580 2024-09-21T07:11:27.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.727+0000 7f3697dc6640 1 -- 172.21.15.18:0/2867893588 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36900d17d0 con 0x7f36900d3580 2024-09-21T07:11:27.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.728+0000 7f36867fc640 1 -- 172.21.15.18:0/2867893588 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3680005030 con 0x7f36900d3580 2024-09-21T07:11:27.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.728+0000 7f36867fc640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3674078b90 0x7f367407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:27.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.728+0000 7f36867fc640 1 -- 172.21.15.18:0/2867893588 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f368009b6a0 con 0x7f36900d3580 2024-09-21T07:11:27.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.729+0000 7f3695b62640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3674078b90 0x7f367407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:27.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.729+0000 7f3695b62640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3674078b90 0x7f367407b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f368c034000 tx=0x7f368c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:27.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.733+0000 7f36867fc640 1 -- 172.21.15.18:0/2867893588 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3680063ae0 con 0x7f36900d3580 2024-09-21T07:11:27.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.922+0000 7f3697dc6640 1 -- 172.21.15.18:0/2867893588 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f369015bd40 con 0x7f36900d3580 2024-09-21T07:11:27.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.923+0000 7f36867fc640 1 -- 172.21.15.18:0/2867893588 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16705 (secure 0 0 0) 0x7f36800633e0 con 0x7f36900d3580 2024-09-21T07:11:27.925 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:27.926 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":32,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:11:25.200034+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:11:21.656195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T07:11:22.531227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:27.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.926+0000 7f3697dc6640 1 -- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3674078b90 msgr2=0x7f367407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.926+0000 7f3697dc6640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3674078b90 0x7f367407b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f368c034000 tx=0x7f368c004730 comp rx=0 tx=0).stop 2024-09-21T07:11:27.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.926+0000 7f3697dc6640 1 -- 172.21.15.18:0/2867893588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36900d3580 msgr2=0x7f36900abf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:27.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.926+0000 7f3697dc6640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36900d3580 0x7f36900abf20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f368000e9f0 tx=0x7f368000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.926+0000 7f3697dc6640 1 -- 172.21.15.18:0/2867893588 shutdown_connections 2024-09-21T07:11:27.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.926+0000 7f3697dc6640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3674078b90 0x7f367407b0a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.926+0000 7f3697dc6640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f369015ef50 0x7f36900b90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.926+0000 7f3697dc6640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36900d3580 0x7f36900abf20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.926+0000 7f3697dc6640 1 --2- 172.21.15.18:0/2867893588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36900cef70 0x7f369015ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:27.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.926+0000 7f3697dc6640 1 -- 172.21.15.18:0/2867893588 >> 172.21.15.18:0/2867893588 conn(0x7f3690073f30 msgr2=0x7f36900b6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:27.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.926+0000 7f3697dc6640 1 -- 172.21.15.18:0/2867893588 shutdown_connections 2024-09-21T07:11:27.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:27.926+0000 7f3697dc6640 1 -- 172.21.15.18:0/2867893588 wait complete. 2024-09-21T07:11:27.939 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:11:27.940 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:11:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.054+0000 7efff11a9640 1 -- 172.21.15.18:0/3745636337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effec0b4760 msgr2=0x7effec153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.054+0000 7efff11a9640 1 --2- 172.21.15.18:0/3745636337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effec0b4760 0x7effec153900 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7effec0b81a0 tx=0x7effdc02a560 comp rx=0 tx=0).stop 2024-09-21T07:11:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.054+0000 7efff11a9640 1 -- 172.21.15.18:0/3745636337 shutdown_connections 2024-09-21T07:11:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.054+0000 7efff11a9640 1 --2- 172.21.15.18:0/3745636337 >> v2:172.21.15.49:3300/0 conn(0x7effec15d060 0x7effec15d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.054+0000 7efff11a9640 1 --2- 172.21.15.18:0/3745636337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effec0b4760 0x7effec153900 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.054+0000 7efff11a9640 1 -- 172.21.15.18:0/3745636337 >> 172.21.15.18:0/3745636337 conn(0x7effec0b78b0 msgr2=0x7effec0b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:28.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.054+0000 7efff11a9640 1 -- 172.21.15.18:0/3745636337 shutdown_connections 2024-09-21T07:11:28.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.054+0000 7efff11a9640 1 -- 172.21.15.18:0/3745636337 wait complete. 2024-09-21T07:11:28.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.056+0000 7efff11a9640 1 Processor -- start 2024-09-21T07:11:28.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.056+0000 7efff11a9640 1 -- start start 2024-09-21T07:11:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.057+0000 7efff11a9640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7effec0b4760 0x7effec154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.057+0000 7efff11a9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effec15d060 0x7effec15b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.057+0000 7efff11a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effec15d9b0 0x7effec1f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.057+0000 7efff11a9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7effec0b4d10 con 0x7effec15d9b0 2024-09-21T07:11:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.057+0000 7efff11a9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7effec0b6a00 con 0x7effec15d060 2024-09-21T07:11:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.057+0000 7efff11a9640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7effec160cf0 con 0x7effec0b4760 2024-09-21T07:11:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effeb59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effec15d9b0 0x7effec1f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effeb59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effec15d9b0 0x7effec1f3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60098/0 (socket says 172.21.15.18:60098) 2024-09-21T07:11:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effeb59e640 1 -- 172.21.15.18:0/2002851730 learned_addr learned my addr 172.21.15.18:0/2002851730 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effe259c640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effec15d060 0x7effec15b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effead9d640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7effec0b4760 0x7effec154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effeb59e640 1 -- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7effec0b4760 msgr2=0x7effec154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effeb59e640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7effec0b4760 0x7effec154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effeb59e640 1 -- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effec15d060 msgr2=0x7effec15b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effeb59e640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effec15d060 0x7effec15b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effeb59e640 1 -- 172.21.15.18:0/2002851730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effec1f41a0 con 0x7effec15d9b0 2024-09-21T07:11:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effead9d640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7effec0b4760 0x7effec154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effe259c640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effec15d060 0x7effec15b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effeb59e640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effec15d9b0 0x7effec1f3550 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7effe400b970 tx=0x7effe400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effe3fff640 1 -- 172.21.15.18:0/2002851730 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe4019070 con 0x7effec15d9b0 2024-09-21T07:11:28.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effe3fff640 1 -- 172.21.15.18:0/2002851730 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effe400cc30 con 0x7effec15d9b0 2024-09-21T07:11:28.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7efff11a9640 1 -- 172.21.15.18:0/2002851730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effec1f4480 con 0x7effec15d9b0 2024-09-21T07:11:28.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7effe3fff640 1 -- 172.21.15.18:0/2002851730 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe40146a0 con 0x7effec15d9b0 2024-09-21T07:11:28.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.058+0000 7efff11a9640 1 -- 172.21.15.18:0/2002851730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effec154400 con 0x7effec15d9b0 2024-09-21T07:11:28.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.059+0000 7efff11a9640 1 -- 172.21.15.18:0/2002851730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effec1611c0 con 0x7effec15d9b0 2024-09-21T07:11:28.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.060+0000 7effe3fff640 1 -- 172.21.15.18:0/2002851730 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7effe401c070 con 0x7effec15d9b0 2024-09-21T07:11:28.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.061+0000 7effe3fff640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7effcc078bc0 0x7effcc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:28.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.061+0000 7effe3fff640 1 -- 172.21.15.18:0/2002851730 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7effe409ab40 con 0x7effec15d9b0 2024-09-21T07:11:28.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.061+0000 7effead9d640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7effcc078bc0 0x7effcc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:28.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.061+0000 7effead9d640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7effcc078bc0 0x7effcc07b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7effdc033000 tx=0x7effdc004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:28.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.065+0000 7effe3fff640 1 -- 172.21.15.18:0/2002851730 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7effe4062ef0 con 0x7effec15d9b0 2024-09-21T07:11:28.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.251+0000 7efff11a9640 1 -- 172.21.15.18:0/2002851730 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7effec06b490 con 0x7effcc078bc0 2024-09-21T07:11:28.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.255+0000 7effe3fff640 1 -- 172.21.15.18:0/2002851730 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243059 (secure 0 0 0) 0x7effdc004040 con 0x7effcc078bc0 2024-09-21T07:11:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:28.260 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-21T07:11:28.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.259+0000 7efff11a9640 1 -- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7effcc078bc0 msgr2=0x7effcc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:28.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.259+0000 7efff11a9640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7effcc078bc0 0x7effcc07b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7effdc033000 tx=0x7effdc004730 comp rx=0 tx=0).stop 2024-09-21T07:11:28.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.259+0000 7efff11a9640 1 -- 172.21.15.18:0/2002851730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effec15d9b0 msgr2=0x7effec1f3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:28.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.259+0000 7efff11a9640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effec15d9b0 0x7effec1f3550 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7effe400b970 tx=0x7effe400be30 comp rx=0 tx=0).stop 2024-09-21T07:11:28.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.259+0000 7efff11a9640 1 -- 172.21.15.18:0/2002851730 shutdown_connections 2024-09-21T07:11:28.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.259+0000 7efff11a9640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effec15d9b0 0x7effec1f3550 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.259+0000 7efff11a9640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effec15d060 0x7effec15b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.259+0000 7efff11a9640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7effcc078bc0 0x7effcc07b0d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.259+0000 7efff11a9640 1 --2- 172.21.15.18:0/2002851730 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7effec0b4760 0x7effec154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.259+0000 7efff11a9640 1 -- 172.21.15.18:0/2002851730 >> 172.21.15.18:0/2002851730 conn(0x7effec0b78b0 msgr2=0x7effec15f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:28.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.259+0000 7efff11a9640 1 -- 172.21.15.18:0/2002851730 shutdown_connections 2024-09-21T07:11:28.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.259+0000 7efff11a9640 1 -- 172.21.15.18:0/2002851730 wait complete. 2024-09-21T07:11:28.272 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-09-21T07:11:26.324156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":127,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":80,"acting":80,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":269864,"kb_used_data":3668,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754704856,"statfs":{"total":773094113280,"available":772817772544,"internally_reserved":0,"allocated":3756032,"data_stored":2129797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.144312"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.209445+0000","last_change":"2024-09-21T07:11:24.200982+0000","last_active":"2024-09-21T07:11:24.209445+0000","last_peered":"2024-09-21T07:11:24.209445+0000","last_clean":"2024-09-21T07:11:24.209445+0000","last_became_active":"2024-09-21T07:11:24.200516+0000","last_became_peered":"2024-09-21T07:11:24.200516+0000","last_unstale":"2024-09-21T07:11:24.209445+0000","last_undegraded":"2024-09-21T07:11:24.209445+0000","last_fullsized":"2024-09-21T07:11:24.209445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:51.075720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.213329+0000","last_change":"2024-09-21T07:11:24.208989+0000","last_active":"2024-09-21T07:11:24.213329+0000","last_peered":"2024-09-21T07:11:24.213329+0000","last_clean":"2024-09-21T07:11:24.213329+0000","last_became_active":"2024-09-21T07:11:24.208288+0000","last_became_peered":"2024-09-21T07:11:24.208288+0000","last_unstale":"2024-09-21T07:11:24.213329+0000","last_undegraded":"2024-09-21T07:11:24.213329+0000","last_fullsized":"2024-09-21T07:11:24.213329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:48.695478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.220734+0000","last_change":"2024-09-21T07:11:24.213190+0000","last_active":"2024-09-21T07:11:24.220734+0000","last_peered":"2024-09-21T07:11:24.220734+0000","last_clean":"2024-09-21T07:11:24.220734+0000","last_became_active":"2024-09-21T07:11:24.210515+0000","last_became_peered":"2024-09-21T07:11:24.210515+0000","last_unstale":"2024-09-21T07:11:24.220734+0000","last_undegraded":"2024-09-21T07:11:24.220734+0000","last_fullsized":"2024-09-21T07:11:24.220734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:47.164865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.209250+0000","last_change":"2024-09-21T07:11:24.205973+0000","last_active":"2024-09-21T07:11:24.209250+0000","last_peered":"2024-09-21T07:11:24.209250+0000","last_clean":"2024-09-21T07:11:24.209250+0000","last_became_active":"2024-09-21T07:11:24.205581+0000","last_became_peered":"2024-09-21T07:11:24.205581+0000","last_unstale":"2024-09-21T07:11:24.209250+0000","last_undegraded":"2024-09-21T07:11:24.209250+0000","last_fullsized":"2024-09-21T07:11:24.209250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:50.190521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.206161+0000","last_change":"2024-09-21T07:11:24.204195+0000","last_active":"2024-09-21T07:11:24.206161+0000","last_peered":"2024-09-21T07:11:24.206161+0000","last_clean":"2024-09-21T07:11:24.206161+0000","last_became_active":"2024-09-21T07:11:24.203720+0000","last_became_peered":"2024-09-21T07:11:24.203720+0000","last_unstale":"2024-09-21T07:11:24.206161+0000","last_undegraded":"2024-09-21T07:11:24.206161+0000","last_fullsized":"2024-09-21T07:11:24.206161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:02.507740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.219178+0000","last_change":"2024-09-21T07:11:24.210512+0000","last_active":"2024-09-21T07:11:24.219178+0000","last_peered":"2024-09-21T07:11:24.219178+0000","last_clean":"2024-09-21T07:11:24.219178+0000","last_became_active":"2024-09-21T07:11:24.209904+0000","last_became_peered":"2024-09-21T07:11:24.209904+0000","last_unstale":"2024-09-21T07:11:24.219178+0000","last_undegraded":"2024-09-21T07:11:24.219178+0000","last_fullsized":"2024-09-21T07:11:24.219178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:52.156830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.219130+0000","last_change":"2024-09-21T07:11:24.211044+0000","last_active":"2024-09-21T07:11:24.219130+0000","last_peered":"2024-09-21T07:11:24.219130+0000","last_clean":"2024-09-21T07:11:24.219130+0000","last_became_active":"2024-09-21T07:11:24.210706+0000","last_became_peered":"2024-09-21T07:11:24.210706+0000","last_unstale":"2024-09-21T07:11:24.219130+0000","last_undegraded":"2024-09-21T07:11:24.219130+0000","last_fullsized":"2024-09-21T07:11:24.219130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:04.526473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.206935+0000","last_change":"2024-09-21T07:11:24.209933+0000","last_active":"2024-09-21T07:11:25.206935+0000","last_peered":"2024-09-21T07:11:25.206935+0000","last_clean":"2024-09-21T07:11:25.206935+0000","last_became_active":"2024-09-21T07:11:24.209622+0000","last_became_peered":"2024-09-21T07:11:24.209622+0000","last_unstale":"2024-09-21T07:11:25.206935+0000","last_undegraded":"2024-09-21T07:11:25.206935+0000","last_fullsized":"2024-09-21T07:11:25.206935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:39.624284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.221029+0000","last_change":"2024-09-21T07:11:24.219903+0000","last_active":"2024-09-21T07:11:24.221029+0000","last_peered":"2024-09-21T07:11:24.221029+0000","last_clean":"2024-09-21T07:11:24.221029+0000","last_became_active":"2024-09-21T07:11:24.219362+0000","last_became_peered":"2024-09-21T07:11:24.219362+0000","last_unstale":"2024-09-21T07:11:24.221029+0000","last_undegraded":"2024-09-21T07:11:24.221029+0000","last_fullsized":"2024-09-21T07:11:24.221029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:59.577772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.220918+0000","last_change":"2024-09-21T07:11:24.216562+0000","last_active":"2024-09-21T07:11:24.220918+0000","last_peered":"2024-09-21T07:11:24.220918+0000","last_clean":"2024-09-21T07:11:24.220918+0000","last_became_active":"2024-09-21T07:11:24.216233+0000","last_became_peered":"2024-09-21T07:11:24.216233+0000","last_unstale":"2024-09-21T07:11:24.220918+0000","last_undegraded":"2024-09-21T07:11:24.220918+0000","last_fullsized":"2024-09-21T07:11:24.220918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:18.542064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.217532+0000","last_change":"2024-09-21T07:11:24.214460+0000","last_active":"2024-09-21T07:11:24.217532+0000","last_peered":"2024-09-21T07:11:24.217532+0000","last_clean":"2024-09-21T07:11:24.217532+0000","last_became_active":"2024-09-21T07:11:24.213761+0000","last_became_peered":"2024-09-21T07:11:24.213761+0000","last_unstale":"2024-09-21T07:11:24.217532+0000","last_undegraded":"2024-09-21T07:11:24.217532+0000","last_fullsized":"2024-09-21T07:11:24.217532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:07.008536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207088+0000","last_change":"2024-09-21T07:11:24.215755+0000","last_active":"2024-09-21T07:11:25.207088+0000","last_peered":"2024-09-21T07:11:25.207088+0000","last_clean":"2024-09-21T07:11:25.207088+0000","last_became_active":"2024-09-21T07:11:24.215411+0000","last_became_peered":"2024-09-21T07:11:24.215411+0000","last_unstale":"2024-09-21T07:11:25.207088+0000","last_undegraded":"2024-09-21T07:11:25.207088+0000","last_fullsized":"2024-09-21T07:11:25.207088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:07.008536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:22.173665+0000","last_change":"2024-09-21T07:11:22.173665+0000","last_active":"2024-09-21T07:11:22.173665+0000","last_peered":"2024-09-21T07:11:22.173665+0000","last_clean":"2024-09-21T07:11:22.173665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:22.173665+0000","last_undegraded":"2024-09-21T07:11:22.173665+0000","last_fullsized":"2024-09-21T07:11:22.173665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207152+0000","last_change":"2024-09-21T07:11:23.206667+0000","last_active":"2024-09-21T07:11:25.207152+0000","last_peered":"2024-09-21T07:11:25.207152+0000","last_clean":"2024-09-21T07:11:25.207152+0000","last_became_active":"2024-09-21T07:11:23.206340+0000","last_became_peered":"2024-09-21T07:11:23.206340+0000","last_unstale":"2024-09-21T07:11:25.207152+0000","last_undegraded":"2024-09-21T07:11:25.207152+0000","last_fullsized":"2024-09-21T07:11:25.207152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:25.327096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.226685+0000","last_change":"2024-09-21T07:11:23.203172+0000","last_active":"2024-09-21T07:11:24.226685+0000","last_peered":"2024-09-21T07:11:24.226685+0000","last_clean":"2024-09-21T07:11:24.226685+0000","last_became_active":"2024-09-21T07:11:23.202792+0000","last_became_peered":"2024-09-21T07:11:23.202792+0000","last_unstale":"2024-09-21T07:11:24.226685+0000","last_undegraded":"2024-09-21T07:11:24.226685+0000","last_fullsized":"2024-09-21T07:11:24.226685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:57.855736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.215622+0000","last_change":"2024-09-21T07:11:24.214085+0000","last_active":"2024-09-21T07:11:24.215622+0000","last_peered":"2024-09-21T07:11:24.215622+0000","last_clean":"2024-09-21T07:11:24.215622+0000","last_became_active":"2024-09-21T07:11:24.213156+0000","last_became_peered":"2024-09-21T07:11:24.213156+0000","last_unstale":"2024-09-21T07:11:24.215622+0000","last_undegraded":"2024-09-21T07:11:24.215622+0000","last_fullsized":"2024-09-21T07:11:24.215622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:14.772321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:22.173665+0000","last_change":"2024-09-21T07:11:22.173665+0000","last_active":"2024-09-21T07:11:22.173665+0000","last_peered":"2024-09-21T07:11:22.173665+0000","last_clean":"2024-09-21T07:11:22.173665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:22.173665+0000","last_undegraded":"2024-09-21T07:11:22.173665+0000","last_fullsized":"2024-09-21T07:11:22.173665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:22.173665+0000","last_change":"2024-09-21T07:11:22.173665+0000","last_active":"2024-09-21T07:11:22.173665+0000","last_peered":"2024-09-21T07:11:22.173665+0000","last_clean":"2024-09-21T07:11:22.173665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:22.173665+0000","last_undegraded":"2024-09-21T07:11:22.173665+0000","last_fullsized":"2024-09-21T07:11:22.173665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:22.173665+0000","last_change":"2024-09-21T07:11:22.173665+0000","last_active":"2024-09-21T07:11:22.173665+0000","last_peered":"2024-09-21T07:11:22.173665+0000","last_clean":"2024-09-21T07:11:22.173665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:22.173665+0000","last_undegraded":"2024-09-21T07:11:22.173665+0000","last_fullsized":"2024-09-21T07:11:22.173665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.195945+0000","last_change":"2024-09-21T07:11:23.199608+0000","last_active":"2024-09-21T07:11:24.195945+0000","last_peered":"2024-09-21T07:11:24.195945+0000","last_clean":"2024-09-21T07:11:24.195945+0000","last_became_active":"2024-09-21T07:11:23.199290+0000","last_became_peered":"2024-09-21T07:11:23.199290+0000","last_unstale":"2024-09-21T07:11:24.195945+0000","last_undegraded":"2024-09-21T07:11:24.195945+0000","last_fullsized":"2024-09-21T07:11:24.195945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:10.764270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.213540+0000","last_change":"2024-09-21T07:11:24.211246+0000","last_active":"2024-09-21T07:11:24.213540+0000","last_peered":"2024-09-21T07:11:24.213540+0000","last_clean":"2024-09-21T07:11:24.213540+0000","last_became_active":"2024-09-21T07:11:24.210803+0000","last_became_peered":"2024-09-21T07:11:24.210803+0000","last_unstale":"2024-09-21T07:11:24.213540+0000","last_undegraded":"2024-09-21T07:11:24.213540+0000","last_fullsized":"2024-09-21T07:11:24.213540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:39.624284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:22.173665+0000","last_change":"2024-09-21T07:11:22.173665+0000","last_active":"2024-09-21T07:11:22.173665+0000","last_peered":"2024-09-21T07:11:22.173665+0000","last_clean":"2024-09-21T07:11:22.173665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:22.173665+0000","last_undegraded":"2024-09-21T07:11:22.173665+0000","last_fullsized":"2024-09-21T07:11:22.173665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.196184+0000","last_change":"2024-09-21T07:11:23.207317+0000","last_active":"2024-09-21T07:11:24.196184+0000","last_peered":"2024-09-21T07:11:24.196184+0000","last_clean":"2024-09-21T07:11:24.196184+0000","last_became_active":"2024-09-21T07:11:23.206996+0000","last_became_peered":"2024-09-21T07:11:23.206996+0000","last_unstale":"2024-09-21T07:11:24.196184+0000","last_undegraded":"2024-09-21T07:11:24.196184+0000","last_fullsized":"2024-09-21T07:11:24.196184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:13.900227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.220177+0000","last_change":"2024-09-21T07:11:24.211568+0000","last_active":"2024-09-21T07:11:24.220177+0000","last_peered":"2024-09-21T07:11:24.220177+0000","last_clean":"2024-09-21T07:11:24.220177+0000","last_became_active":"2024-09-21T07:11:24.210417+0000","last_became_peered":"2024-09-21T07:11:24.210417+0000","last_unstale":"2024-09-21T07:11:24.220177+0000","last_undegraded":"2024-09-21T07:11:24.220177+0000","last_fullsized":"2024-09-21T07:11:24.220177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:17.334466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207206+0000","last_change":"2024-09-21T07:11:23.202397+0000","last_active":"2024-09-21T07:11:25.207206+0000","last_peered":"2024-09-21T07:11:25.207206+0000","last_clean":"2024-09-21T07:11:25.207206+0000","last_became_active":"2024-09-21T07:11:23.202045+0000","last_became_peered":"2024-09-21T07:11:23.202045+0000","last_unstale":"2024-09-21T07:11:25.207206+0000","last_undegraded":"2024-09-21T07:11:25.207206+0000","last_fullsized":"2024-09-21T07:11:25.207206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:07.286401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.220730+0000","last_change":"2024-09-21T07:11:24.213578+0000","last_active":"2024-09-21T07:11:24.220730+0000","last_peered":"2024-09-21T07:11:24.220730+0000","last_clean":"2024-09-21T07:11:24.220730+0000","last_became_active":"2024-09-21T07:11:24.211919+0000","last_became_peered":"2024-09-21T07:11:24.211919+0000","last_unstale":"2024-09-21T07:11:24.220730+0000","last_undegraded":"2024-09-21T07:11:24.220730+0000","last_fullsized":"2024-09-21T07:11:24.220730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:02.299593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:22.173665+0000","last_change":"2024-09-21T07:11:22.173665+0000","last_active":"2024-09-21T07:11:22.173665+0000","last_peered":"2024-09-21T07:11:22.173665+0000","last_clean":"2024-09-21T07:11:22.173665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:22.173665+0000","last_undegraded":"2024-09-21T07:11:22.173665+0000","last_fullsized":"2024-09-21T07:11:22.173665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.229017+0000","last_change":"2024-09-21T07:11:23.205388+0000","last_active":"2024-09-21T07:11:24.229017+0000","last_peered":"2024-09-21T07:11:24.229017+0000","last_clean":"2024-09-21T07:11:24.229017+0000","last_became_active":"2024-09-21T07:11:23.204913+0000","last_became_peered":"2024-09-21T07:11:23.204913+0000","last_unstale":"2024-09-21T07:11:24.229017+0000","last_undegraded":"2024-09-21T07:11:24.229017+0000","last_fullsized":"2024-09-21T07:11:24.229017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:08.763096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.213287+0000","last_change":"2024-09-21T07:11:24.211156+0000","last_active":"2024-09-21T07:11:24.213287+0000","last_peered":"2024-09-21T07:11:24.213287+0000","last_clean":"2024-09-21T07:11:24.213287+0000","last_became_active":"2024-09-21T07:11:24.210869+0000","last_became_peered":"2024-09-21T07:11:24.210869+0000","last_unstale":"2024-09-21T07:11:24.213287+0000","last_undegraded":"2024-09-21T07:11:24.213287+0000","last_fullsized":"2024-09-21T07:11:24.213287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:20.285144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:22.173665+0000","last_change":"2024-09-21T07:11:22.173665+0000","last_active":"2024-09-21T07:11:22.173665+0000","last_peered":"2024-09-21T07:11:22.173665+0000","last_clean":"2024-09-21T07:11:22.173665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:22.173665+0000","last_undegraded":"2024-09-21T07:11:22.173665+0000","last_fullsized":"2024-09-21T07:11:22.173665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.205600+0000","last_change":"2024-09-21T07:11:24.204009+0000","last_active":"2024-09-21T07:11:24.205600+0000","last_peered":"2024-09-21T07:11:24.205600+0000","last_clean":"2024-09-21T07:11:24.205600+0000","last_became_active":"2024-09-21T07:11:24.202584+0000","last_became_peered":"2024-09-21T07:11:24.202584+0000","last_unstale":"2024-09-21T07:11:24.205600+0000","last_undegraded":"2024-09-21T07:11:24.205600+0000","last_fullsized":"2024-09-21T07:11:24.205600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:44.979488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.196530+0000","last_change":"2024-09-21T07:11:23.207609+0000","last_active":"2024-09-21T07:11:24.196530+0000","last_peered":"2024-09-21T07:11:24.196530+0000","last_clean":"2024-09-21T07:11:24.196530+0000","last_became_active":"2024-09-21T07:11:23.207225+0000","last_became_peered":"2024-09-21T07:11:23.207225+0000","last_unstale":"2024-09-21T07:11:24.196530+0000","last_undegraded":"2024-09-21T07:11:24.196530+0000","last_fullsized":"2024-09-21T07:11:24.196530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:25.327096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.196165+0000","last_change":"2024-09-21T07:11:23.207737+0000","last_active":"2024-09-21T07:11:24.196165+0000","last_peered":"2024-09-21T07:11:24.196165+0000","last_clean":"2024-09-21T07:11:24.196165+0000","last_became_active":"2024-09-21T07:11:23.207396+0000","last_became_peered":"2024-09-21T07:11:23.207396+0000","last_unstale":"2024-09-21T07:11:24.196165+0000","last_undegraded":"2024-09-21T07:11:24.196165+0000","last_fullsized":"2024-09-21T07:11:24.196165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:42.085081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.227650+0000","last_change":"2024-09-21T07:11:23.204186+0000","last_active":"2024-09-21T07:11:24.227650+0000","last_peered":"2024-09-21T07:11:24.227650+0000","last_clean":"2024-09-21T07:11:24.227650+0000","last_became_active":"2024-09-21T07:11:23.203721+0000","last_became_peered":"2024-09-21T07:11:23.203721+0000","last_unstale":"2024-09-21T07:11:24.227650+0000","last_undegraded":"2024-09-21T07:11:24.227650+0000","last_fullsized":"2024-09-21T07:11:24.227650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:36:47.323252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.221791+0000","last_change":"2024-09-21T07:11:23.208058+0000","last_active":"2024-09-21T07:11:24.221791+0000","last_peered":"2024-09-21T07:11:24.221791+0000","last_clean":"2024-09-21T07:11:24.221791+0000","last_became_active":"2024-09-21T07:11:23.207723+0000","last_became_peered":"2024-09-21T07:11:23.207723+0000","last_unstale":"2024-09-21T07:11:24.221791+0000","last_undegraded":"2024-09-21T07:11:24.221791+0000","last_fullsized":"2024-09-21T07:11:24.221791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:28.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:22.173665+0000","last_change":"2024-09-21T07:11:22.173665+0000","last_active":"2024-09-21T07:11:22.173665+0000","last_peered":"2024-09-21T07:11:22.173665+0000","last_clean":"2024-09-21T07:11:22.173665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:22.173665+0000","last_undegraded":"2024-09-21T07:11:22.173665+0000","last_fullsized":"2024-09-21T07:11:22.173665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.209345+0000","last_change":"2024-09-21T07:11:24.206200+0000","last_active":"2024-09-21T07:11:24.209345+0000","last_peered":"2024-09-21T07:11:24.209345+0000","last_clean":"2024-09-21T07:11:24.209345+0000","last_became_active":"2024-09-21T07:11:24.205869+0000","last_became_peered":"2024-09-21T07:11:24.205869+0000","last_unstale":"2024-09-21T07:11:24.209345+0000","last_undegraded":"2024-09-21T07:11:24.209345+0000","last_fullsized":"2024-09-21T07:11:24.209345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:02.269668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:22.173665+0000","last_change":"2024-09-21T07:11:22.173665+0000","last_active":"2024-09-21T07:11:22.173665+0000","last_peered":"2024-09-21T07:11:22.173665+0000","last_clean":"2024-09-21T07:11:22.173665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:22.173665+0000","last_undegraded":"2024-09-21T07:11:22.173665+0000","last_fullsized":"2024-09-21T07:11:22.173665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:22.173665+0000","last_change":"2024-09-21T07:11:22.173665+0000","last_active":"2024-09-21T07:11:22.173665+0000","last_peered":"2024-09-21T07:11:22.173665+0000","last_clean":"2024-09-21T07:11:22.173665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:22.173665+0000","last_undegraded":"2024-09-21T07:11:22.173665+0000","last_fullsized":"2024-09-21T07:11:22.173665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207249+0000","last_change":"2024-09-21T07:11:23.211434+0000","last_active":"2024-09-21T07:11:25.207249+0000","last_peered":"2024-09-21T07:11:25.207249+0000","last_clean":"2024-09-21T07:11:25.207249+0000","last_became_active":"2024-09-21T07:11:23.210906+0000","last_became_peered":"2024-09-21T07:11:23.210906+0000","last_unstale":"2024-09-21T07:11:25.207249+0000","last_undegraded":"2024-09-21T07:11:25.207249+0000","last_fullsized":"2024-09-21T07:11:25.207249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:34.514941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:22.173665+0000","last_change":"2024-09-21T07:11:22.173665+0000","last_active":"2024-09-21T07:11:22.173665+0000","last_peered":"2024-09-21T07:11:22.173665+0000","last_clean":"2024-09-21T07:11:22.173665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:22.173665+0000","last_undegraded":"2024-09-21T07:11:22.173665+0000","last_fullsized":"2024-09-21T07:11:22.173665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:22.173665+0000","last_change":"2024-09-21T07:11:22.173665+0000","last_active":"2024-09-21T07:11:22.173665+0000","last_peered":"2024-09-21T07:11:22.173665+0000","last_clean":"2024-09-21T07:11:22.173665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:22.173665+0000","last_undegraded":"2024-09-21T07:11:22.173665+0000","last_fullsized":"2024-09-21T07:11:22.173665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:22.173665+0000","last_change":"2024-09-21T07:11:22.173665+0000","last_active":"2024-09-21T07:11:22.173665+0000","last_peered":"2024-09-21T07:11:22.173665+0000","last_clean":"2024-09-21T07:11:22.173665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:22.173665+0000","last_undegraded":"2024-09-21T07:11:22.173665+0000","last_fullsized":"2024-09-21T07:11:22.173665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.220013+0000","last_change":"2024-09-21T07:11:23.205527+0000","last_active":"2024-09-21T07:11:24.220013+0000","last_peered":"2024-09-21T07:11:24.220013+0000","last_clean":"2024-09-21T07:11:24.220013+0000","last_became_active":"2024-09-21T07:11:23.204985+0000","last_became_peered":"2024-09-21T07:11:23.204985+0000","last_unstale":"2024-09-21T07:11:24.220013+0000","last_undegraded":"2024-09-21T07:11:24.220013+0000","last_fullsized":"2024-09-21T07:11:24.220013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:45:43.435561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207212+0000","last_change":"2024-09-21T07:11:23.205583+0000","last_active":"2024-09-21T07:11:25.207212+0000","last_peered":"2024-09-21T07:11:25.207212+0000","last_clean":"2024-09-21T07:11:25.207212+0000","last_became_active":"2024-09-21T07:11:23.205258+0000","last_became_peered":"2024-09-21T07:11:23.205258+0000","last_unstale":"2024-09-21T07:11:25.207212+0000","last_undegraded":"2024-09-21T07:11:25.207212+0000","last_fullsized":"2024-09-21T07:11:25.207212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:28.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207036+0000","last_change":"2024-09-21T07:11:24.214657+0000","last_active":"2024-09-21T07:11:25.207036+0000","last_peered":"2024-09-21T07:11:25.207036+0000","last_clean":"2024-09-21T07:11:25.207036+0000","last_became_active":"2024-09-21T07:11:24.212761+0000","last_became_peered":"2024-09-21T07:11:24.212761+0000","last_unstale":"2024-09-21T07:11:25.207036+0000","last_undegraded":"2024-09-21T07:11:25.207036+0000","last_fullsized":"2024-09-21T07:11:25.207036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:14.772321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.195965+0000","last_change":"2024-09-21T07:11:23.206444+0000","last_active":"2024-09-21T07:11:24.195965+0000","last_peered":"2024-09-21T07:11:24.195965+0000","last_clean":"2024-09-21T07:11:24.195965+0000","last_became_active":"2024-09-21T07:11:23.206077+0000","last_became_peered":"2024-09-21T07:11:23.206077+0000","last_unstale":"2024-09-21T07:11:24.195965+0000","last_undegraded":"2024-09-21T07:11:24.195965+0000","last_fullsized":"2024-09-21T07:11:24.195965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:34.514941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207397+0000","last_change":"2024-09-21T07:11:23.203244+0000","last_active":"2024-09-21T07:11:25.207397+0000","last_peered":"2024-09-21T07:11:25.207397+0000","last_clean":"2024-09-21T07:11:25.207397+0000","last_became_active":"2024-09-21T07:11:23.202786+0000","last_became_peered":"2024-09-21T07:11:23.202786+0000","last_unstale":"2024-09-21T07:11:25.207397+0000","last_undegraded":"2024-09-21T07:11:25.207397+0000","last_fullsized":"2024-09-21T07:11:25.207397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:45:43.435561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207301+0000","last_change":"2024-09-21T07:11:24.215505+0000","last_active":"2024-09-21T07:11:25.207301+0000","last_peered":"2024-09-21T07:11:25.207301+0000","last_clean":"2024-09-21T07:11:25.207301+0000","last_became_active":"2024-09-21T07:11:24.215033+0000","last_became_peered":"2024-09-21T07:11:24.215033+0000","last_unstale":"2024-09-21T07:11:25.207301+0000","last_undegraded":"2024-09-21T07:11:25.207301+0000","last_fullsized":"2024-09-21T07:11:25.207301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:59.577772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.196797+0000","last_change":"2024-09-21T07:11:23.202216+0000","last_active":"2024-09-21T07:11:24.196797+0000","last_peered":"2024-09-21T07:11:24.196797+0000","last_clean":"2024-09-21T07:11:24.196797+0000","last_became_active":"2024-09-21T07:11:23.200778+0000","last_became_peered":"2024-09-21T07:11:23.200778+0000","last_unstale":"2024-09-21T07:11:24.196797+0000","last_undegraded":"2024-09-21T07:11:24.196797+0000","last_fullsized":"2024-09-21T07:11:24.196797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:07.286401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.220842+0000","last_change":"2024-09-21T07:11:24.210116+0000","last_active":"2024-09-21T07:11:24.220842+0000","last_peered":"2024-09-21T07:11:24.220842+0000","last_clean":"2024-09-21T07:11:24.220842+0000","last_became_active":"2024-09-21T07:11:24.209729+0000","last_became_peered":"2024-09-21T07:11:24.209729+0000","last_unstale":"2024-09-21T07:11:24.220842+0000","last_undegraded":"2024-09-21T07:11:24.220842+0000","last_fullsized":"2024-09-21T07:11:24.220842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:57.216729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:22.173665+0000","last_change":"2024-09-21T07:11:22.173665+0000","last_active":"2024-09-21T07:11:22.173665+0000","last_peered":"2024-09-21T07:11:22.173665+0000","last_clean":"2024-09-21T07:11:22.173665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:22.173665+0000","last_undegraded":"2024-09-21T07:11:22.173665+0000","last_fullsized":"2024-09-21T07:11:22.173665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.200858+0000","last_change":"2024-09-21T07:11:23.207340+0000","last_active":"2024-09-21T07:11:24.200858+0000","last_peered":"2024-09-21T07:11:24.200858+0000","last_clean":"2024-09-21T07:11:24.200858+0000","last_became_active":"2024-09-21T07:11:23.207011+0000","last_became_peered":"2024-09-21T07:11:23.207011+0000","last_unstale":"2024-09-21T07:11:24.200858+0000","last_undegraded":"2024-09-21T07:11:24.200858+0000","last_fullsized":"2024-09-21T07:11:24.200858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:56.190723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:23.179224+0000","last_change":"2024-09-21T07:11:23.179224+0000","last_active":"2024-09-21T07:11:23.179224+0000","last_peered":"2024-09-21T07:11:23.179224+0000","last_clean":"2024-09-21T07:11:23.179224+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:23.179224+0000","last_undegraded":"2024-09-21T07:11:23.179224+0000","last_fullsized":"2024-09-21T07:11:23.179224+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:11:22.173665+0000","last_change":"2024-09-21T07:11:22.173665+0000","last_active":"2024-09-21T07:11:22.173665+0000","last_peered":"2024-09-21T07:11:22.173665+0000","last_clean":"2024-09-21T07:11:22.173665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:11:22.173665+0000","last_undegraded":"2024-09-21T07:11:22.173665+0000","last_fullsized":"2024-09-21T07:11:22.173665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":121,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-21T07:11:18.342274+0000","last_change":"2024-09-21T07:10:32.034091+0000","last_active":"2024-09-21T07:11:18.342274+0000","last_peered":"2024-09-21T07:11:18.342274+0000","last_clean":"2024-09-21T07:11:18.342274+0000","last_became_active":"2024-09-21T07:10:32.033005+0000","last_became_peered":"2024-09-21T07:10:32.033005+0000","last_unstale":"2024-09-21T07:11:18.342274+0000","last_undegraded":"2024-09-21T07:11:18.342274+0000","last_fullsized":"2024-09-21T07:11:18.342274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_clean_scrub_stamp":"2024-09-21T07:10:31.011167+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:10.064019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":34,"acting":34,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":897024,"data_stored":701520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31488,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":303104,"data_stored":111152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31500,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":303104,"data_stored":111152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31492,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":303104,"data_stored":111152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35648,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336192,"statfs":{"total":96636764160,"available":96600260608,"internally_reserved":0,"allocated":303104,"data_stored":111152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35696,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336144,"statfs":{"total":96636764160,"available":96600211456,"internally_reserved":0,"allocated":356352,"data_stored":131645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336136,"statfs":{"total":96636764160,"available":96600203264,"internally_reserved":0,"allocated":356352,"data_stored":131645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36268,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335572,"statfs":{"total":96636764160,"available":96599625728,"internally_reserved":0,"allocated":933888,"data_stored":720379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:11:28.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:11:28.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.427+0000 7f52271ba640 1 -- 172.21.15.18:0/2146538870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52200b5680 msgr2=0x7f52200b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:28.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.427+0000 7f52271ba640 1 --2- 172.21.15.18:0/2146538870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52200b5680 0x7f52200b5a90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5214009830 tx=0x7f521402a510 comp rx=0 tx=0).stop 2024-09-21T07:11:28.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.427+0000 7f52271ba640 1 -- 172.21.15.18:0/2146538870 shutdown_connections 2024-09-21T07:11:28.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.427+0000 7f52271ba640 1 --2- 172.21.15.18:0/2146538870 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f52200b5fd0 0x7f52200cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.427+0000 7f52271ba640 1 --2- 172.21.15.18:0/2146538870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52200b5680 0x7f52200b5a90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.427+0000 7f52271ba640 1 -- 172.21.15.18:0/2146538870 >> 172.21.15.18:0/2146538870 conn(0x7f5220074240 msgr2=0x7f522006cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:28.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.427+0000 7f52271ba640 1 -- 172.21.15.18:0/2146538870 shutdown_connections 2024-09-21T07:11:28.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.427+0000 7f52271ba640 1 -- 172.21.15.18:0/2146538870 wait complete. 2024-09-21T07:11:28.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.429+0000 7f52271ba640 1 Processor -- start 2024-09-21T07:11:28.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.429+0000 7f52271ba640 1 -- start start 2024-09-21T07:11:28.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.430+0000 7f52271ba640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f522006f7b0 0x7f52200afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:28.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.430+0000 7f52271ba640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f52200b5680 0x7f52201f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:28.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f52271ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52200b5fd0 0x7f52201f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f52271ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f52200d0180 con 0x7f52200b5fd0 2024-09-21T07:11:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f52271ba640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f52200d0000 con 0x7f522006f7b0 2024-09-21T07:11:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f52271ba640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f52200d0300 con 0x7f52200b5680 2024-09-21T07:11:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f5225757640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52200b5fd0 0x7f52201f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f5225757640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52200b5fd0 0x7f52201f6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60106/0 (socket says 172.21.15.18:60106) 2024-09-21T07:11:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f5225757640 1 -- 172.21.15.18:0/2440470673 learned_addr learned my addr 172.21.15.18:0/2440470673 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f5224f56640 1 --2- 172.21.15.18:0/2440470673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f522006f7b0 0x7f52200afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f521ffff640 1 --2- 172.21.15.18:0/2440470673 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f52200b5680 0x7f52201f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f5225757640 1 -- 172.21.15.18:0/2440470673 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f52200b5680 msgr2=0x7f52201f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f5225757640 1 --2- 172.21.15.18:0/2440470673 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f52200b5680 0x7f52201f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f5225757640 1 -- 172.21.15.18:0/2440470673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f522006f7b0 msgr2=0x7f52200afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f5225757640 1 --2- 172.21.15.18:0/2440470673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f522006f7b0 0x7f52200afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f5225757640 1 -- 172.21.15.18:0/2440470673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52201e4df0 con 0x7f52200b5fd0 2024-09-21T07:11:28.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f5225757640 1 --2- 172.21.15.18:0/2440470673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52200b5fd0 0x7f52201f6280 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f521800ea80 tx=0x7f521800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:28.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.431+0000 7f521d7fa640 1 -- 172.21.15.18:0/2440470673 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521800ce40 con 0x7f52200b5fd0 2024-09-21T07:11:28.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.432+0000 7f521d7fa640 1 -- 172.21.15.18:0/2440470673 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5218004b20 con 0x7f52200b5fd0 2024-09-21T07:11:28.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.432+0000 7f521d7fa640 1 -- 172.21.15.18:0/2440470673 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218005020 con 0x7f52200b5fd0 2024-09-21T07:11:28.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.432+0000 7f52271ba640 1 -- 172.21.15.18:0/2440470673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52201e50d0 con 0x7f52200b5fd0 2024-09-21T07:11:28.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.432+0000 7f52271ba640 1 -- 172.21.15.18:0/2440470673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52201e6c30 con 0x7f52200b5fd0 2024-09-21T07:11:28.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.433+0000 7f52271ba640 1 -- 172.21.15.18:0/2440470673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52201417a0 con 0x7f52200b5fd0 2024-09-21T07:11:28.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.433+0000 7f521d7fa640 1 -- 172.21.15.18:0/2440470673 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f52180051c0 con 0x7f52200b5fd0 2024-09-21T07:11:28.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.434+0000 7f521d7fa640 1 --2- 172.21.15.18:0/2440470673 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f520c078bc0 0x7f520c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:28.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.434+0000 7f521d7fa640 1 -- 172.21.15.18:0/2440470673 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f521809b720 con 0x7f52200b5fd0 2024-09-21T07:11:28.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.434+0000 7f5224f56640 1 --2- 172.21.15.18:0/2440470673 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f520c078bc0 0x7f520c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:28.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.435+0000 7f5224f56640 1 --2- 172.21.15.18:0/2440470673 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f520c078bc0 0x7f520c07b0d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f52200b6410 tx=0x7f5210007eb0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:28.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.439+0000 7f521d7fa640 1 -- 172.21.15.18:0/2440470673 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5218063630 con 0x7f52200b5fd0 2024-09-21T07:11:28.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.623+0000 7f52271ba640 1 -- 172.21.15.18:0/2440470673 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52201e4ba0 con 0x7f520c078bc0 2024-09-21T07:11:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.628+0000 7f521d7fa640 1 -- 172.21.15.18:0/2440470673 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f52201e4ba0 con 0x7f520c078bc0 2024-09-21T07:11:28.632 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:28.633 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-21T07:11:28.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.631+0000 7f52271ba640 1 -- 172.21.15.18:0/2440470673 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f520c078bc0 msgr2=0x7f520c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:28.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.631+0000 7f52271ba640 1 --2- 172.21.15.18:0/2440470673 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f520c078bc0 0x7f520c07b0d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f52200b6410 tx=0x7f5210007eb0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.631+0000 7f52271ba640 1 -- 172.21.15.18:0/2440470673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52200b5fd0 msgr2=0x7f52201f6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:28.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.631+0000 7f52271ba640 1 --2- 172.21.15.18:0/2440470673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52200b5fd0 0x7f52201f6280 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f521800ea80 tx=0x7f521800ef40 comp rx=0 tx=0).stop 2024-09-21T07:11:28.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.631+0000 7f52271ba640 1 -- 172.21.15.18:0/2440470673 shutdown_connections 2024-09-21T07:11:28.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.631+0000 7f52271ba640 1 --2- 172.21.15.18:0/2440470673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52200b5fd0 0x7f52201f6280 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.631+0000 7f52271ba640 1 --2- 172.21.15.18:0/2440470673 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f520c078bc0 0x7f520c07b0d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.631+0000 7f52271ba640 1 --2- 172.21.15.18:0/2440470673 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f52200b5680 0x7f52201f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.631+0000 7f52271ba640 1 --2- 172.21.15.18:0/2440470673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f522006f7b0 0x7f52200afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.631+0000 7f52271ba640 1 -- 172.21.15.18:0/2440470673 >> 172.21.15.18:0/2440470673 conn(0x7f5220074240 msgr2=0x7f522015c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:28.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.631+0000 7f52271ba640 1 -- 172.21.15.18:0/2440470673 shutdown_connections 2024-09-21T07:11:28.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.631+0000 7f52271ba640 1 -- 172.21.15.18:0/2440470673 wait complete. 2024-09-21T07:11:28.644 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-21T07:11:28.324712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":270108,"kb_used_data":3928,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754704612,"statfs":{"total":773094113280,"available":772817522688,"internally_reserved":0,"allocated":4022272,"data_stored":2250844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001281"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.585727+0000","last_change":"2024-09-21T07:11:24.216000+0000","last_active":"2024-09-21T07:11:25.585727+0000","last_peered":"2024-09-21T07:11:25.585727+0000","last_clean":"2024-09-21T07:11:25.585727+0000","last_became_active":"2024-09-21T07:11:24.215533+0000","last_became_peered":"2024-09-21T07:11:24.215533+0000","last_unstale":"2024-09-21T07:11:25.585727+0000","last_undegraded":"2024-09-21T07:11:25.585727+0000","last_fullsized":"2024-09-21T07:11:25.585727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:36.941139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.209445+0000","last_change":"2024-09-21T07:11:24.200982+0000","last_active":"2024-09-21T07:11:24.209445+0000","last_peered":"2024-09-21T07:11:24.209445+0000","last_clean":"2024-09-21T07:11:24.209445+0000","last_became_active":"2024-09-21T07:11:24.200516+0000","last_became_peered":"2024-09-21T07:11:24.200516+0000","last_unstale":"2024-09-21T07:11:24.209445+0000","last_undegraded":"2024-09-21T07:11:24.209445+0000","last_fullsized":"2024-09-21T07:11:24.209445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:51.075720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.209370+0000","last_change":"2024-09-21T07:11:24.206714+0000","last_active":"2024-09-21T07:11:25.209370+0000","last_peered":"2024-09-21T07:11:25.209370+0000","last_clean":"2024-09-21T07:11:25.209370+0000","last_became_active":"2024-09-21T07:11:24.206403+0000","last_became_peered":"2024-09-21T07:11:24.206403+0000","last_unstale":"2024-09-21T07:11:25.209370+0000","last_undegraded":"2024-09-21T07:11:25.209370+0000","last_fullsized":"2024-09-21T07:11:25.209370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:14.065709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.213329+0000","last_change":"2024-09-21T07:11:24.208989+0000","last_active":"2024-09-21T07:11:24.213329+0000","last_peered":"2024-09-21T07:11:24.213329+0000","last_clean":"2024-09-21T07:11:24.213329+0000","last_became_active":"2024-09-21T07:11:24.208288+0000","last_became_peered":"2024-09-21T07:11:24.208288+0000","last_unstale":"2024-09-21T07:11:24.213329+0000","last_undegraded":"2024-09-21T07:11:24.213329+0000","last_fullsized":"2024-09-21T07:11:24.213329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:48.695478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.208418+0000","last_change":"2024-09-21T07:11:24.206159+0000","last_active":"2024-09-21T07:11:25.208418+0000","last_peered":"2024-09-21T07:11:25.208418+0000","last_clean":"2024-09-21T07:11:25.208418+0000","last_became_active":"2024-09-21T07:11:24.205848+0000","last_became_peered":"2024-09-21T07:11:24.205848+0000","last_unstale":"2024-09-21T07:11:25.208418+0000","last_undegraded":"2024-09-21T07:11:25.208418+0000","last_fullsized":"2024-09-21T07:11:25.208418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:43.589115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.220734+0000","last_change":"2024-09-21T07:11:24.213190+0000","last_active":"2024-09-21T07:11:24.220734+0000","last_peered":"2024-09-21T07:11:24.220734+0000","last_clean":"2024-09-21T07:11:24.220734+0000","last_became_active":"2024-09-21T07:11:24.210515+0000","last_became_peered":"2024-09-21T07:11:24.210515+0000","last_unstale":"2024-09-21T07:11:24.220734+0000","last_undegraded":"2024-09-21T07:11:24.220734+0000","last_fullsized":"2024-09-21T07:11:24.220734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:47.164865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.342321+0000","last_change":"2024-09-21T07:11:24.214429+0000","last_active":"2024-09-21T07:11:25.342321+0000","last_peered":"2024-09-21T07:11:25.342321+0000","last_clean":"2024-09-21T07:11:25.342321+0000","last_became_active":"2024-09-21T07:11:24.214083+0000","last_became_peered":"2024-09-21T07:11:24.214083+0000","last_unstale":"2024-09-21T07:11:25.342321+0000","last_undegraded":"2024-09-21T07:11:25.342321+0000","last_fullsized":"2024-09-21T07:11:25.342321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:02.299593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.341816+0000","last_change":"2024-09-21T07:11:24.214827+0000","last_active":"2024-09-21T07:11:25.341816+0000","last_peered":"2024-09-21T07:11:25.341816+0000","last_clean":"2024-09-21T07:11:25.341816+0000","last_became_active":"2024-09-21T07:11:24.214106+0000","last_became_peered":"2024-09-21T07:11:24.214106+0000","last_unstale":"2024-09-21T07:11:25.341816+0000","last_undegraded":"2024-09-21T07:11:25.341816+0000","last_fullsized":"2024-09-21T07:11:25.341816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:51.295483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.586393+0000","last_change":"2024-09-21T07:11:24.222652+0000","last_active":"2024-09-21T07:11:25.586393+0000","last_peered":"2024-09-21T07:11:25.586393+0000","last_clean":"2024-09-21T07:11:25.586393+0000","last_became_active":"2024-09-21T07:11:24.222284+0000","last_became_peered":"2024-09-21T07:11:24.222284+0000","last_unstale":"2024-09-21T07:11:25.586393+0000","last_undegraded":"2024-09-21T07:11:25.586393+0000","last_fullsized":"2024-09-21T07:11:25.586393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:51.075720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.209250+0000","last_change":"2024-09-21T07:11:24.205973+0000","last_active":"2024-09-21T07:11:24.209250+0000","last_peered":"2024-09-21T07:11:24.209250+0000","last_clean":"2024-09-21T07:11:24.209250+0000","last_became_active":"2024-09-21T07:11:24.205581+0000","last_became_peered":"2024-09-21T07:11:24.205581+0000","last_unstale":"2024-09-21T07:11:24.209250+0000","last_undegraded":"2024-09-21T07:11:24.209250+0000","last_fullsized":"2024-09-21T07:11:24.209250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:50.190521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.342477+0000","last_change":"2024-09-21T07:11:24.220754+0000","last_active":"2024-09-21T07:11:25.342477+0000","last_peered":"2024-09-21T07:11:25.342477+0000","last_clean":"2024-09-21T07:11:25.342477+0000","last_became_active":"2024-09-21T07:11:24.220408+0000","last_became_peered":"2024-09-21T07:11:24.220408+0000","last_unstale":"2024-09-21T07:11:25.342477+0000","last_undegraded":"2024-09-21T07:11:25.342477+0000","last_fullsized":"2024-09-21T07:11:25.342477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:27.482013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.209098+0000","last_change":"2024-09-21T07:11:24.211649+0000","last_active":"2024-09-21T07:11:25.209098+0000","last_peered":"2024-09-21T07:11:25.209098+0000","last_clean":"2024-09-21T07:11:25.209098+0000","last_became_active":"2024-09-21T07:11:24.211013+0000","last_became_peered":"2024-09-21T07:11:24.211013+0000","last_unstale":"2024-09-21T07:11:25.209098+0000","last_undegraded":"2024-09-21T07:11:25.209098+0000","last_fullsized":"2024-09-21T07:11:25.209098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:03.319781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.208654+0000","last_change":"2024-09-21T07:11:24.209408+0000","last_active":"2024-09-21T07:11:25.208654+0000","last_peered":"2024-09-21T07:11:25.208654+0000","last_clean":"2024-09-21T07:11:25.208654+0000","last_became_active":"2024-09-21T07:11:24.209108+0000","last_became_peered":"2024-09-21T07:11:24.209108+0000","last_unstale":"2024-09-21T07:11:25.208654+0000","last_undegraded":"2024-09-21T07:11:25.208654+0000","last_fullsized":"2024-09-21T07:11:25.208654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:28.521307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.206161+0000","last_change":"2024-09-21T07:11:24.204195+0000","last_active":"2024-09-21T07:11:24.206161+0000","last_peered":"2024-09-21T07:11:24.206161+0000","last_clean":"2024-09-21T07:11:24.206161+0000","last_became_active":"2024-09-21T07:11:24.203720+0000","last_became_peered":"2024-09-21T07:11:24.203720+0000","last_unstale":"2024-09-21T07:11:24.206161+0000","last_undegraded":"2024-09-21T07:11:24.206161+0000","last_fullsized":"2024-09-21T07:11:24.206161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:02.507740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.209010+0000","last_change":"2024-09-21T07:11:24.212092+0000","last_active":"2024-09-21T07:11:25.209010+0000","last_peered":"2024-09-21T07:11:25.209010+0000","last_clean":"2024-09-21T07:11:25.209010+0000","last_became_active":"2024-09-21T07:11:24.211209+0000","last_became_peered":"2024-09-21T07:11:24.211209+0000","last_unstale":"2024-09-21T07:11:25.209010+0000","last_undegraded":"2024-09-21T07:11:25.209010+0000","last_fullsized":"2024-09-21T07:11:25.209010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:55.909607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.342407+0000","last_change":"2024-09-21T07:11:24.215178+0000","last_active":"2024-09-21T07:11:25.342407+0000","last_peered":"2024-09-21T07:11:25.342407+0000","last_clean":"2024-09-21T07:11:25.342407+0000","last_became_active":"2024-09-21T07:11:24.214513+0000","last_became_peered":"2024-09-21T07:11:24.214513+0000","last_unstale":"2024-09-21T07:11:25.342407+0000","last_undegraded":"2024-09-21T07:11:25.342407+0000","last_fullsized":"2024-09-21T07:11:25.342407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:18.542064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.342529+0000","last_change":"2024-09-21T07:11:24.212618+0000","last_active":"2024-09-21T07:11:25.342529+0000","last_peered":"2024-09-21T07:11:25.342529+0000","last_clean":"2024-09-21T07:11:25.342529+0000","last_became_active":"2024-09-21T07:11:24.212211+0000","last_became_peered":"2024-09-21T07:11:24.212211+0000","last_unstale":"2024-09-21T07:11:25.342529+0000","last_undegraded":"2024-09-21T07:11:25.342529+0000","last_fullsized":"2024-09-21T07:11:25.342529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:09.419420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.219178+0000","last_change":"2024-09-21T07:11:24.210512+0000","last_active":"2024-09-21T07:11:24.219178+0000","last_peered":"2024-09-21T07:11:24.219178+0000","last_clean":"2024-09-21T07:11:24.219178+0000","last_became_active":"2024-09-21T07:11:24.209904+0000","last_became_peered":"2024-09-21T07:11:24.209904+0000","last_unstale":"2024-09-21T07:11:24.219178+0000","last_undegraded":"2024-09-21T07:11:24.219178+0000","last_fullsized":"2024-09-21T07:11:24.219178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:52.156830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.219130+0000","last_change":"2024-09-21T07:11:24.211044+0000","last_active":"2024-09-21T07:11:24.219130+0000","last_peered":"2024-09-21T07:11:24.219130+0000","last_clean":"2024-09-21T07:11:24.219130+0000","last_became_active":"2024-09-21T07:11:24.210706+0000","last_became_peered":"2024-09-21T07:11:24.210706+0000","last_unstale":"2024-09-21T07:11:24.219130+0000","last_undegraded":"2024-09-21T07:11:24.219130+0000","last_fullsized":"2024-09-21T07:11:24.219130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:04.526473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.208571+0000","last_change":"2024-09-21T07:11:24.214106+0000","last_active":"2024-09-21T07:11:25.208571+0000","last_peered":"2024-09-21T07:11:25.208571+0000","last_clean":"2024-09-21T07:11:25.208571+0000","last_became_active":"2024-09-21T07:11:24.213842+0000","last_became_peered":"2024-09-21T07:11:24.213842+0000","last_unstale":"2024-09-21T07:11:25.208571+0000","last_undegraded":"2024-09-21T07:11:25.208571+0000","last_fullsized":"2024-09-21T07:11:25.208571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:58.142163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.586435+0000","last_change":"2024-09-21T07:11:24.215966+0000","last_active":"2024-09-21T07:11:25.586435+0000","last_peered":"2024-09-21T07:11:25.586435+0000","last_clean":"2024-09-21T07:11:25.586435+0000","last_became_active":"2024-09-21T07:11:24.215626+0000","last_became_peered":"2024-09-21T07:11:24.215626+0000","last_unstale":"2024-09-21T07:11:25.586435+0000","last_undegraded":"2024-09-21T07:11:25.586435+0000","last_fullsized":"2024-09-21T07:11:25.586435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:44.979488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.586114+0000","last_change":"2024-09-21T07:11:24.215072+0000","last_active":"2024-09-21T07:11:25.586114+0000","last_peered":"2024-09-21T07:11:25.586114+0000","last_clean":"2024-09-21T07:11:25.586114+0000","last_became_active":"2024-09-21T07:11:24.214775+0000","last_became_peered":"2024-09-21T07:11:24.214775+0000","last_unstale":"2024-09-21T07:11:25.586114+0000","last_undegraded":"2024-09-21T07:11:25.586114+0000","last_fullsized":"2024-09-21T07:11:25.586114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:59.881040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.206935+0000","last_change":"2024-09-21T07:11:24.209933+0000","last_active":"2024-09-21T07:11:25.206935+0000","last_peered":"2024-09-21T07:11:25.206935+0000","last_clean":"2024-09-21T07:11:25.206935+0000","last_became_active":"2024-09-21T07:11:24.209622+0000","last_became_peered":"2024-09-21T07:11:24.209622+0000","last_unstale":"2024-09-21T07:11:25.206935+0000","last_undegraded":"2024-09-21T07:11:25.206935+0000","last_fullsized":"2024-09-21T07:11:25.206935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:39.624284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.208835+0000","last_change":"2024-09-21T07:11:24.205414+0000","last_active":"2024-09-21T07:11:25.208835+0000","last_peered":"2024-09-21T07:11:25.208835+0000","last_clean":"2024-09-21T07:11:25.208835+0000","last_became_active":"2024-09-21T07:11:24.205051+0000","last_became_peered":"2024-09-21T07:11:24.205051+0000","last_unstale":"2024-09-21T07:11:25.208835+0000","last_undegraded":"2024-09-21T07:11:25.208835+0000","last_fullsized":"2024-09-21T07:11:25.208835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:51.000445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.221029+0000","last_change":"2024-09-21T07:11:24.219903+0000","last_active":"2024-09-21T07:11:24.221029+0000","last_peered":"2024-09-21T07:11:24.221029+0000","last_clean":"2024-09-21T07:11:24.221029+0000","last_became_active":"2024-09-21T07:11:24.219362+0000","last_became_peered":"2024-09-21T07:11:24.219362+0000","last_unstale":"2024-09-21T07:11:24.221029+0000","last_undegraded":"2024-09-21T07:11:24.221029+0000","last_fullsized":"2024-09-21T07:11:24.221029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:59.577772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.220918+0000","last_change":"2024-09-21T07:11:24.216562+0000","last_active":"2024-09-21T07:11:24.220918+0000","last_peered":"2024-09-21T07:11:24.220918+0000","last_clean":"2024-09-21T07:11:24.220918+0000","last_became_active":"2024-09-21T07:11:24.216233+0000","last_became_peered":"2024-09-21T07:11:24.216233+0000","last_unstale":"2024-09-21T07:11:24.220918+0000","last_undegraded":"2024-09-21T07:11:24.220918+0000","last_fullsized":"2024-09-21T07:11:24.220918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:18.542064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.217532+0000","last_change":"2024-09-21T07:11:24.214460+0000","last_active":"2024-09-21T07:11:24.217532+0000","last_peered":"2024-09-21T07:11:24.217532+0000","last_clean":"2024-09-21T07:11:24.217532+0000","last_became_active":"2024-09-21T07:11:24.213761+0000","last_became_peered":"2024-09-21T07:11:24.213761+0000","last_unstale":"2024-09-21T07:11:24.217532+0000","last_undegraded":"2024-09-21T07:11:24.217532+0000","last_fullsized":"2024-09-21T07:11:24.217532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:07.008536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.209362+0000","last_change":"2024-09-21T07:11:24.211332+0000","last_active":"2024-09-21T07:11:25.209362+0000","last_peered":"2024-09-21T07:11:25.209362+0000","last_clean":"2024-09-21T07:11:25.209362+0000","last_became_active":"2024-09-21T07:11:24.210669+0000","last_became_peered":"2024-09-21T07:11:24.210669+0000","last_unstale":"2024-09-21T07:11:25.209362+0000","last_undegraded":"2024-09-21T07:11:25.209362+0000","last_fullsized":"2024-09-21T07:11:25.209362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:19.958195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.586455+0000","last_change":"2024-09-21T07:11:24.214908+0000","last_active":"2024-09-21T07:11:25.586455+0000","last_peered":"2024-09-21T07:11:25.586455+0000","last_clean":"2024-09-21T07:11:25.586455+0000","last_became_active":"2024-09-21T07:11:24.214570+0000","last_became_peered":"2024-09-21T07:11:24.214570+0000","last_unstale":"2024-09-21T07:11:25.586455+0000","last_undegraded":"2024-09-21T07:11:25.586455+0000","last_fullsized":"2024-09-21T07:11:25.586455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:02.507740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.342102+0000","last_change":"2024-09-21T07:11:24.212714+0000","last_active":"2024-09-21T07:11:25.342102+0000","last_peered":"2024-09-21T07:11:25.342102+0000","last_clean":"2024-09-21T07:11:25.342102+0000","last_became_active":"2024-09-21T07:11:24.212180+0000","last_became_peered":"2024-09-21T07:11:24.212180+0000","last_unstale":"2024-09-21T07:11:25.342102+0000","last_undegraded":"2024-09-21T07:11:25.342102+0000","last_fullsized":"2024-09-21T07:11:25.342102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:04.526473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.585952+0000","last_change":"2024-09-21T07:11:24.207235+0000","last_active":"2024-09-21T07:11:25.585952+0000","last_peered":"2024-09-21T07:11:25.585952+0000","last_clean":"2024-09-21T07:11:25.585952+0000","last_became_active":"2024-09-21T07:11:24.206688+0000","last_became_peered":"2024-09-21T07:11:24.206688+0000","last_unstale":"2024-09-21T07:11:25.585952+0000","last_undegraded":"2024-09-21T07:11:25.585952+0000","last_fullsized":"2024-09-21T07:11:25.585952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:14.905787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.341799+0000","last_change":"2024-09-21T07:11:24.219175+0000","last_active":"2024-09-21T07:11:25.341799+0000","last_peered":"2024-09-21T07:11:25.341799+0000","last_clean":"2024-09-21T07:11:25.341799+0000","last_became_active":"2024-09-21T07:11:24.218783+0000","last_became_peered":"2024-09-21T07:11:24.218783+0000","last_unstale":"2024-09-21T07:11:25.341799+0000","last_undegraded":"2024-09-21T07:11:25.341799+0000","last_fullsized":"2024-09-21T07:11:25.341799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:02.507740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207088+0000","last_change":"2024-09-21T07:11:24.215755+0000","last_active":"2024-09-21T07:11:25.207088+0000","last_peered":"2024-09-21T07:11:25.207088+0000","last_clean":"2024-09-21T07:11:25.207088+0000","last_became_active":"2024-09-21T07:11:24.215411+0000","last_became_peered":"2024-09-21T07:11:24.215411+0000","last_unstale":"2024-09-21T07:11:25.207088+0000","last_undegraded":"2024-09-21T07:11:25.207088+0000","last_fullsized":"2024-09-21T07:11:25.207088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:07.008536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.585891+0000","last_change":"2024-09-21T07:11:23.202906+0000","last_active":"2024-09-21T07:11:25.585891+0000","last_peered":"2024-09-21T07:11:25.585891+0000","last_clean":"2024-09-21T07:11:25.585891+0000","last_became_active":"2024-09-21T07:11:23.202497+0000","last_became_peered":"2024-09-21T07:11:23.202497+0000","last_unstale":"2024-09-21T07:11:25.585891+0000","last_undegraded":"2024-09-21T07:11:25.585891+0000","last_fullsized":"2024-09-21T07:11:25.585891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:45.781193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.586136+0000","last_change":"2024-09-21T07:11:24.213697+0000","last_active":"2024-09-21T07:11:25.586136+0000","last_peered":"2024-09-21T07:11:25.586136+0000","last_clean":"2024-09-21T07:11:25.586136+0000","last_became_active":"2024-09-21T07:11:24.211891+0000","last_became_peered":"2024-09-21T07:11:24.211891+0000","last_unstale":"2024-09-21T07:11:25.586136+0000","last_undegraded":"2024-09-21T07:11:25.586136+0000","last_fullsized":"2024-09-21T07:11:25.586136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:15.033944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207152+0000","last_change":"2024-09-21T07:11:23.206667+0000","last_active":"2024-09-21T07:11:25.207152+0000","last_peered":"2024-09-21T07:11:25.207152+0000","last_clean":"2024-09-21T07:11:25.207152+0000","last_became_active":"2024-09-21T07:11:23.206340+0000","last_became_peered":"2024-09-21T07:11:23.206340+0000","last_unstale":"2024-09-21T07:11:25.207152+0000","last_undegraded":"2024-09-21T07:11:25.207152+0000","last_fullsized":"2024-09-21T07:11:25.207152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:25.327096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.586046+0000","last_change":"2024-09-21T07:11:24.215997+0000","last_active":"2024-09-21T07:11:25.586046+0000","last_peered":"2024-09-21T07:11:25.586046+0000","last_clean":"2024-09-21T07:11:25.586046+0000","last_became_active":"2024-09-21T07:11:24.215665+0000","last_became_peered":"2024-09-21T07:11:24.215665+0000","last_unstale":"2024-09-21T07:11:25.586046+0000","last_undegraded":"2024-09-21T07:11:25.586046+0000","last_fullsized":"2024-09-21T07:11:25.586046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:36:48.328812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.226685+0000","last_change":"2024-09-21T07:11:23.203172+0000","last_active":"2024-09-21T07:11:24.226685+0000","last_peered":"2024-09-21T07:11:24.226685+0000","last_clean":"2024-09-21T07:11:24.226685+0000","last_became_active":"2024-09-21T07:11:23.202792+0000","last_became_peered":"2024-09-21T07:11:23.202792+0000","last_unstale":"2024-09-21T07:11:24.226685+0000","last_undegraded":"2024-09-21T07:11:24.226685+0000","last_fullsized":"2024-09-21T07:11:24.226685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:57.855736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.215622+0000","last_change":"2024-09-21T07:11:24.214085+0000","last_active":"2024-09-21T07:11:24.215622+0000","last_peered":"2024-09-21T07:11:24.215622+0000","last_clean":"2024-09-21T07:11:24.215622+0000","last_became_active":"2024-09-21T07:11:24.213156+0000","last_became_peered":"2024-09-21T07:11:24.213156+0000","last_unstale":"2024-09-21T07:11:24.215622+0000","last_undegraded":"2024-09-21T07:11:24.215622+0000","last_fullsized":"2024-09-21T07:11:24.215622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:14.772321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.208624+0000","last_change":"2024-09-21T07:11:23.205559+0000","last_active":"2024-09-21T07:11:25.208624+0000","last_peered":"2024-09-21T07:11:25.208624+0000","last_clean":"2024-09-21T07:11:25.208624+0000","last_became_active":"2024-09-21T07:11:23.205220+0000","last_became_peered":"2024-09-21T07:11:23.205220+0000","last_unstale":"2024-09-21T07:11:25.208624+0000","last_undegraded":"2024-09-21T07:11:25.208624+0000","last_fullsized":"2024-09-21T07:11:25.208624+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:34.879483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.342081+0000","last_change":"2024-09-21T07:11:24.224479+0000","last_active":"2024-09-21T07:11:25.342081+0000","last_peered":"2024-09-21T07:11:25.342081+0000","last_clean":"2024-09-21T07:11:25.342081+0000","last_became_active":"2024-09-21T07:11:24.223942+0000","last_became_peered":"2024-09-21T07:11:24.223942+0000","last_unstale":"2024-09-21T07:11:25.342081+0000","last_undegraded":"2024-09-21T07:11:25.342081+0000","last_fullsized":"2024-09-21T07:11:25.342081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:55.909607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.586597+0000","last_change":"2024-09-21T07:11:23.207181+0000","last_active":"2024-09-21T07:11:25.586597+0000","last_peered":"2024-09-21T07:11:25.586597+0000","last_clean":"2024-09-21T07:11:25.586597+0000","last_became_active":"2024-09-21T07:11:23.206743+0000","last_became_peered":"2024-09-21T07:11:23.206743+0000","last_unstale":"2024-09-21T07:11:25.586597+0000","last_undegraded":"2024-09-21T07:11:25.586597+0000","last_fullsized":"2024-09-21T07:11:25.586597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:47.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.209303+0000","last_change":"2024-09-21T07:11:24.210326+0000","last_active":"2024-09-21T07:11:25.209303+0000","last_peered":"2024-09-21T07:11:25.209303+0000","last_clean":"2024-09-21T07:11:25.209303+0000","last_became_active":"2024-09-21T07:11:24.209795+0000","last_became_peered":"2024-09-21T07:11:24.209795+0000","last_unstale":"2024-09-21T07:11:25.209303+0000","last_undegraded":"2024-09-21T07:11:25.209303+0000","last_fullsized":"2024-09-21T07:11:25.209303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:35.755470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.585770+0000","last_change":"2024-09-21T07:11:23.207042+0000","last_active":"2024-09-21T07:11:25.585770+0000","last_peered":"2024-09-21T07:11:25.585770+0000","last_clean":"2024-09-21T07:11:25.585770+0000","last_became_active":"2024-09-21T07:11:23.206675+0000","last_became_peered":"2024-09-21T07:11:23.206675+0000","last_unstale":"2024-09-21T07:11:25.585770+0000","last_undegraded":"2024-09-21T07:11:25.585770+0000","last_fullsized":"2024-09-21T07:11:25.585770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:25.309642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.585644+0000","last_change":"2024-09-21T07:11:24.216473+0000","last_active":"2024-09-21T07:11:25.585644+0000","last_peered":"2024-09-21T07:11:25.585644+0000","last_clean":"2024-09-21T07:11:25.585644+0000","last_became_active":"2024-09-21T07:11:24.216148+0000","last_became_peered":"2024-09-21T07:11:24.216148+0000","last_unstale":"2024-09-21T07:11:25.585644+0000","last_undegraded":"2024-09-21T07:11:25.585644+0000","last_fullsized":"2024-09-21T07:11:25.585644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:58.861296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.195945+0000","last_change":"2024-09-21T07:11:23.199608+0000","last_active":"2024-09-21T07:11:24.195945+0000","last_peered":"2024-09-21T07:11:24.195945+0000","last_clean":"2024-09-21T07:11:24.195945+0000","last_became_active":"2024-09-21T07:11:23.199290+0000","last_became_peered":"2024-09-21T07:11:23.199290+0000","last_unstale":"2024-09-21T07:11:24.195945+0000","last_undegraded":"2024-09-21T07:11:24.195945+0000","last_fullsized":"2024-09-21T07:11:24.195945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:10.764270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.213540+0000","last_change":"2024-09-21T07:11:24.211246+0000","last_active":"2024-09-21T07:11:24.213540+0000","last_peered":"2024-09-21T07:11:24.213540+0000","last_clean":"2024-09-21T07:11:24.213540+0000","last_became_active":"2024-09-21T07:11:24.210803+0000","last_became_peered":"2024-09-21T07:11:24.210803+0000","last_unstale":"2024-09-21T07:11:24.213540+0000","last_undegraded":"2024-09-21T07:11:24.213540+0000","last_fullsized":"2024-09-21T07:11:24.213540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:39.624284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.585851+0000","last_change":"2024-09-21T07:11:23.202337+0000","last_active":"2024-09-21T07:11:25.585851+0000","last_peered":"2024-09-21T07:11:25.585851+0000","last_clean":"2024-09-21T07:11:25.585851+0000","last_became_active":"2024-09-21T07:11:23.201904+0000","last_became_peered":"2024-09-21T07:11:23.201904+0000","last_unstale":"2024-09-21T07:11:25.585851+0000","last_undegraded":"2024-09-21T07:11:25.585851+0000","last_fullsized":"2024-09-21T07:11:25.585851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:48.489856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.209380+0000","last_change":"2024-09-21T07:11:24.207172+0000","last_active":"2024-09-21T07:11:25.209380+0000","last_peered":"2024-09-21T07:11:25.209380+0000","last_clean":"2024-09-21T07:11:25.209380+0000","last_became_active":"2024-09-21T07:11:24.206068+0000","last_became_peered":"2024-09-21T07:11:24.206068+0000","last_unstale":"2024-09-21T07:11:25.209380+0000","last_undegraded":"2024-09-21T07:11:25.209380+0000","last_fullsized":"2024-09-21T07:11:25.209380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:22.210989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.196184+0000","last_change":"2024-09-21T07:11:23.207317+0000","last_active":"2024-09-21T07:11:24.196184+0000","last_peered":"2024-09-21T07:11:24.196184+0000","last_clean":"2024-09-21T07:11:24.196184+0000","last_became_active":"2024-09-21T07:11:23.206996+0000","last_became_peered":"2024-09-21T07:11:23.206996+0000","last_unstale":"2024-09-21T07:11:24.196184+0000","last_undegraded":"2024-09-21T07:11:24.196184+0000","last_fullsized":"2024-09-21T07:11:24.196184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:13.900227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.220177+0000","last_change":"2024-09-21T07:11:24.211568+0000","last_active":"2024-09-21T07:11:24.220177+0000","last_peered":"2024-09-21T07:11:24.220177+0000","last_clean":"2024-09-21T07:11:24.220177+0000","last_became_active":"2024-09-21T07:11:24.210417+0000","last_became_peered":"2024-09-21T07:11:24.210417+0000","last_unstale":"2024-09-21T07:11:24.220177+0000","last_undegraded":"2024-09-21T07:11:24.220177+0000","last_fullsized":"2024-09-21T07:11:24.220177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:17.334466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207206+0000","last_change":"2024-09-21T07:11:23.202397+0000","last_active":"2024-09-21T07:11:25.207206+0000","last_peered":"2024-09-21T07:11:25.207206+0000","last_clean":"2024-09-21T07:11:25.207206+0000","last_became_active":"2024-09-21T07:11:23.202045+0000","last_became_peered":"2024-09-21T07:11:23.202045+0000","last_unstale":"2024-09-21T07:11:25.207206+0000","last_undegraded":"2024-09-21T07:11:25.207206+0000","last_fullsized":"2024-09-21T07:11:25.207206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:07.286401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.220730+0000","last_change":"2024-09-21T07:11:24.213578+0000","last_active":"2024-09-21T07:11:24.220730+0000","last_peered":"2024-09-21T07:11:24.220730+0000","last_clean":"2024-09-21T07:11:24.220730+0000","last_became_active":"2024-09-21T07:11:24.211919+0000","last_became_peered":"2024-09-21T07:11:24.211919+0000","last_unstale":"2024-09-21T07:11:24.220730+0000","last_undegraded":"2024-09-21T07:11:24.220730+0000","last_fullsized":"2024-09-21T07:11:24.220730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:02.299593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.209419+0000","last_change":"2024-09-21T07:11:23.205228+0000","last_active":"2024-09-21T07:11:25.209419+0000","last_peered":"2024-09-21T07:11:25.209419+0000","last_clean":"2024-09-21T07:11:25.209419+0000","last_became_active":"2024-09-21T07:11:23.204900+0000","last_became_peered":"2024-09-21T07:11:23.204900+0000","last_unstale":"2024-09-21T07:11:25.209419+0000","last_undegraded":"2024-09-21T07:11:25.209419+0000","last_fullsized":"2024-09-21T07:11:25.209419+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:21.153477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.209223+0000","last_change":"2024-09-21T07:11:24.209983+0000","last_active":"2024-09-21T07:11:25.209223+0000","last_peered":"2024-09-21T07:11:25.209223+0000","last_clean":"2024-09-21T07:11:25.209223+0000","last_became_active":"2024-09-21T07:11:24.209608+0000","last_became_peered":"2024-09-21T07:11:24.209608+0000","last_unstale":"2024-09-21T07:11:25.209223+0000","last_undegraded":"2024-09-21T07:11:25.209223+0000","last_fullsized":"2024-09-21T07:11:25.209223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:04.780169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.229017+0000","last_change":"2024-09-21T07:11:23.205388+0000","last_active":"2024-09-21T07:11:24.229017+0000","last_peered":"2024-09-21T07:11:24.229017+0000","last_clean":"2024-09-21T07:11:24.229017+0000","last_became_active":"2024-09-21T07:11:23.204913+0000","last_became_peered":"2024-09-21T07:11:23.204913+0000","last_unstale":"2024-09-21T07:11:24.229017+0000","last_undegraded":"2024-09-21T07:11:24.229017+0000","last_fullsized":"2024-09-21T07:11:24.229017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:08.763096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.213287+0000","last_change":"2024-09-21T07:11:24.211156+0000","last_active":"2024-09-21T07:11:24.213287+0000","last_peered":"2024-09-21T07:11:24.213287+0000","last_clean":"2024-09-21T07:11:24.213287+0000","last_became_active":"2024-09-21T07:11:24.210869+0000","last_became_peered":"2024-09-21T07:11:24.210869+0000","last_unstale":"2024-09-21T07:11:24.213287+0000","last_undegraded":"2024-09-21T07:11:24.213287+0000","last_fullsized":"2024-09-21T07:11:24.213287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:20.285144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.586597+0000","last_change":"2024-09-21T07:11:23.202747+0000","last_active":"2024-09-21T07:11:25.586597+0000","last_peered":"2024-09-21T07:11:25.586597+0000","last_clean":"2024-09-21T07:11:25.586597+0000","last_became_active":"2024-09-21T07:11:23.201894+0000","last_became_peered":"2024-09-21T07:11:23.201894+0000","last_unstale":"2024-09-21T07:11:25.586597+0000","last_undegraded":"2024-09-21T07:11:25.586597+0000","last_fullsized":"2024-09-21T07:11:25.586597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:55.216812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.205600+0000","last_change":"2024-09-21T07:11:24.204009+0000","last_active":"2024-09-21T07:11:24.205600+0000","last_peered":"2024-09-21T07:11:24.205600+0000","last_clean":"2024-09-21T07:11:24.205600+0000","last_became_active":"2024-09-21T07:11:24.202584+0000","last_became_peered":"2024-09-21T07:11:24.202584+0000","last_unstale":"2024-09-21T07:11:24.205600+0000","last_undegraded":"2024-09-21T07:11:24.205600+0000","last_fullsized":"2024-09-21T07:11:24.205600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:44.979488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.196530+0000","last_change":"2024-09-21T07:11:23.207609+0000","last_active":"2024-09-21T07:11:24.196530+0000","last_peered":"2024-09-21T07:11:24.196530+0000","last_clean":"2024-09-21T07:11:24.196530+0000","last_became_active":"2024-09-21T07:11:23.207225+0000","last_became_peered":"2024-09-21T07:11:23.207225+0000","last_unstale":"2024-09-21T07:11:24.196530+0000","last_undegraded":"2024-09-21T07:11:24.196530+0000","last_fullsized":"2024-09-21T07:11:24.196530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:25.327096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.342120+0000","last_change":"2024-09-21T07:11:24.223949+0000","last_active":"2024-09-21T07:11:25.342120+0000","last_peered":"2024-09-21T07:11:25.342120+0000","last_clean":"2024-09-21T07:11:25.342120+0000","last_became_active":"2024-09-21T07:11:24.222880+0000","last_became_peered":"2024-09-21T07:11:24.222880+0000","last_unstale":"2024-09-21T07:11:25.342120+0000","last_undegraded":"2024-09-21T07:11:25.342120+0000","last_fullsized":"2024-09-21T07:11:25.342120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:47.164865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.196165+0000","last_change":"2024-09-21T07:11:23.207737+0000","last_active":"2024-09-21T07:11:24.196165+0000","last_peered":"2024-09-21T07:11:24.196165+0000","last_clean":"2024-09-21T07:11:24.196165+0000","last_became_active":"2024-09-21T07:11:23.207396+0000","last_became_peered":"2024-09-21T07:11:23.207396+0000","last_unstale":"2024-09-21T07:11:24.196165+0000","last_undegraded":"2024-09-21T07:11:24.196165+0000","last_fullsized":"2024-09-21T07:11:24.196165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:42.085081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.585248+0000","last_change":"2024-09-21T07:11:24.211361+0000","last_active":"2024-09-21T07:11:25.585248+0000","last_peered":"2024-09-21T07:11:25.585248+0000","last_clean":"2024-09-21T07:11:25.585248+0000","last_became_active":"2024-09-21T07:11:24.210972+0000","last_became_peered":"2024-09-21T07:11:24.210972+0000","last_unstale":"2024-09-21T07:11:25.585248+0000","last_undegraded":"2024-09-21T07:11:25.585248+0000","last_fullsized":"2024-09-21T07:11:25.585248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:14.434502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.227650+0000","last_change":"2024-09-21T07:11:23.204186+0000","last_active":"2024-09-21T07:11:24.227650+0000","last_peered":"2024-09-21T07:11:24.227650+0000","last_clean":"2024-09-21T07:11:24.227650+0000","last_became_active":"2024-09-21T07:11:23.203721+0000","last_became_peered":"2024-09-21T07:11:23.203721+0000","last_unstale":"2024-09-21T07:11:24.227650+0000","last_undegraded":"2024-09-21T07:11:24.227650+0000","last_fullsized":"2024-09-21T07:11:24.227650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:36:47.323252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.586102+0000","last_change":"2024-09-21T07:11:24.217149+0000","last_active":"2024-09-21T07:11:25.586102+0000","last_peered":"2024-09-21T07:11:25.586102+0000","last_clean":"2024-09-21T07:11:25.586102+0000","last_became_active":"2024-09-21T07:11:24.216854+0000","last_became_peered":"2024-09-21T07:11:24.216854+0000","last_unstale":"2024-09-21T07:11:25.586102+0000","last_undegraded":"2024-09-21T07:11:25.586102+0000","last_fullsized":"2024-09-21T07:11:25.586102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:24.595356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.221791+0000","last_change":"2024-09-21T07:11:23.208058+0000","last_active":"2024-09-21T07:11:24.221791+0000","last_peered":"2024-09-21T07:11:24.221791+0000","last_clean":"2024-09-21T07:11:24.221791+0000","last_became_active":"2024-09-21T07:11:23.207723+0000","last_became_peered":"2024-09-21T07:11:23.207723+0000","last_unstale":"2024-09-21T07:11:24.221791+0000","last_undegraded":"2024-09-21T07:11:24.221791+0000","last_fullsized":"2024-09-21T07:11:24.221791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:28.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.209564+0000","last_change":"2024-09-21T07:11:24.218494+0000","last_active":"2024-09-21T07:11:25.209564+0000","last_peered":"2024-09-21T07:11:25.209564+0000","last_clean":"2024-09-21T07:11:25.209564+0000","last_became_active":"2024-09-21T07:11:24.218136+0000","last_became_peered":"2024-09-21T07:11:24.218136+0000","last_unstale":"2024-09-21T07:11:25.209564+0000","last_undegraded":"2024-09-21T07:11:25.209564+0000","last_fullsized":"2024-09-21T07:11:25.209564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:00.655160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.585835+0000","last_change":"2024-09-21T07:11:23.205359+0000","last_active":"2024-09-21T07:11:25.585835+0000","last_peered":"2024-09-21T07:11:25.585835+0000","last_clean":"2024-09-21T07:11:25.585835+0000","last_became_active":"2024-09-21T07:11:23.205027+0000","last_became_peered":"2024-09-21T07:11:23.205027+0000","last_unstale":"2024-09-21T07:11:25.585835+0000","last_undegraded":"2024-09-21T07:11:25.585835+0000","last_fullsized":"2024-09-21T07:11:25.585835+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:54.116988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.209345+0000","last_change":"2024-09-21T07:11:24.206200+0000","last_active":"2024-09-21T07:11:24.209345+0000","last_peered":"2024-09-21T07:11:24.209345+0000","last_clean":"2024-09-21T07:11:24.209345+0000","last_became_active":"2024-09-21T07:11:24.205869+0000","last_became_peered":"2024-09-21T07:11:24.205869+0000","last_unstale":"2024-09-21T07:11:24.209345+0000","last_undegraded":"2024-09-21T07:11:24.209345+0000","last_fullsized":"2024-09-21T07:11:24.209345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:02.269668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.586292+0000","last_change":"2024-09-21T07:11:23.209630+0000","last_active":"2024-09-21T07:11:25.586292+0000","last_peered":"2024-09-21T07:11:25.586292+0000","last_clean":"2024-09-21T07:11:25.586292+0000","last_became_active":"2024-09-21T07:11:23.209146+0000","last_became_peered":"2024-09-21T07:11:23.209146+0000","last_unstale":"2024-09-21T07:11:25.586292+0000","last_undegraded":"2024-09-21T07:11:25.586292+0000","last_fullsized":"2024-09-21T07:11:25.586292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:23.193429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.208539+0000","last_change":"2024-09-21T07:11:24.217227+0000","last_active":"2024-09-21T07:11:25.208539+0000","last_peered":"2024-09-21T07:11:25.208539+0000","last_clean":"2024-09-21T07:11:25.208539+0000","last_became_active":"2024-09-21T07:11:24.216892+0000","last_became_peered":"2024-09-21T07:11:24.216892+0000","last_unstale":"2024-09-21T07:11:25.208539+0000","last_undegraded":"2024-09-21T07:11:25.208539+0000","last_fullsized":"2024-09-21T07:11:25.208539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:07.839891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.586030+0000","last_change":"2024-09-21T07:11:23.208271+0000","last_active":"2024-09-21T07:11:25.586030+0000","last_peered":"2024-09-21T07:11:25.586030+0000","last_clean":"2024-09-21T07:11:25.586030+0000","last_became_active":"2024-09-21T07:11:23.207903+0000","last_became_peered":"2024-09-21T07:11:23.207903+0000","last_unstale":"2024-09-21T07:11:25.586030+0000","last_undegraded":"2024-09-21T07:11:25.586030+0000","last_fullsized":"2024-09-21T07:11:25.586030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:10.218779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.208484+0000","last_change":"2024-09-21T07:11:24.219001+0000","last_active":"2024-09-21T07:11:25.208484+0000","last_peered":"2024-09-21T07:11:25.208484+0000","last_clean":"2024-09-21T07:11:25.208484+0000","last_became_active":"2024-09-21T07:11:24.218618+0000","last_became_peered":"2024-09-21T07:11:24.218618+0000","last_unstale":"2024-09-21T07:11:25.208484+0000","last_undegraded":"2024-09-21T07:11:25.208484+0000","last_fullsized":"2024-09-21T07:11:25.208484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:08.174572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207249+0000","last_change":"2024-09-21T07:11:23.211434+0000","last_active":"2024-09-21T07:11:25.207249+0000","last_peered":"2024-09-21T07:11:25.207249+0000","last_clean":"2024-09-21T07:11:25.207249+0000","last_became_active":"2024-09-21T07:11:23.210906+0000","last_became_peered":"2024-09-21T07:11:23.210906+0000","last_unstale":"2024-09-21T07:11:25.207249+0000","last_undegraded":"2024-09-21T07:11:25.207249+0000","last_fullsized":"2024-09-21T07:11:25.207249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:34.514941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.208673+0000","last_change":"2024-09-21T07:11:24.207793+0000","last_active":"2024-09-21T07:11:25.208673+0000","last_peered":"2024-09-21T07:11:25.208673+0000","last_clean":"2024-09-21T07:11:25.208673+0000","last_became_active":"2024-09-21T07:11:24.207497+0000","last_became_peered":"2024-09-21T07:11:24.207497+0000","last_unstale":"2024-09-21T07:11:25.208673+0000","last_undegraded":"2024-09-21T07:11:25.208673+0000","last_fullsized":"2024-09-21T07:11:25.208673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:33.699315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.585188+0000","last_change":"2024-09-21T07:11:23.203597+0000","last_active":"2024-09-21T07:11:25.585188+0000","last_peered":"2024-09-21T07:11:25.585188+0000","last_clean":"2024-09-21T07:11:25.585188+0000","last_became_active":"2024-09-21T07:11:23.203212+0000","last_became_peered":"2024-09-21T07:11:23.203212+0000","last_unstale":"2024-09-21T07:11:25.585188+0000","last_undegraded":"2024-09-21T07:11:25.585188+0000","last_fullsized":"2024-09-21T07:11:25.585188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:05.979078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.208382+0000","last_change":"2024-09-21T07:11:24.205257+0000","last_active":"2024-09-21T07:11:25.208382+0000","last_peered":"2024-09-21T07:11:25.208382+0000","last_clean":"2024-09-21T07:11:25.208382+0000","last_became_active":"2024-09-21T07:11:24.204949+0000","last_became_peered":"2024-09-21T07:11:24.204949+0000","last_unstale":"2024-09-21T07:11:25.208382+0000","last_undegraded":"2024-09-21T07:11:25.208382+0000","last_fullsized":"2024-09-21T07:11:25.208382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:20.256005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.585625+0000","last_change":"2024-09-21T07:11:23.211942+0000","last_active":"2024-09-21T07:11:25.585625+0000","last_peered":"2024-09-21T07:11:25.585625+0000","last_clean":"2024-09-21T07:11:25.585625+0000","last_became_active":"2024-09-21T07:11:23.211690+0000","last_became_peered":"2024-09-21T07:11:23.211690+0000","last_unstale":"2024-09-21T07:11:25.585625+0000","last_undegraded":"2024-09-21T07:11:25.585625+0000","last_fullsized":"2024-09-21T07:11:25.585625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:19.675316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.341942+0000","last_change":"2024-09-21T07:11:24.215014+0000","last_active":"2024-09-21T07:11:25.341942+0000","last_peered":"2024-09-21T07:11:25.341942+0000","last_clean":"2024-09-21T07:11:25.341942+0000","last_became_active":"2024-09-21T07:11:24.213605+0000","last_became_peered":"2024-09-21T07:11:24.213605+0000","last_unstale":"2024-09-21T07:11:25.341942+0000","last_undegraded":"2024-09-21T07:11:25.341942+0000","last_fullsized":"2024-09-21T07:11:25.341942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:52.156830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.208687+0000","last_change":"2024-09-21T07:11:23.207042+0000","last_active":"2024-09-21T07:11:25.208687+0000","last_peered":"2024-09-21T07:11:25.208687+0000","last_clean":"2024-09-21T07:11:25.208687+0000","last_became_active":"2024-09-21T07:11:23.206705+0000","last_became_peered":"2024-09-21T07:11:23.206705+0000","last_unstale":"2024-09-21T07:11:25.208687+0000","last_undegraded":"2024-09-21T07:11:25.208687+0000","last_fullsized":"2024-09-21T07:11:25.208687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:35.935580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.208471+0000","last_change":"2024-09-21T07:11:24.214679+0000","last_active":"2024-09-21T07:11:25.208471+0000","last_peered":"2024-09-21T07:11:25.208471+0000","last_clean":"2024-09-21T07:11:25.208471+0000","last_became_active":"2024-09-21T07:11:24.214354+0000","last_became_peered":"2024-09-21T07:11:24.214354+0000","last_unstale":"2024-09-21T07:11:25.208471+0000","last_undegraded":"2024-09-21T07:11:25.208471+0000","last_fullsized":"2024-09-21T07:11:25.208471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:28.059223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.220013+0000","last_change":"2024-09-21T07:11:23.205527+0000","last_active":"2024-09-21T07:11:24.220013+0000","last_peered":"2024-09-21T07:11:24.220013+0000","last_clean":"2024-09-21T07:11:24.220013+0000","last_became_active":"2024-09-21T07:11:23.204985+0000","last_became_peered":"2024-09-21T07:11:23.204985+0000","last_unstale":"2024-09-21T07:11:24.220013+0000","last_undegraded":"2024-09-21T07:11:24.220013+0000","last_fullsized":"2024-09-21T07:11:24.220013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:45:43.435561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.209677+0000","last_change":"2024-09-21T07:11:24.210618+0000","last_active":"2024-09-21T07:11:25.209677+0000","last_peered":"2024-09-21T07:11:25.209677+0000","last_clean":"2024-09-21T07:11:25.209677+0000","last_became_active":"2024-09-21T07:11:24.210283+0000","last_became_peered":"2024-09-21T07:11:24.210283+0000","last_unstale":"2024-09-21T07:11:25.209677+0000","last_undegraded":"2024-09-21T07:11:25.209677+0000","last_fullsized":"2024-09-21T07:11:25.209677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:34.568987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207212+0000","last_change":"2024-09-21T07:11:23.205583+0000","last_active":"2024-09-21T07:11:25.207212+0000","last_peered":"2024-09-21T07:11:25.207212+0000","last_clean":"2024-09-21T07:11:25.207212+0000","last_became_active":"2024-09-21T07:11:23.205258+0000","last_became_peered":"2024-09-21T07:11:23.205258+0000","last_unstale":"2024-09-21T07:11:25.207212+0000","last_undegraded":"2024-09-21T07:11:25.207212+0000","last_fullsized":"2024-09-21T07:11:25.207212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:28.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207036+0000","last_change":"2024-09-21T07:11:24.214657+0000","last_active":"2024-09-21T07:11:25.207036+0000","last_peered":"2024-09-21T07:11:25.207036+0000","last_clean":"2024-09-21T07:11:25.207036+0000","last_became_active":"2024-09-21T07:11:24.212761+0000","last_became_peered":"2024-09-21T07:11:24.212761+0000","last_unstale":"2024-09-21T07:11:25.207036+0000","last_undegraded":"2024-09-21T07:11:25.207036+0000","last_fullsized":"2024-09-21T07:11:25.207036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:14.772321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.195965+0000","last_change":"2024-09-21T07:11:23.206444+0000","last_active":"2024-09-21T07:11:24.195965+0000","last_peered":"2024-09-21T07:11:24.195965+0000","last_clean":"2024-09-21T07:11:24.195965+0000","last_became_active":"2024-09-21T07:11:23.206077+0000","last_became_peered":"2024-09-21T07:11:23.206077+0000","last_unstale":"2024-09-21T07:11:24.195965+0000","last_undegraded":"2024-09-21T07:11:24.195965+0000","last_fullsized":"2024-09-21T07:11:24.195965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:34.514941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.585308+0000","last_change":"2024-09-21T07:11:24.206093+0000","last_active":"2024-09-21T07:11:25.585308+0000","last_peered":"2024-09-21T07:11:25.585308+0000","last_clean":"2024-09-21T07:11:25.585308+0000","last_became_active":"2024-09-21T07:11:24.205703+0000","last_became_peered":"2024-09-21T07:11:24.205703+0000","last_unstale":"2024-09-21T07:11:25.585308+0000","last_undegraded":"2024-09-21T07:11:25.585308+0000","last_fullsized":"2024-09-21T07:11:25.585308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:22.159037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207397+0000","last_change":"2024-09-21T07:11:23.203244+0000","last_active":"2024-09-21T07:11:25.207397+0000","last_peered":"2024-09-21T07:11:25.207397+0000","last_clean":"2024-09-21T07:11:25.207397+0000","last_became_active":"2024-09-21T07:11:23.202786+0000","last_became_peered":"2024-09-21T07:11:23.202786+0000","last_unstale":"2024-09-21T07:11:25.207397+0000","last_undegraded":"2024-09-21T07:11:25.207397+0000","last_fullsized":"2024-09-21T07:11:25.207397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:45:43.435561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.207301+0000","last_change":"2024-09-21T07:11:24.215505+0000","last_active":"2024-09-21T07:11:25.207301+0000","last_peered":"2024-09-21T07:11:25.207301+0000","last_clean":"2024-09-21T07:11:25.207301+0000","last_became_active":"2024-09-21T07:11:24.215033+0000","last_became_peered":"2024-09-21T07:11:24.215033+0000","last_unstale":"2024-09-21T07:11:25.207301+0000","last_undegraded":"2024-09-21T07:11:25.207301+0000","last_fullsized":"2024-09-21T07:11:25.207301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:59.577772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.196797+0000","last_change":"2024-09-21T07:11:23.202216+0000","last_active":"2024-09-21T07:11:24.196797+0000","last_peered":"2024-09-21T07:11:24.196797+0000","last_clean":"2024-09-21T07:11:24.196797+0000","last_became_active":"2024-09-21T07:11:23.200778+0000","last_became_peered":"2024-09-21T07:11:23.200778+0000","last_unstale":"2024-09-21T07:11:24.196797+0000","last_undegraded":"2024-09-21T07:11:24.196797+0000","last_fullsized":"2024-09-21T07:11:24.196797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:07.286401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.220842+0000","last_change":"2024-09-21T07:11:24.210116+0000","last_active":"2024-09-21T07:11:24.220842+0000","last_peered":"2024-09-21T07:11:24.220842+0000","last_clean":"2024-09-21T07:11:24.220842+0000","last_became_active":"2024-09-21T07:11:24.209729+0000","last_became_peered":"2024-09-21T07:11:24.209729+0000","last_unstale":"2024-09-21T07:11:24.220842+0000","last_undegraded":"2024-09-21T07:11:24.220842+0000","last_fullsized":"2024-09-21T07:11:24.220842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:57.216729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.585794+0000","last_change":"2024-09-21T07:11:23.203350+0000","last_active":"2024-09-21T07:11:25.585794+0000","last_peered":"2024-09-21T07:11:25.585794+0000","last_clean":"2024-09-21T07:11:25.585794+0000","last_became_active":"2024-09-21T07:11:23.203045+0000","last_became_peered":"2024-09-21T07:11:23.203045+0000","last_unstale":"2024-09-21T07:11:25.585794+0000","last_undegraded":"2024-09-21T07:11:25.585794+0000","last_fullsized":"2024-09-21T07:11:25.585794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:25.714770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.585692+0000","last_change":"2024-09-21T07:11:24.214846+0000","last_active":"2024-09-21T07:11:25.585692+0000","last_peered":"2024-09-21T07:11:25.585692+0000","last_clean":"2024-09-21T07:11:25.585692+0000","last_became_active":"2024-09-21T07:11:24.214353+0000","last_became_peered":"2024-09-21T07:11:24.214353+0000","last_unstale":"2024-09-21T07:11:25.585692+0000","last_undegraded":"2024-09-21T07:11:25.585692+0000","last_fullsized":"2024-09-21T07:11:25.585692+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:15.033944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T07:11:24.200858+0000","last_change":"2024-09-21T07:11:23.207340+0000","last_active":"2024-09-21T07:11:24.200858+0000","last_peered":"2024-09-21T07:11:24.200858+0000","last_clean":"2024-09-21T07:11:24.200858+0000","last_became_active":"2024-09-21T07:11:23.207011+0000","last_became_peered":"2024-09-21T07:11:23.207011+0000","last_unstale":"2024-09-21T07:11:24.200858+0000","last_undegraded":"2024-09-21T07:11:24.200858+0000","last_fullsized":"2024-09-21T07:11:24.200858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:56.190723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.342492+0000","last_change":"2024-09-21T07:11:24.213627+0000","last_active":"2024-09-21T07:11:25.342492+0000","last_peered":"2024-09-21T07:11:25.342492+0000","last_clean":"2024-09-21T07:11:25.342492+0000","last_became_active":"2024-09-21T07:11:24.213306+0000","last_became_peered":"2024-09-21T07:11:24.213306+0000","last_unstale":"2024-09-21T07:11:25.342492+0000","last_undegraded":"2024-09-21T07:11:25.342492+0000","last_fullsized":"2024-09-21T07:11:25.342492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:23.179224+0000","last_clean_scrub_stamp":"2024-09-21T07:11:23.179224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:14.065709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.585305+0000","last_change":"2024-09-21T07:11:23.203866+0000","last_active":"2024-09-21T07:11:25.585305+0000","last_peered":"2024-09-21T07:11:25.585305+0000","last_clean":"2024-09-21T07:11:25.585305+0000","last_became_active":"2024-09-21T07:11:23.203501+0000","last_became_peered":"2024-09-21T07:11:23.203501+0000","last_unstale":"2024-09-21T07:11:25.585305+0000","last_undegraded":"2024-09-21T07:11:25.585305+0000","last_fullsized":"2024-09-21T07:11:25.585305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:11:22.173665+0000","last_clean_scrub_stamp":"2024-09-21T07:11:22.173665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:19.488907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T07:11:25.342305+0000","last_change":"2024-09-21T07:10:32.034091+0000","last_active":"2024-09-21T07:11:25.342305+0000","last_peered":"2024-09-21T07:11:25.342305+0000","last_clean":"2024-09-21T07:11:25.342305+0000","last_became_active":"2024-09-21T07:10:32.033005+0000","last_became_peered":"2024-09-21T07:10:32.033005+0000","last_unstale":"2024-09-21T07:11:25.342305+0000","last_undegraded":"2024-09-21T07:11:25.342305+0000","last_fullsized":"2024-09-21T07:11:25.342305+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_clean_scrub_stamp":"2024-09-21T07:10:31.011167+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:10.064019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":950272,"data_stored":726769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":360448,"data_stored":136927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":360448,"data_stored":136983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":348160,"data_stored":130115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35700,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336140,"statfs":{"total":96636764160,"available":96600207360,"internally_reserved":0,"allocated":356352,"data_stored":136381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35696,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336144,"statfs":{"total":96636764160,"available":96600211456,"internally_reserved":0,"allocated":356352,"data_stored":131645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336136,"statfs":{"total":96636764160,"available":96600203264,"internally_reserved":0,"allocated":356352,"data_stored":131645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36268,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335572,"statfs":{"total":96636764160,"available":96599625728,"internally_reserved":0,"allocated":933888,"data_stored":720379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:11:28.648 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:11:28.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:11:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.807+0000 7f26829a8640 1 -- 172.21.15.18:0/3284253605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f267c0cfac0 msgr2=0x7f267c0cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.807+0000 7f26829a8640 1 --2- 172.21.15.18:0/3284253605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f267c0cfac0 0x7f267c0cfed0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2674005fd0 tx=0x7f267402a940 comp rx=0 tx=0).stop 2024-09-21T07:11:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.807+0000 7f26829a8640 1 -- 172.21.15.18:0/3284253605 shutdown_connections 2024-09-21T07:11:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.807+0000 7f26829a8640 1 --2- 172.21.15.18:0/3284253605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f267c0cfac0 0x7f267c0cfed0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.807+0000 7f26829a8640 1 -- 172.21.15.18:0/3284253605 >> 172.21.15.18:0/3284253605 conn(0x7f267c074240 msgr2=0x7f267c06cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.807+0000 7f26829a8640 1 -- 172.21.15.18:0/3284253605 shutdown_connections 2024-09-21T07:11:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.807+0000 7f26829a8640 1 -- 172.21.15.18:0/3284253605 wait complete. 2024-09-21T07:11:28.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.809+0000 7f26829a8640 1 Processor -- start 2024-09-21T07:11:28.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.809+0000 7f26829a8640 1 -- start start 2024-09-21T07:11:28.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.810+0000 7f26829a8640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f267c06f7b0 0x7f267c0cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:28.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.810+0000 7f26829a8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267c0b5680 0x7f267c0aa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:28.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.810+0000 7f26829a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f267c0cfac0 0x7f267c1f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:28.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.810+0000 7f26829a8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f267c0b6930 con 0x7f267c0cfac0 2024-09-21T07:11:28.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.810+0000 7f26829a8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f267c0b67b0 con 0x7f267c0b5680 2024-09-21T07:11:28.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.810+0000 7f26829a8640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f267c0d0410 con 0x7f267c06f7b0 2024-09-21T07:11:28.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.810+0000 7f2680f45640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f267c0cfac0 0x7f267c1f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:28.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.810+0000 7f2680f45640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f267c0cfac0 0x7f267c1f5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60124/0 (socket says 172.21.15.18:60124) 2024-09-21T07:11:28.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.810+0000 7f2680f45640 1 -- 172.21.15.18:0/2382436457 learned_addr learned my addr 172.21.15.18:0/2382436457 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:28.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.810+0000 7f267bfff640 1 --2- 172.21.15.18:0/2382436457 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f267c06f7b0 0x7f267c0cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:28.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.810+0000 7f267b7fe640 1 --2- 172.21.15.18:0/2382436457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267c0b5680 0x7f267c0aa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:28.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.811+0000 7f2680f45640 1 -- 172.21.15.18:0/2382436457 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f267c06f7b0 msgr2=0x7f267c0cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:28.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.811+0000 7f2680f45640 1 --2- 172.21.15.18:0/2382436457 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f267c06f7b0 0x7f267c0cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.811+0000 7f2680f45640 1 -- 172.21.15.18:0/2382436457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267c0b5680 msgr2=0x7f267c0aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:28.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.811+0000 7f2680f45640 1 --2- 172.21.15.18:0/2382436457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267c0b5680 0x7f267c0aa810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:28.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.811+0000 7f2680f45640 1 -- 172.21.15.18:0/2382436457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c1f5cb0 con 0x7f267c0cfac0 2024-09-21T07:11:28.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.811+0000 7f2680f45640 1 --2- 172.21.15.18:0/2382436457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f267c0cfac0 0x7f267c1f5500 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2674006010 tx=0x7f2674031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:28.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.811+0000 7f2678ff9640 1 -- 172.21.15.18:0/2382436457 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267403e070 con 0x7f267c0cfac0 2024-09-21T07:11:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.811+0000 7f2678ff9640 1 -- 172.21.15.18:0/2382436457 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2674004540 con 0x7f267c0cfac0 2024-09-21T07:11:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.811+0000 7f26829a8640 1 -- 172.21.15.18:0/2382436457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f267c1f5f90 con 0x7f267c0cfac0 2024-09-21T07:11:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.811+0000 7f2678ff9640 1 -- 172.21.15.18:0/2382436457 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674043460 con 0x7f267c0cfac0 2024-09-21T07:11:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.811+0000 7f26829a8640 1 -- 172.21.15.18:0/2382436457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f267c0cab90 con 0x7f267c0cfac0 2024-09-21T07:11:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.812+0000 7f26829a8640 1 -- 172.21.15.18:0/2382436457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f267c0cfed0 con 0x7f267c0cfac0 2024-09-21T07:11:28.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.813+0000 7f2678ff9640 1 -- 172.21.15.18:0/2382436457 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2674043600 con 0x7f267c0cfac0 2024-09-21T07:11:28.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.814+0000 7f2678ff9640 1 --2- 172.21.15.18:0/2382436457 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2668078bc0 0x7f266807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:28.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.814+0000 7f2678ff9640 1 -- 172.21.15.18:0/2382436457 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f26740bc7c0 con 0x7f267c0cfac0 2024-09-21T07:11:28.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.814+0000 7f267bfff640 1 --2- 172.21.15.18:0/2382436457 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2668078bc0 0x7f266807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:28.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.814+0000 7f267bfff640 1 --2- 172.21.15.18:0/2382436457 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2668078bc0 0x7f266807b0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f266c000f60 tx=0x7f266c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:28.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:28.818+0000 7f2678ff9640 1 -- 172.21.15.18:0/2382436457 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2674084640 con 0x7f267c0cfac0 2024-09-21T07:11:29.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.079+0000 7f26829a8640 1 -- 172.21.15.18:0/2382436457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f267c1f5a40 con 0x7f267c0cfac0 2024-09-21T07:11:29.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.082+0000 7f2678ff9640 1 -- 172.21.15.18:0/2382436457 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f2674089070 con 0x7f267c0cfac0 2024-09-21T07:11:29.084 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-21T07:11:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA4ce5mJv7rDhAAkKNAHkkVH1tIbrRt3I1zBg== 2024-09-21T07:11:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-09-21T07:11:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-09-21T07:11:29.084 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:11:29.084 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-09-21T07:11:29.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.085+0000 7f26829a8640 1 -- 172.21.15.18:0/2382436457 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2668078bc0 msgr2=0x7f266807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:29.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.085+0000 7f26829a8640 1 --2- 172.21.15.18:0/2382436457 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2668078bc0 0x7f266807b0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f266c000f60 tx=0x7f266c009040 comp rx=0 tx=0).stop 2024-09-21T07:11:29.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.085+0000 7f26829a8640 1 -- 172.21.15.18:0/2382436457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f267c0cfac0 msgr2=0x7f267c1f5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:29.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.085+0000 7f26829a8640 1 --2- 172.21.15.18:0/2382436457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f267c0cfac0 0x7f267c1f5500 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2674006010 tx=0x7f2674031e20 comp rx=0 tx=0).stop 2024-09-21T07:11:29.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.085+0000 7f26829a8640 1 -- 172.21.15.18:0/2382436457 shutdown_connections 2024-09-21T07:11:29.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.085+0000 7f26829a8640 1 --2- 172.21.15.18:0/2382436457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f267c0cfac0 0x7f267c1f5500 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.085+0000 7f26829a8640 1 --2- 172.21.15.18:0/2382436457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f267c0b5680 0x7f267c0aa810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.085+0000 7f26829a8640 1 --2- 172.21.15.18:0/2382436457 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f2668078bc0 0x7f266807b0d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.085+0000 7f26829a8640 1 --2- 172.21.15.18:0/2382436457 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f267c06f7b0 0x7f267c0cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.085+0000 7f26829a8640 1 -- 172.21.15.18:0/2382436457 >> 172.21.15.18:0/2382436457 conn(0x7f267c074240 msgr2=0x7f267c06dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:29.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.085+0000 7f26829a8640 1 -- 172.21.15.18:0/2382436457 shutdown_connections 2024-09-21T07:11:29.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.085+0000 7f26829a8640 1 -- 172.21.15.18:0/2382436457 wait complete. 2024-09-21T07:11:29.098 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:11:29.129 INFO:tasks.ceph.mds.d.smithi049.stderr:2024-09-21T07:11:29.127+0000 7f1918c25640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:11:29.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.213+0000 7f5e177a1640 1 -- 172.21.15.18:0/322072091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dfc003a30 msgr2=0x7f5dfc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:29.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.213+0000 7f5e177a1640 1 --2- 172.21.15.18:0/322072091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dfc003a30 0x7f5dfc003ea0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00bb20 tx=0x7f5dfc005830 comp rx=0 tx=0).stop 2024-09-21T07:11:29.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.213+0000 7f5e15d3e640 1 -- 172.21.15.18:0/322072091 reap_dead start 2024-09-21T07:11:29.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.213+0000 7f5e177a1640 1 -- 172.21.15.18:0/322072091 shutdown_connections 2024-09-21T07:11:29.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.213+0000 7f5e177a1640 1 -- 172.21.15.18:0/322072091 >> 172.21.15.18:0/322072091 conn(0x7f5e100b1fe0 msgr2=0x7f5e100b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:29.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.213+0000 7f5e177a1640 1 -- 172.21.15.18:0/322072091 shutdown_connections 2024-09-21T07:11:29.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.213+0000 7f5e177a1640 1 -- 172.21.15.18:0/322072091 wait complete. 2024-09-21T07:11:29.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.215+0000 7f5e177a1640 1 Processor -- start 2024-09-21T07:11:29.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.215+0000 7f5e177a1640 1 -- start start 2024-09-21T07:11:29.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.216+0000 7f5e177a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dfc003a30 0x7f5e10158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:29.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.216+0000 7f5e177a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e101591a0 0x7f5e101f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:29.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e177a1640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5e101f4a50 0x7f5e1009d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e177a1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5e100b3670 con 0x7f5e101591a0 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e177a1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5e100b34f0 con 0x7f5dfc003a30 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e177a1640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f5e1006eda0 con 0x7f5e101f4a50 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e14d3c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e101591a0 0x7f5e101f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e14d3c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e101591a0 0x7f5e101f4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60134/0 (socket says 172.21.15.18:60134) 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e14d3c640 1 -- 172.21.15.18:0/670136127 learned_addr learned my addr 172.21.15.18:0/670136127 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e1553d640 1 --2- 172.21.15.18:0/670136127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dfc003a30 0x7f5e10158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e15d3e640 1 --2- 172.21.15.18:0/670136127 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5e101f4a50 0x7f5e1009d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e14d3c640 1 -- 172.21.15.18:0/670136127 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5e101f4a50 msgr2=0x7f5e1009d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e14d3c640 1 --2- 172.21.15.18:0/670136127 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5e101f4a50 0x7f5e1009d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e14d3c640 1 -- 172.21.15.18:0/670136127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dfc003a30 msgr2=0x7f5e10158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e14d3c640 1 --2- 172.21.15.18:0/670136127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dfc003a30 0x7f5e10158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e14d3c640 1 -- 172.21.15.18:0/670136127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e101f4e60 con 0x7f5e101591a0 2024-09-21T07:11:29.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e14d3c640 1 --2- 172.21.15.18:0/670136127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e101591a0 0x7f5e101f4510 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5e00003f80 tx=0x7f5e000016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:29.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e05ffb640 1 -- 172.21.15.18:0/670136127 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e00016030 con 0x7f5e101591a0 2024-09-21T07:11:29.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e05ffb640 1 -- 172.21.15.18:0/670136127 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e00011700 con 0x7f5e101591a0 2024-09-21T07:11:29.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e177a1640 1 -- 172.21.15.18:0/670136127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e101599d0 con 0x7f5e101591a0 2024-09-21T07:11:29.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.217+0000 7f5e05ffb640 1 -- 172.21.15.18:0/670136127 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e00011b30 con 0x7f5e101591a0 2024-09-21T07:11:29.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.218+0000 7f5e177a1640 1 -- 172.21.15.18:0/670136127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e10159f90 con 0x7f5e101591a0 2024-09-21T07:11:29.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.218+0000 7f5e177a1640 1 -- 172.21.15.18:0/670136127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e100b0a70 con 0x7f5e101591a0 2024-09-21T07:11:29.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.220+0000 7f5e05ffb640 1 -- 172.21.15.18:0/670136127 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e00019070 con 0x7f5e101591a0 2024-09-21T07:11:29.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.220+0000 7f5e05ffb640 1 --2- 172.21.15.18:0/670136127 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5df4078b90 0x7f5df407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:29.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.220+0000 7f5e05ffb640 1 -- 172.21.15.18:0/670136127 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f5e0009b3c0 con 0x7f5e101591a0 2024-09-21T07:11:29.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.220+0000 7f5e1553d640 1 --2- 172.21.15.18:0/670136127 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5df4078b90 0x7f5df407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:29.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.221+0000 7f5e1553d640 1 --2- 172.21.15.18:0/670136127 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5df4078b90 0x7f5df407b0a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c036000 tx=0x7f5e0c0046c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:29.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.227+0000 7f5e05ffb640 1 -- 172.21.15.18:0/670136127 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5e101f4e60 con 0x7f5e101591a0 2024-09-21T07:11:29.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.454+0000 7f5e177a1640 1 -- 172.21.15.18:0/670136127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e10159760 con 0x7f5e101591a0 2024-09-21T07:11:29.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.454+0000 7f5e05ffb640 1 -- 172.21.15.18:0/670136127 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5220 (secure 0 0 0) 0x7f5e00063890 con 0x7f5e101591a0 2024-09-21T07:11:29.456 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:29.456 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"btime":"2024-09-21T07:11:27:212589+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/492466681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":492466681},{"type":"v1","addr":"172.21.15.18:6834","nonce":492466681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4777,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/2411496903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2411496903},{"type":"v1","addr":"172.21.15.18:6835","nonce":2411496903}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4780,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2997359476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2997359476},{"type":"v1","addr":"172.21.15.49:6836","nonce":2997359476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:11:23.587887+0000","modified":"2024-09-21T07:11:26.595981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3575557854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3575557854},{"type":"v1","addr":"172.21.15.49:6837","nonce":3575557854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4905,"qdb_cluster":[4905]},"id":2}]} 2024-09-21T07:11:29.456 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 17 2024-09-21T07:11:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.457+0000 7f5e177a1640 1 -- 172.21.15.18:0/670136127 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5df4078b90 msgr2=0x7f5df407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.457+0000 7f5e177a1640 1 --2- 172.21.15.18:0/670136127 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5df4078b90 0x7f5df407b0a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c036000 tx=0x7f5e0c0046c0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.457+0000 7f5e177a1640 1 -- 172.21.15.18:0/670136127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e101591a0 msgr2=0x7f5e101f4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.457+0000 7f5e177a1640 1 --2- 172.21.15.18:0/670136127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e101591a0 0x7f5e101f4510 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5e00003f80 tx=0x7f5e000016f0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.457+0000 7f5e177a1640 1 -- 172.21.15.18:0/670136127 shutdown_connections 2024-09-21T07:11:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.457+0000 7f5e177a1640 1 --2- 172.21.15.18:0/670136127 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5df4078b90 0x7f5df407b0a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.457+0000 7f5e177a1640 1 --2- 172.21.15.18:0/670136127 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5e101f4a50 0x7f5e1009d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.457+0000 7f5e177a1640 1 --2- 172.21.15.18:0/670136127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e101591a0 0x7f5e101f4510 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.457+0000 7f5e177a1640 1 --2- 172.21.15.18:0/670136127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5dfc003a30 0x7f5e10158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.457+0000 7f5e177a1640 1 -- 172.21.15.18:0/670136127 >> 172.21.15.18:0/670136127 conn(0x7f5e100b1fe0 msgr2=0x7f5e100d0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.457+0000 7f5e177a1640 1 -- 172.21.15.18:0/670136127 shutdown_connections 2024-09-21T07:11:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.457+0000 7f5e177a1640 1 -- 172.21.15.18:0/670136127 wait complete. 2024-09-21T07:11:29.872 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:11:23.587887+0000', 'modified': '2024-09-21T07:11:26.595981+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4905}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4905': {'gid': 4905, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6837/3575557854', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6835', 'nonce': 3575557854}, {'type': 'v1', 'addr': '172.21.15.49:6837', 'nonce': 3575557854}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4905, 'qdb_cluster': [4905]} 2024-09-21T07:11:29.872 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:11:29.873 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-21T07:11:29.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.993+0000 7f513d027640 1 -- 172.21.15.18:0/703426460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5124004800 msgr2=0x7f5124004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:29.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.993+0000 7f513d027640 1 --2- 172.21.15.18:0/703426460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5124004800 0x7f5124004c10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f51381455d0 tx=0x7f5124005830 comp rx=0 tx=0).stop 2024-09-21T07:11:29.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.993+0000 7f513759e640 1 -- 172.21.15.18:0/703426460 reap_dead start 2024-09-21T07:11:29.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.993+0000 7f513d027640 1 -- 172.21.15.18:0/703426460 shutdown_connections 2024-09-21T07:11:29.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.993+0000 7f513d027640 1 -- 172.21.15.18:0/703426460 >> 172.21.15.18:0/703426460 conn(0x7f5138074240 msgr2=0x7f513806cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:29.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.993+0000 7f513d027640 1 -- 172.21.15.18:0/703426460 shutdown_connections 2024-09-21T07:11:29.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.993+0000 7f513d027640 1 -- 172.21.15.18:0/703426460 wait complete. 2024-09-21T07:11:29.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.995+0000 7f513d027640 1 Processor -- start 2024-09-21T07:11:29.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.996+0000 7f513d027640 1 -- start start 2024-09-21T07:11:30.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f513d027640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5124004800 0x7f5138141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f513d027640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f513815af00 0x7f513806d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f513d027640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513815b310 0x7f513806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f513d027640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f51380b6920 con 0x7f5124004800 2024-09-21T07:11:30.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f513d027640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f51380b61e0 con 0x7f513815b310 2024-09-21T07:11:30.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f513d027640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f51380b5680 con 0x7f513815af00 2024-09-21T07:11:30.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f5136d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5124004800 0x7f5138141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f5136d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5124004800 0x7f5138141db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60146/0 (socket says 172.21.15.18:60146) 2024-09-21T07:11:30.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f5136d9d640 1 -- 172.21.15.18:0/1210207713 learned_addr learned my addr 172.21.15.18:0/1210207713 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:30.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f513659c640 1 --2- 172.21.15.18:0/1210207713 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f513815af00 0x7f513806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f513759e640 1 --2- 172.21.15.18:0/1210207713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513815b310 0x7f513806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f5136d9d640 1 -- 172.21.15.18:0/1210207713 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f513815af00 msgr2=0x7f513806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:30.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f5136d9d640 1 --2- 172.21.15.18:0/1210207713 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f513815af00 0x7f513806d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f5136d9d640 1 -- 172.21.15.18:0/1210207713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513815b310 msgr2=0x7f513806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:30.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f5136d9d640 1 --2- 172.21.15.18:0/1210207713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513815b310 0x7f513806de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f5136d9d640 1 -- 172.21.15.18:0/1210207713 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51381f59b0 con 0x7f5124004800 2024-09-21T07:11:30.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.997+0000 7f5136d9d640 1 --2- 172.21.15.18:0/1210207713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5124004800 0x7f5138141db0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5128004370 tx=0x7f5128004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:30.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.998+0000 7f512f7fe640 1 -- 172.21.15.18:0/1210207713 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128016070 con 0x7f5124004800 2024-09-21T07:11:30.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.998+0000 7f512f7fe640 1 -- 172.21.15.18:0/1210207713 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5128010e20 con 0x7f5124004800 2024-09-21T07:11:30.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.998+0000 7f512f7fe640 1 -- 172.21.15.18:0/1210207713 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51280126b0 con 0x7f5124004800 2024-09-21T07:11:30.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.998+0000 7f513d027640 1 -- 172.21.15.18:0/1210207713 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51381f5c90 con 0x7f5124004800 2024-09-21T07:11:30.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:29.998+0000 7f513d027640 1 -- 172.21.15.18:0/1210207713 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51381f6250 con 0x7f5124004800 2024-09-21T07:11:30.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.000+0000 7f512f7fe640 1 -- 172.21.15.18:0/1210207713 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5128012850 con 0x7f5124004800 2024-09-21T07:11:30.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.000+0000 7f512f7fe640 1 --2- 172.21.15.18:0/1210207713 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5118078b90 0x7f511807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.000+0000 7f512f7fe640 1 -- 172.21.15.18:0/1210207713 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f512809bff0 con 0x7f5124004800 2024-09-21T07:11:30.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.001+0000 7f513659c640 1 --2- 172.21.15.18:0/1210207713 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5118078b90 0x7f511807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.001+0000 7f514406e740 1 Processor -- start 2024-09-21T07:11:30.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.001+0000 7f513659c640 1 --2- 172.21.15.18:0/1210207713 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5118078b90 0x7f511807b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5120036000 tx=0x7f5120035040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:30.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.001+0000 7f514406e740 1 -- start start 2024-09-21T07:11:30.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f514406e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8426270 0x5599e87f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f514406e740 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e83fd3b0 0x5599e87f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f514406e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e8405590 0x5599e88153e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f514406e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5599e8740820 con 0x5599e8405590 2024-09-21T07:11:30.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f514406e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5599e872fc50 con 0x5599e8426270 2024-09-21T07:11:30.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f514406e740 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x5599e8733a60 con 0x5599e83fd3b0 2024-09-21T07:11:30.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f513759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e8405590 0x5599e88153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f513759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e8405590 0x5599e88153e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60162/0 (socket says 172.21.15.18:60162) 2024-09-21T07:11:30.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f513759e640 1 -- 172.21.15.18:0/2790242570 learned_addr learned my addr 172.21.15.18:0/2790242570 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:30.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f5136d9d640 1 --2- 172.21.15.18:0/2790242570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8426270 0x5599e87f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f513659c640 1 --2- 172.21.15.18:0/2790242570 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e83fd3b0 0x5599e87f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f513759e640 1 -- 172.21.15.18:0/2790242570 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e83fd3b0 msgr2=0x5599e87f84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:30.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f513759e640 1 --2- 172.21.15.18:0/2790242570 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e83fd3b0 0x5599e87f84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f513759e640 1 -- 172.21.15.18:0/2790242570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8426270 msgr2=0x5599e87f7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:30.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f513759e640 1 --2- 172.21.15.18:0/2790242570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8426270 0x5599e87f7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f513759e640 1 -- 172.21.15.18:0/2790242570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599e8491850 con 0x5599e8405590 2024-09-21T07:11:30.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.003+0000 7f513759e640 1 --2- 172.21.15.18:0/2790242570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e8405590 0x5599e88153e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f51380721e0 tx=0x7f5130006f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37537bfeb69610c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:30.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.004+0000 7f512cff9640 1 -- 172.21.15.18:0/2790242570 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5130003970 con 0x5599e8405590 2024-09-21T07:11:30.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.004+0000 7f512cff9640 1 -- 172.21.15.18:0/2790242570 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5130016070 con 0x5599e8405590 2024-09-21T07:11:30.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.004+0000 7f512cff9640 1 -- 172.21.15.18:0/2790242570 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5130003d90 con 0x5599e8405590 2024-09-21T07:11:30.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.004+0000 7f514406e740 1 -- 172.21.15.18:0/2790242570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e8405590 msgr2=0x5599e88153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:30.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.004+0000 7f514406e740 1 --2- 172.21.15.18:0/2790242570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e8405590 0x5599e88153e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f51380721e0 tx=0x7f5130006f60 comp rx=0 tx=0).stop 2024-09-21T07:11:30.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.005+0000 7f514406e740 1 -- 172.21.15.18:0/2790242570 shutdown_connections 2024-09-21T07:11:30.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.005+0000 7f514406e740 1 --2- 172.21.15.18:0/2790242570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e8405590 0x5599e88153e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.005+0000 7f514406e740 1 --2- 172.21.15.18:0/2790242570 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e83fd3b0 0x5599e87f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.005+0000 7f514406e740 1 --2- 172.21.15.18:0/2790242570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8426270 0x5599e87f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.005+0000 7f514406e740 1 -- 172.21.15.18:0/2790242570 >> 172.21.15.18:0/2790242570 conn(0x5599e841a3c0 msgr2=0x5599e87ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:30.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.005+0000 7f514406e740 1 -- 172.21.15.18:0/2790242570 shutdown_connections 2024-09-21T07:11:30.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.005+0000 7f514406e740 1 -- 172.21.15.18:0/2790242570 wait complete. 2024-09-21T07:11:30.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.005+0000 7f514406e740 1 -- start start 2024-09-21T07:11:30.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.006+0000 7f514406e740 1 Processor -- start 2024-09-21T07:11:30.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f514406e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e83fd3b0 0x5599e87e3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f514406e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8405590 0x5599e8822980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f514406e740 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e8426270 0x5599e87de3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f514406e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5599e84a0620 con 0x5599e83fd3b0 2024-09-21T07:11:30.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f514406e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5599e86d55f0 con 0x5599e8405590 2024-09-21T07:11:30.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f514406e740 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x5599e87f8a20 con 0x5599e8426270 2024-09-21T07:11:30.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f514406e740 10 client.0 _ll_register_callbacks cb 0x5599e86d90a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:11:30.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f5136d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e83fd3b0 0x5599e87e3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f5136d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e83fd3b0 0x5599e87e3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60172/0 (socket says 172.21.15.18:60172) 2024-09-21T07:11:30.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f5136d9d640 1 -- 172.21.15.18:0/3855783291 learned_addr learned my addr 172.21.15.18:0/3855783291 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:30.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f513659c640 1 --2- 172.21.15.18:0/3855783291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8405590 0x5599e8822980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f5136d9d640 1 -- 172.21.15.18:0/3855783291 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e8426270 msgr2=0x5599e87de3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:30.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f513759e640 1 --2- 172.21.15.18:0/3855783291 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e8426270 0x5599e87de3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f5136d9d640 1 --2- 172.21.15.18:0/3855783291 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e8426270 0x5599e87de3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f5136d9d640 1 -- 172.21.15.18:0/3855783291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8405590 msgr2=0x5599e8822980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:30.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f5136d9d640 1 --2- 172.21.15.18:0/3855783291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8405590 0x5599e8822980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f5136d9d640 1 -- 172.21.15.18:0/3855783291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599e85086b0 con 0x5599e83fd3b0 2024-09-21T07:11:30.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.007+0000 7f513659c640 1 --2- 172.21.15.18:0/3855783291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8405590 0x5599e8822980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:30.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f5136d9d640 1 --2- 172.21.15.18:0/3855783291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e83fd3b0 0x5599e87e3ed0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5128060f60 tx=0x7f5128060210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4656fe8e59698dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:30.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f5115ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-21T07:11:30.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f5115ffb640 1 -- 172.21.15.18:0/3855783291 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512801f070 con 0x5599e83fd3b0 2024-09-21T07:11:30.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f5115ffb640 1 -- 172.21.15.18:0/3855783291 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f512804f170 con 0x5599e83fd3b0 2024-09-21T07:11:30.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f514406e740 1 -- 172.21.15.18:0/3855783291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5130016070 con 0x5599e83fd3b0 2024-09-21T07:11:30.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f5115ffb640 1 -- 172.21.15.18:0/3855783291 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f5128063cf0 con 0x5599e83fd3b0 2024-09-21T07:11:30.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f514406e740 10 client.5043 fetch_fsmap learned FSMap version 17 2024-09-21T07:11:30.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f514406e740 1 -- 172.21.15.18:0/3855783291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5599e87e2af0 con 0x5599e83fd3b0 2024-09-21T07:11:30.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f5115ffb640 1 -- 172.21.15.18:0/3855783291 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5130016070 con 0x5599e83fd3b0 2024-09-21T07:11:30.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f5115ffb640 1 -- 172.21.15.18:0/3855783291 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f512800f040 con 0x5599e83fd3b0 2024-09-21T07:11:30.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f514406e740 10 client.5043 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T07:11:30.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f514406e740 10 client.5043 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T07:11:30.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f514406e740 20 client.5043 populate_metadata read hostname 'smithi018' 2024-09-21T07:11:30.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f514406e740 1 --2- 172.21.15.18:0/3855783291 >> [v2:172.21.15.49:6835/3575557854,v1:172.21.15.49:6837/3575557854] conn(0x5599e83e4e40 0x5599e88253c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f514406e740 4 client.5043 mds_command: new command op to 4905 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:11:30.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f514406e740 1 -- 172.21.15.18:0/3855783291 --> [v2:172.21.15.49:6835/3575557854,v1:172.21.15.49:6837/3575557854] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599e8742770 con 0x5599e83e4e40 2024-09-21T07:11:30.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.008+0000 7f513659c640 1 --2- 172.21.15.18:0/3855783291 >> [v2:172.21.15.49:6835/3575557854,v1:172.21.15.49:6837/3575557854] conn(0x5599e83e4e40 0x5599e88253c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.009+0000 7f5115ffb640 10 client.5043 ms_handle_connect on v2:172.21.15.49:6835/3575557854 2024-09-21T07:11:30.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.009+0000 7f513659c640 1 --2- 172.21.15.18:0/3855783291 >> [v2:172.21.15.49:6835/3575557854,v1:172.21.15.49:6837/3575557854] conn(0x5599e83e4e40 0x5599e88253c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95d44b96f211561 server_cookie=128da2ebd75030e7 in_seq=0 out_seq=0 2024-09-21T07:11:30.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.010+0000 7f5115ffb640 1 -- 172.21.15.18:0/3855783291 <== mds.0 v2:172.21.15.49:6835/3575557854 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599e8742770 con 0x5599e83e4e40 2024-09-21T07:11:30.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.010+0000 7f5115ffb640 10 client.5043 handle_command_reply: tid=0 2024-09-21T07:11:30.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.010+0000 7f514406e740 1 client.5043 shutdown 2024-09-21T07:11:30.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.010+0000 7f514406e740 1 -- 172.21.15.18:0/3855783291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e83fd3b0 msgr2=0x5599e87e3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:30.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.010+0000 7f514406e740 1 --2- 172.21.15.18:0/3855783291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e83fd3b0 0x5599e87e3ed0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5128060f60 tx=0x7f5128060210 comp rx=0 tx=0).stop 2024-09-21T07:11:30.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.010+0000 7f514406e740 1 -- 172.21.15.18:0/3855783291 shutdown_connections 2024-09-21T07:11:30.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.010+0000 7f514406e740 1 --2- 172.21.15.18:0/3855783291 >> [v2:172.21.15.49:6835/3575557854,v1:172.21.15.49:6837/3575557854] conn(0x5599e83e4e40 0x5599e88253c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.010+0000 7f514406e740 1 --2- 172.21.15.18:0/3855783291 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e8426270 0x5599e87de3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.010+0000 7f514406e740 1 --2- 172.21.15.18:0/3855783291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8405590 0x5599e8822980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.010+0000 7f5115ffb640 0 client.5043 ms_handle_reset on v2:172.21.15.49:6835/3575557854 2024-09-21T07:11:30.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.010+0000 7f514406e740 1 --2- 172.21.15.18:0/3855783291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e83fd3b0 0x5599e87e3ed0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.010+0000 7f514406e740 1 -- 172.21.15.18:0/3855783291 >> 172.21.15.18:0/3855783291 conn(0x5599e841a3c0 msgr2=0x5599e87ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:30.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.010+0000 7f514406e740 1 -- 172.21.15.18:0/3855783291 shutdown_connections 2024-09-21T07:11:30.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.010+0000 7f514406e740 1 -- 172.21.15.18:0/3855783291 wait complete. 2024-09-21T07:11:30.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.010+0000 7f514406e740 20 client.5043 trim_cache size 0 max 16384 2024-09-21T07:11:30.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.029+0000 7f514406e740 1 Processor -- start 2024-09-21T07:11:30.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.029+0000 7f514406e740 1 -- start start 2024-09-21T07:11:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.030+0000 7f514406e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e83fd3b0 0x5599e87ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.030+0000 7f514406e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8405590 0x5599e87d9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.030+0000 7f514406e740 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e8426270 0x5599e87da3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.030+0000 7f514406e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f51382018a0 con 0x5599e83fd3b0 2024-09-21T07:11:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.030+0000 7f514406e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f513815d030 con 0x5599e8405590 2024-09-21T07:11:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.030+0000 7f514406e740 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f5138201250 con 0x5599e8426270 2024-09-21T07:11:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.030+0000 7f5136d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e83fd3b0 0x5599e87ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.030+0000 7f5136d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e83fd3b0 0x5599e87ce2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60186/0 (socket says 172.21.15.18:60186) 2024-09-21T07:11:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.030+0000 7f5136d9d640 1 -- 172.21.15.18:0/2956330430 learned_addr learned my addr 172.21.15.18:0/2956330430 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:30.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.031+0000 7f513659c640 1 --2- 172.21.15.18:0/2956330430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8405590 0x5599e87d9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.031+0000 7f513759e640 1 --2- 172.21.15.18:0/2956330430 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e8426270 0x5599e87da3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.031+0000 7f5136d9d640 1 -- 172.21.15.18:0/2956330430 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e8426270 msgr2=0x5599e87da3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:30.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.031+0000 7f5136d9d640 1 --2- 172.21.15.18:0/2956330430 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e8426270 0x5599e87da3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.031+0000 7f5136d9d640 1 -- 172.21.15.18:0/2956330430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8405590 msgr2=0x5599e87d9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:30.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.031+0000 7f5136d9d640 1 --2- 172.21.15.18:0/2956330430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8405590 0x5599e87d9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.031+0000 7f5136d9d640 1 -- 172.21.15.18:0/2956330430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599e87e7410 con 0x5599e83fd3b0 2024-09-21T07:11:30.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.031+0000 7f5136d9d640 1 --2- 172.21.15.18:0/2956330430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e83fd3b0 0x5599e87ce2e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5128005c40 tx=0x7f512807e120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f844c7d2f6264b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:30.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.031+0000 7f5117fff640 1 -- 172.21.15.18:0/2956330430 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512801f070 con 0x5599e83fd3b0 2024-09-21T07:11:30.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.031+0000 7f5117fff640 1 -- 172.21.15.18:0/2956330430 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f512806d710 con 0x5599e83fd3b0 2024-09-21T07:11:30.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.031+0000 7f5117fff640 1 -- 172.21.15.18:0/2956330430 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512804f170 con 0x5599e83fd3b0 2024-09-21T07:11:30.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.032+0000 7f514406e740 1 -- 172.21.15.18:0/2956330430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e83fd3b0 msgr2=0x5599e87ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:30.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.032+0000 7f514406e740 1 --2- 172.21.15.18:0/2956330430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e83fd3b0 0x5599e87ce2e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5128005c40 tx=0x7f512807e120 comp rx=0 tx=0).stop 2024-09-21T07:11:30.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.032+0000 7f514406e740 1 -- 172.21.15.18:0/2956330430 shutdown_connections 2024-09-21T07:11:30.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.032+0000 7f514406e740 1 --2- 172.21.15.18:0/2956330430 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e8426270 0x5599e87da3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.032+0000 7f514406e740 1 --2- 172.21.15.18:0/2956330430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e8405590 0x5599e87d9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.032+0000 7f514406e740 1 --2- 172.21.15.18:0/2956330430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e83fd3b0 0x5599e87ce2e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.032+0000 7f514406e740 1 -- 172.21.15.18:0/2956330430 >> 172.21.15.18:0/2956330430 conn(0x5599e841a3c0 msgr2=0x5599e87e6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:30.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.032+0000 7f514406e740 1 -- 172.21.15.18:0/2956330430 shutdown_connections 2024-09-21T07:11:30.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.032+0000 7f514406e740 1 -- 172.21.15.18:0/2956330430 wait complete. 2024-09-21T07:11:30.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.033+0000 7f514406e740 1 -- start start 2024-09-21T07:11:30.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.033+0000 7f514406e740 1 Processor -- start 2024-09-21T07:11:30.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.034+0000 7f514406e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e83fd3b0 0x5599e87f80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.034+0000 7f514406e740 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e8405590 0x5599e87f8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.034+0000 7f514406e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e8426270 0x5599e8834d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.034+0000 7f514406e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5599e87e06d0 con 0x5599e8426270 2024-09-21T07:11:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.034+0000 7f514406e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5599e87e0fd0 con 0x5599e83fd3b0 2024-09-21T07:11:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.034+0000 7f514406e740 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x5599e87e2860 con 0x5599e8405590 2024-09-21T07:11:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.034+0000 7f514406e740 10 client.0 _ll_register_callbacks cb 0x7f512805fc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:11:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.034+0000 7f513759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e8426270 0x5599e8834d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.034+0000 7f513759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e8426270 0x5599e8834d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60188/0 (socket says 172.21.15.18:60188) 2024-09-21T07:11:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.034+0000 7f5136d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e83fd3b0 0x5599e87f80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.034+0000 7f513759e640 1 -- 172.21.15.18:0/1591395544 learned_addr learned my addr 172.21.15.18:0/1591395544 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.034+0000 7f513659c640 1 --2- 172.21.15.18:0/1591395544 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e8405590 0x5599e87f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f5136d9d640 1 -- 172.21.15.18:0/1591395544 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e8405590 msgr2=0x5599e87f8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f5136d9d640 1 --2- 172.21.15.18:0/1591395544 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e8405590 0x5599e87f8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f5136d9d640 1 -- 172.21.15.18:0/1591395544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e8426270 msgr2=0x5599e8834d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:11:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f5136d9d640 1 --2- 172.21.15.18:0/1591395544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e8426270 0x5599e8834d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f5136d9d640 1 -- 172.21.15.18:0/1591395544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599e87db900 con 0x5599e83fd3b0 2024-09-21T07:11:30.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f513759e640 1 --2- 172.21.15.18:0/1591395544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e8426270 0x5599e8834d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:11:30.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f5136d9d640 1 --2- 172.21.15.18:0/1591395544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e83fd3b0 0x5599e87f80f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f51280604b0 tx=0x7f5128063460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebc0754921aa060f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:30.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f5115ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T07:11:30.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f5115ffb640 1 -- 172.21.15.18:0/1591395544 <== mon.1 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128072060 con 0x5599e83fd3b0 2024-09-21T07:11:30.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f514406e740 1 -- 172.21.15.18:0/1591395544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f512806d710 con 0x5599e83fd3b0 2024-09-21T07:11:30.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f5115ffb640 1 -- 172.21.15.18:0/1591395544 <== mon.1 v2:172.21.15.49:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f5128012b40 con 0x5599e83fd3b0 2024-09-21T07:11:30.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f5115ffb640 1 -- 172.21.15.18:0/1591395544 <== mon.1 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f5128078050 con 0x5599e83fd3b0 2024-09-21T07:11:30.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f514406e740 10 client.4906 fetch_fsmap learned FSMap version 17 2024-09-21T07:11:30.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f514406e740 1 -- 172.21.15.18:0/1591395544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5599e8822420 con 0x5599e83fd3b0 2024-09-21T07:11:30.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f5115ffb640 1 -- 172.21.15.18:0/1591395544 <== mon.1 v2:172.21.15.49:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f512806d710 con 0x5599e83fd3b0 2024-09-21T07:11:30.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f5115ffb640 1 -- 172.21.15.18:0/1591395544 <== mon.1 v2:172.21.15.49:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f5128062f50 con 0x5599e83fd3b0 2024-09-21T07:11:30.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.035+0000 7f514406e740 10 client.4906 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T07:11:30.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.036+0000 7f514406e740 10 client.4906 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T07:11:30.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.036+0000 7f514406e740 20 client.4906 populate_metadata read hostname 'smithi018' 2024-09-21T07:11:30.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.036+0000 7f514406e740 1 --2- 172.21.15.18:0/1591395544 >> [v2:172.21.15.49:6835/3575557854,v1:172.21.15.49:6837/3575557854] conn(0x5599e88352d0 0x5599e87de900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.036+0000 7f514406e740 4 client.4906 mds_command: new command op to 4905 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:11:30.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.036+0000 7f514406e740 1 -- 172.21.15.18:0/1591395544 --> [v2:172.21.15.49:6835/3575557854,v1:172.21.15.49:6837/3575557854] -- command(tid 0: {"prefix": "status"}) -- 0x5599e873e220 con 0x5599e88352d0 2024-09-21T07:11:30.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.036+0000 7f513659c640 1 --2- 172.21.15.18:0/1591395544 >> [v2:172.21.15.49:6835/3575557854,v1:172.21.15.49:6837/3575557854] conn(0x5599e88352d0 0x5599e87de900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.036+0000 7f5115ffb640 10 client.4906 ms_handle_connect on v2:172.21.15.49:6835/3575557854 2024-09-21T07:11:30.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.036+0000 7f513659c640 1 --2- 172.21.15.18:0/1591395544 >> [v2:172.21.15.49:6835/3575557854,v1:172.21.15.49:6837/3575557854] conn(0x5599e88352d0 0x5599e87de900 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33ccfcb7de93ed9f server_cookie=189a5a3618c8107f in_seq=0 out_seq=0 2024-09-21T07:11:30.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.036+0000 7f5115ffb640 1 -- 172.21.15.18:0/1591395544 <== mds.0 v2:172.21.15.49:6835/3575557854 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5599e873e220 con 0x5599e88352d0 2024-09-21T07:11:30.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.036+0000 7f5115ffb640 10 client.4906 handle_command_reply: tid=0 2024-09-21T07:11:30.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.036+0000 7f514406e740 1 client.4906 shutdown 2024-09-21T07:11:30.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.037+0000 7f514406e740 1 -- 172.21.15.18:0/1591395544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e83fd3b0 msgr2=0x5599e87f80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:30.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.037+0000 7f514406e740 1 --2- 172.21.15.18:0/1591395544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e83fd3b0 0x5599e87f80f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f51280604b0 tx=0x7f5128063460 comp rx=0 tx=0).stop 2024-09-21T07:11:30.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.037+0000 7f514406e740 1 -- 172.21.15.18:0/1591395544 shutdown_connections 2024-09-21T07:11:30.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.037+0000 7f514406e740 1 --2- 172.21.15.18:0/1591395544 >> [v2:172.21.15.49:6835/3575557854,v1:172.21.15.49:6837/3575557854] conn(0x5599e88352d0 0x5599e87de900 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.037+0000 7f514406e740 1 --2- 172.21.15.18:0/1591395544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599e8426270 0x5599e8834d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.037+0000 7f514406e740 1 --2- 172.21.15.18:0/1591395544 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x5599e8405590 0x5599e87f8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.037+0000 7f5115ffb640 0 client.4906 ms_handle_reset on v2:172.21.15.49:6835/3575557854 2024-09-21T07:11:30.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.037+0000 7f514406e740 1 --2- 172.21.15.18:0/1591395544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599e83fd3b0 0x5599e87f80f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.037+0000 7f514406e740 1 -- 172.21.15.18:0/1591395544 >> 172.21.15.18:0/1591395544 conn(0x5599e841a3c0 msgr2=0x5599e87e6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:30.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.037+0000 7f514406e740 1 -- 172.21.15.18:0/1591395544 shutdown_connections 2024-09-21T07:11:30.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.037+0000 7f514406e740 1 -- 172.21.15.18:0/1591395544 wait complete. 2024-09-21T07:11:30.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.037+0000 7f514406e740 20 client.4906 trim_cache size 0 max 16384 2024-09-21T07:11:30.045 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T07:11:30.045 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "ed917ec8-3fd9-4777-97f4-b5e2f57d6f41", 2024-09-21T07:11:30.045 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-21T07:11:30.045 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4905, 2024-09-21T07:11:30.045 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-21T07:11:30.045 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-21T07:11:30.045 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-21T07:11:30.045 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 5.8499515850000003, 2024-09-21T07:11:30.045 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 17, 2024-09-21T07:11:30.045 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 32, 2024-09-21T07:11:30.045 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 32, 2024-09-21T07:11:30.046 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 12.747849812 2024-09-21T07:11:30.046 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T07:11:30.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.038+0000 7f513d027640 1 -- 172.21.15.18:0/1210207713 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5118078b90 msgr2=0x7f511807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:30.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.038+0000 7f513d027640 1 --2- 172.21.15.18:0/1210207713 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5118078b90 0x7f511807b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5120036000 tx=0x7f5120035040 comp rx=0 tx=0).stop 2024-09-21T07:11:30.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.038+0000 7f513d027640 1 -- 172.21.15.18:0/1210207713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5124004800 msgr2=0x7f5138141db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:30.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.038+0000 7f513d027640 1 --2- 172.21.15.18:0/1210207713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5124004800 0x7f5138141db0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5128004370 tx=0x7f5128004830 comp rx=0 tx=0).stop 2024-09-21T07:11:30.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.038+0000 7f513d027640 1 -- 172.21.15.18:0/1210207713 shutdown_connections 2024-09-21T07:11:30.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.038+0000 7f513d027640 1 --2- 172.21.15.18:0/1210207713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f513815b310 0x7f513806de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.038+0000 7f513d027640 1 --2- 172.21.15.18:0/1210207713 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5118078b90 0x7f511807b0a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.038+0000 7f513d027640 1 --2- 172.21.15.18:0/1210207713 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f513815af00 0x7f513806d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.038+0000 7f513d027640 1 --2- 172.21.15.18:0/1210207713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5124004800 0x7f5138141db0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.038+0000 7f513d027640 1 -- 172.21.15.18:0/1210207713 >> 172.21.15.18:0/1210207713 conn(0x7f5138074240 msgr2=0x7f51380d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:30.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.038+0000 7f513d027640 1 -- 172.21.15.18:0/1210207713 shutdown_connections 2024-09-21T07:11:30.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.038+0000 7f513d027640 1 -- 172.21.15.18:0/1210207713 wait complete. 2024-09-21T07:11:30.051 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:11:30.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.165+0000 7f155e669640 1 -- 172.21.15.18:0/470052485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15580d3580 msgr2=0x7f1558162a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:30.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.165+0000 7f155e669640 1 --2- 172.21.15.18:0/470052485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15580d3580 0x7f1558162a40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1550005fd0 tx=0x7f155002a8b0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.165+0000 7f155e669640 1 -- 172.21.15.18:0/470052485 shutdown_connections 2024-09-21T07:11:30.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.165+0000 7f155e669640 1 --2- 172.21.15.18:0/470052485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15580d3580 0x7f1558162a40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.165+0000 7f155e669640 1 --2- 172.21.15.18:0/470052485 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f155815c520 0x7f15580d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.165+0000 7f155e669640 1 -- 172.21.15.18:0/470052485 >> 172.21.15.18:0/470052485 conn(0x7f1558073f30 msgr2=0x7f15580b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.165+0000 7f155e669640 1 -- 172.21.15.18:0/470052485 shutdown_connections 2024-09-21T07:11:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.165+0000 7f155e669640 1 -- 172.21.15.18:0/470052485 wait complete. 2024-09-21T07:11:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.167+0000 7f155e669640 1 Processor -- start 2024-09-21T07:11:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.167+0000 7f155e669640 1 -- start start 2024-09-21T07:11:30.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f155e669640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f15580d3580 0x7f15580ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f155e669640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155815c520 0x7f15580d4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f155e669640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155815ef50 0x7f15580cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f155e669640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15580d11a0 con 0x7f155815c520 2024-09-21T07:11:30.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f155e669640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f15580d1020 con 0x7f155815ef50 2024-09-21T07:11:30.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f155e669640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f15580d1320 con 0x7f15580d3580 2024-09-21T07:11:30.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f15577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155815c520 0x7f15580d4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f15577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155815c520 0x7f15580d4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60200/0 (socket says 172.21.15.18:60200) 2024-09-21T07:11:30.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f15577fe640 1 -- 172.21.15.18:0/2384104257 learned_addr learned my addr 172.21.15.18:0/2384104257 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:30.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f155cc06640 1 --2- 172.21.15.18:0/2384104257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155815ef50 0x7f15580cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f1557fff640 1 --2- 172.21.15.18:0/2384104257 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f15580d3580 0x7f15580ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f15577fe640 1 -- 172.21.15.18:0/2384104257 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f15580d3580 msgr2=0x7f15580ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:30.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f15577fe640 1 --2- 172.21.15.18:0/2384104257 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f15580d3580 0x7f15580ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f15577fe640 1 -- 172.21.15.18:0/2384104257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155815ef50 msgr2=0x7f15580cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:30.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f15577fe640 1 --2- 172.21.15.18:0/2384104257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155815ef50 0x7f15580cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f15577fe640 1 -- 172.21.15.18:0/2384104257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15580cd070 con 0x7f155815c520 2024-09-21T07:11:30.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f15577fe640 1 --2- 172.21.15.18:0/2384104257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155815c520 0x7f15580d4810 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f154c00d6a0 tx=0x7f154c00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:30.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.169+0000 7f1554ff9640 1 -- 172.21.15.18:0/2384104257 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c017070 con 0x7f155815c520 2024-09-21T07:11:30.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.170+0000 7f1554ff9640 1 -- 172.21.15.18:0/2384104257 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f154c009b10 con 0x7f155815c520 2024-09-21T07:11:30.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.170+0000 7f155e669640 1 -- 172.21.15.18:0/2384104257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15580cd350 con 0x7f155815c520 2024-09-21T07:11:30.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.170+0000 7f1554ff9640 1 -- 172.21.15.18:0/2384104257 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c010460 con 0x7f155815c520 2024-09-21T07:11:30.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.170+0000 7f155e669640 1 -- 172.21.15.18:0/2384104257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15580ae680 con 0x7f155815c520 2024-09-21T07:11:30.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.171+0000 7f155e669640 1 -- 172.21.15.18:0/2384104257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15580ac8b0 con 0x7f155815c520 2024-09-21T07:11:30.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.171+0000 7f1554ff9640 1 -- 172.21.15.18:0/2384104257 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f154c01a070 con 0x7f155815c520 2024-09-21T07:11:30.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.172+0000 7f1554ff9640 1 --2- 172.21.15.18:0/2384104257 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1544078b90 0x7f154407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:30.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.172+0000 7f1554ff9640 1 -- 172.21.15.18:0/2384104257 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f154c09adb0 con 0x7f155815c520 2024-09-21T07:11:30.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.172+0000 7f1557fff640 1 --2- 172.21.15.18:0/2384104257 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1544078b90 0x7f154407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:30.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.173+0000 7f1557fff640 1 --2- 172.21.15.18:0/2384104257 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1544078b90 0x7f154407b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1548001720 tx=0x7f1548007e90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:30.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.177+0000 7f1554ff9640 1 -- 172.21.15.18:0/2384104257 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f154c062ba0 con 0x7f155815c520 2024-09-21T07:11:30.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.405+0000 7f155e669640 1 -- 172.21.15.18:0/2384104257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f15580d17d0 con 0x7f155815c520 2024-09-21T07:11:30.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.406+0000 7f1554ff9640 1 -- 172.21.15.18:0/2384104257 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f154c0675d0 con 0x7f155815c520 2024-09-21T07:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:11:30.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.408+0000 7f155e669640 1 -- 172.21.15.18:0/2384104257 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1544078b90 msgr2=0x7f154407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:30.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.408+0000 7f155e669640 1 --2- 172.21.15.18:0/2384104257 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1544078b90 0x7f154407b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1548001720 tx=0x7f1548007e90 comp rx=0 tx=0).stop 2024-09-21T07:11:30.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.408+0000 7f155e669640 1 -- 172.21.15.18:0/2384104257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155815c520 msgr2=0x7f15580d4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:30.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.408+0000 7f155e669640 1 --2- 172.21.15.18:0/2384104257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155815c520 0x7f15580d4810 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f154c00d6a0 tx=0x7f154c00db60 comp rx=0 tx=0).stop 2024-09-21T07:11:30.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.408+0000 7f155e669640 1 -- 172.21.15.18:0/2384104257 shutdown_connections 2024-09-21T07:11:30.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.408+0000 7f155e669640 1 --2- 172.21.15.18:0/2384104257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155815ef50 0x7f15580cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.408+0000 7f155e669640 1 --2- 172.21.15.18:0/2384104257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155815c520 0x7f15580d4810 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.408+0000 7f155e669640 1 --2- 172.21.15.18:0/2384104257 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1544078b90 0x7f154407b0a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.408+0000 7f155e669640 1 --2- 172.21.15.18:0/2384104257 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f15580d3580 0x7f15580ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:30.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.408+0000 7f155e669640 1 -- 172.21.15.18:0/2384104257 >> 172.21.15.18:0/2384104257 conn(0x7f1558073f30 msgr2=0x7f15580b99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:30.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.409+0000 7f155e669640 1 -- 172.21.15.18:0/2384104257 shutdown_connections 2024-09-21T07:11:30.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30.409+0000 7f155e669640 1 -- 172.21.15.18:0/2384104257 wait complete. 2024-09-21T07:11:30.421 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:11:30.421 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:11:30.422 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-21T07:11:30.422 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:11:30.422 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:11:30.422 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:11:30.422 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:11:30.422 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:11:30.422 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:11:30.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:30.422 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-21T07:11:30.439 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:11:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:11:30.439 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-21T07:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-21T07:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-21T07:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-21T07:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T07:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42665sec preferred_lft 42665sec 2024-09-21T07:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-21T07:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-21T07:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 56:4e:7f:fd:b6:ee brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::8032:aaff:fe57:3b46/64 scope link 2024-09-21T07:11:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:30.442 INFO:teuthology.orchestra.run.smithi018.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:11:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 56:4e:7f:fd:b6:ee brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:11:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::544e:7fff:fefd:b6ee/64 scope link 2024-09-21T07:11:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:30.442 INFO:teuthology.orchestra.run.smithi018.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:11:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether da:a9:49:0b:89:f8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:11:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::d8a9:49ff:fe0b:89f8/64 scope link 2024-09-21T07:11:30.442 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:30.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:30.443 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:11:30.504 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-21T07:11:30.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:30.506 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-21T07:11:30.562 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-21T07:11:30.562 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:11:30.562 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T07:11:30.562 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T07:11:30.562 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:11:30.563 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:30.563 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-21T07:11:30.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T07:11:30.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T07:11:30.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T07:11:30.563 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-21T07:11:30.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:30.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:30.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:30.692 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-21T07:11:30.708 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:11:30.708 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:11:30.708 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:11:30.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:30.709 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-21T07:11:30.774 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:11:30.774 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:11:30.830 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:11:30.830 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:11:30.830 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:11:30.886 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:11:30.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:30.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:30.982 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:30.982 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:11:30.991 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:30.991 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:11:30.991 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.49:3300,172.21.15.49:3301" 2024-09-21T07:11:30.991 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@ed917ec8-3fd9-4777-97f4-b5e2f57d6f41.cephfs=/ 2024-09-21T07:11:30.992 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.49:3300/172.21.15.49:3301" will pass to kernel 2024-09-21T07:11:30.993 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T07:11:30.993 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-21T07:11:30.993 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T07:11:30.993 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T07:11:30.993 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T07:11:30.994 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:11:30.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:30.995 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:11:31.021 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:11:31.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:31.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:31.126 INFO:teuthology.orchestra.run.smithi018.stdout:client5061 2024-09-21T07:11:31.126 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:11:31.126 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:31.144 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:11:31.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.300+0000 7fabf4c7e640 1 -- 172.21.15.18:0/260661982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabf00cef70 msgr2=0x7fabf00d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.300+0000 7fabf4c7e640 1 --2- 172.21.15.18:0/260661982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabf00cef70 0x7fabf00d3040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fabd80098e0 tx=0x7fabd802a5d0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.300+0000 7fabf4c7e640 1 -- 172.21.15.18:0/260661982 shutdown_connections 2024-09-21T07:11:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.300+0000 7fabf4c7e640 1 --2- 172.21.15.18:0/260661982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabf00cef70 0x7fabf00d3040 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.300+0000 7fabf4c7e640 1 --2- 172.21.15.18:0/260661982 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fabf015ef50 0x7fabf015c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.300+0000 7fabf4c7e640 1 -- 172.21.15.18:0/260661982 >> 172.21.15.18:0/260661982 conn(0x7fabf0073f30 msgr2=0x7fabf00b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.300+0000 7fabf4c7e640 1 -- 172.21.15.18:0/260661982 shutdown_connections 2024-09-21T07:11:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.300+0000 7fabf4c7e640 1 -- 172.21.15.18:0/260661982 wait complete. 2024-09-21T07:11:31.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.302+0000 7fabf4c7e640 1 Processor -- start 2024-09-21T07:11:31.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.302+0000 7fabf4c7e640 1 -- start start 2024-09-21T07:11:31.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabf4c7e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabf00cef70 0x7fabf00cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:31.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabf4c7e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabf00d3580 0x7fabf00b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:31.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabf4c7e640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fabf015ef50 0x7fabf00b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:31.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabf4c7e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fabf00d11a0 con 0x7fabf00d3580 2024-09-21T07:11:31.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabf4c7e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fabf00d1020 con 0x7fabf00cef70 2024-09-21T07:11:31.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabf4c7e640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fabf00d1320 con 0x7fabf015ef50 2024-09-21T07:11:31.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabedd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabf00d3580 0x7fabf00b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:31.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabedd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabf00d3580 0x7fabf00b51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60222/0 (socket says 172.21.15.18:60222) 2024-09-21T07:11:31.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabedd9b640 1 -- 172.21.15.18:0/2442764003 learned_addr learned my addr 172.21.15.18:0/2442764003 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:31.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabee59c640 1 --2- 172.21.15.18:0/2442764003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabf00cef70 0x7fabf00cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:31.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabeed9d640 1 --2- 172.21.15.18:0/2442764003 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fabf015ef50 0x7fabf00b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:31.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabedd9b640 1 -- 172.21.15.18:0/2442764003 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fabf015ef50 msgr2=0x7fabf00b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:31.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabedd9b640 1 --2- 172.21.15.18:0/2442764003 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fabf015ef50 0x7fabf00b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabedd9b640 1 -- 172.21.15.18:0/2442764003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabf00cef70 msgr2=0x7fabf00cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:31.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabedd9b640 1 --2- 172.21.15.18:0/2442764003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabf00cef70 0x7fabf00cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabedd9b640 1 -- 172.21.15.18:0/2442764003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf01f6400 con 0x7fabf00d3580 2024-09-21T07:11:31.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.304+0000 7fabedd9b640 1 --2- 172.21.15.18:0/2442764003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabf00d3580 0x7fabf00b51c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009a00 tx=0x7fabd80316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:31.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.305+0000 7fabe6ffd640 1 -- 172.21.15.18:0/2442764003 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd803f070 con 0x7fabf00d3580 2024-09-21T07:11:31.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.305+0000 7fabe6ffd640 1 -- 172.21.15.18:0/2442764003 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabd8031950 con 0x7fabf00d3580 2024-09-21T07:11:31.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.305+0000 7fabe6ffd640 1 -- 172.21.15.18:0/2442764003 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd8031da0 con 0x7fabf00d3580 2024-09-21T07:11:31.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.305+0000 7fabf4c7e640 1 -- 172.21.15.18:0/2442764003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf01f6740 con 0x7fabf00d3580 2024-09-21T07:11:31.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.305+0000 7fabf4c7e640 1 -- 172.21.15.18:0/2442764003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf01f69e0 con 0x7fabf00d3580 2024-09-21T07:11:31.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.306+0000 7fabf4c7e640 1 -- 172.21.15.18:0/2442764003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabf00d17d0 con 0x7fabf00d3580 2024-09-21T07:11:31.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.306+0000 7fabe6ffd640 1 -- 172.21.15.18:0/2442764003 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fabd8042070 con 0x7fabf00d3580 2024-09-21T07:11:31.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.307+0000 7fabe6ffd640 1 --2- 172.21.15.18:0/2442764003 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fabd0078b90 0x7fabd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:31.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.307+0000 7fabe6ffd640 1 -- 172.21.15.18:0/2442764003 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fabd80bb940 con 0x7fabf00d3580 2024-09-21T07:11:31.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.307+0000 7fabee59c640 1 --2- 172.21.15.18:0/2442764003 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fabd0078b90 0x7fabd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:31.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.308+0000 7fabee59c640 1 --2- 172.21.15.18:0/2442764003 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fabd0078b90 0x7fabd007b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fabe0005fd0 tx=0x7fabe00095e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:31.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.311+0000 7fabe6ffd640 1 -- 172.21.15.18:0/2442764003 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fabd8083850 con 0x7fabf00d3580 2024-09-21T07:11:31.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.540+0000 7fabf4c7e640 1 -- 172.21.15.18:0/2442764003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fabf015ea60 con 0x7fabf00d3580 2024-09-21T07:11:31.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.540+0000 7fabe6ffd640 1 -- 172.21.15.18:0/2442764003 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7fabd8088280 con 0x7fabf00d3580 2024-09-21T07:11:31.542 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:11:31.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.542+0000 7fabf4c7e640 1 -- 172.21.15.18:0/2442764003 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fabd0078b90 msgr2=0x7fabd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:31.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.542+0000 7fabf4c7e640 1 --2- 172.21.15.18:0/2442764003 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fabd0078b90 0x7fabd007b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fabe0005fd0 tx=0x7fabe00095e0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.542+0000 7fabf4c7e640 1 -- 172.21.15.18:0/2442764003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabf00d3580 msgr2=0x7fabf00b51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:31.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.542+0000 7fabf4c7e640 1 --2- 172.21.15.18:0/2442764003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabf00d3580 0x7fabf00b51c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009a00 tx=0x7fabd80316b0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.542+0000 7fabf4c7e640 1 -- 172.21.15.18:0/2442764003 shutdown_connections 2024-09-21T07:11:31.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.542+0000 7fabf4c7e640 1 --2- 172.21.15.18:0/2442764003 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fabd0078b90 0x7fabd007b0a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.542+0000 7fabf4c7e640 1 --2- 172.21.15.18:0/2442764003 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fabf015ef50 0x7fabf00b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.542+0000 7fabf4c7e640 1 --2- 172.21.15.18:0/2442764003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabf00d3580 0x7fabf00b51c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.542+0000 7fabf4c7e640 1 --2- 172.21.15.18:0/2442764003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabf00cef70 0x7fabf00cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:31.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.542+0000 7fabf4c7e640 1 -- 172.21.15.18:0/2442764003 >> 172.21.15.18:0/2442764003 conn(0x7fabf0073f30 msgr2=0x7fabf015d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:31.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.542+0000 7fabf4c7e640 1 -- 172.21.15.18:0/2442764003 shutdown_connections 2024-09-21T07:11:31.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:31.542+0000 7fabf4c7e640 1 -- 172.21.15.18:0/2442764003 wait complete. 2024-09-21T07:11:31.555 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:11:31.555 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:11:31.555 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-09-21T07:11:31.555 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T07:11:31.555 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T07:11:31.555 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:11:31.555 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:11:31.555 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:11:31.555 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T07:11:31.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:31.556 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-09-21T07:11:31.576 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:11:31.576 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:11:31.576 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:11:31.576 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:31.576 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-09-21T07:11:31.576 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:31.576 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:31.576 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:31.576 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-09-21T07:11:31.577 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:31.577 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:31.577 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-09-21T07:11:31.577 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:11:31.577 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:31.577 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-09-21T07:11:31.577 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T07:11:31.577 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42707sec preferred_lft 42707sec 2024-09-21T07:11:31.577 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-09-21T07:11:31.577 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:31.577 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:11:31.577 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:31.577 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-09-21T07:11:31.577 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:11:31.578 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 1e:0f:57:03:f6:94 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:11:31.578 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:11:31.578 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:31.578 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e480:3cff:fe77:95ef/64 scope link 2024-09-21T07:11:31.578 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:31.578 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:11:31.578 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ba:ad:85:96:3c:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T07:11:31.578 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::b8ad:85ff:fe96:3c34/64 scope link 2024-09-21T07:11:31.578 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:31.578 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:11:31.578 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 1e:0f:57:03:f6:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T07:11:31.578 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::1c0f:57ff:fe03:f694/64 scope link 2024-09-21T07:11:31.578 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:11:31.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:31.579 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:11:31.645 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-09-21T07:11:31.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:31.647 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-09-21T07:11:31.707 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-09-21T07:11:31.707 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:11:31.707 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T07:11:31.707 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T07:11:31.707 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:11:31.707 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:11:31.707 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-21T07:11:31.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T07:11:31.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T07:11:31.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T07:11:31.708 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-21T07:11:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:11:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:31.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:31.847 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-09-21T07:11:31.863 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T07:11:31.863 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T07:11:31.864 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T07:11:31.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:31.864 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-09-21T07:11:31.931 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:11:31.931 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T07:11:31.987 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T07:11:31.987 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:11:31.987 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T07:11:32.044 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T07:11:32.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:32.044 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:32.141 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:32.141 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:11:32.150 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:11:32.150 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:11:32.150 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.49:3300,172.21.15.49:3301" 2024-09-21T07:11:32.150 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 1@ed917ec8-3fd9-4777-97f4-b5e2f57d6f41.cephfs=/ 2024-09-21T07:11:32.150 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.18:3300/172.21.15.49:3300/172.21.15.49:3301" will pass to kernel 2024-09-21T07:11:32.151 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T07:11:32.151 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2024-09-21T07:11:32.151 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T07:11:32.151 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T07:11:32.151 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T07:11:32.152 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:11:32.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:32.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T07:11:32.177 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:11:32.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:32.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T07:11:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:32.276 INFO:teuthology.orchestra.run.smithi049.stdout:client4918 2024-09-21T07:11:32.276 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:11:32.276 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:32.292 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-21T07:11:32.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.420+0000 7f3f998e5640 1 -- 172.21.15.18:0/1587356649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9415c520 msgr2=0x7f3f940d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.420+0000 7f3f998e5640 1 --2- 172.21.15.18:0/1587356649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9415c520 0x7f3f940d3040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0098e0 tx=0x7f3f7c02a5d0 comp rx=0 tx=0).stop 2024-09-21T07:11:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.420+0000 7f3f998e5640 1 -- 172.21.15.18:0/1587356649 shutdown_connections 2024-09-21T07:11:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.420+0000 7f3f998e5640 1 --2- 172.21.15.18:0/1587356649 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f3f940d3580 0x7f3f94162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.420+0000 7f3f998e5640 1 --2- 172.21.15.18:0/1587356649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9415c520 0x7f3f940d3040 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.420+0000 7f3f998e5640 1 -- 172.21.15.18:0/1587356649 >> 172.21.15.18:0/1587356649 conn(0x7f3f94073f30 msgr2=0x7f3f940b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.420+0000 7f3f998e5640 1 -- 172.21.15.18:0/1587356649 shutdown_connections 2024-09-21T07:11:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.420+0000 7f3f998e5640 1 -- 172.21.15.18:0/1587356649 wait complete. 2024-09-21T07:11:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.422+0000 7f3f998e5640 1 Processor -- start 2024-09-21T07:11:32.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.422+0000 7f3f998e5640 1 -- start start 2024-09-21T07:11:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f998e5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f940d3580 0x7f3f941f8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f998e5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9415c520 0x7f3f940cee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f998e5640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f3f9415ef50 0x7f3f940b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f998e5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3f940d1020 con 0x7f3f9415c520 2024-09-21T07:11:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f998e5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3f94163380 con 0x7f3f940d3580 2024-09-21T07:11:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f998e5640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f3f940d11a0 con 0x7f3f9415ef50 2024-09-21T07:11:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f927fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9415c520 0x7f3f940cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f927fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9415c520 0x7f3f940cee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60228/0 (socket says 172.21.15.18:60228) 2024-09-21T07:11:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f927fc640 1 -- 172.21.15.18:0/4164523353 learned_addr learned my addr 172.21.15.18:0/4164523353 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f92ffd640 1 --2- 172.21.15.18:0/4164523353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f940d3580 0x7f3f941f8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f937fe640 1 --2- 172.21.15.18:0/4164523353 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f3f9415ef50 0x7f3f940b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f927fc640 1 -- 172.21.15.18:0/4164523353 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f3f9415ef50 msgr2=0x7f3f940b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f927fc640 1 --2- 172.21.15.18:0/4164523353 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f3f9415ef50 0x7f3f940b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f927fc640 1 -- 172.21.15.18:0/4164523353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f940d3580 msgr2=0x7f3f941f8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f927fc640 1 --2- 172.21.15.18:0/4164523353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f940d3580 0x7f3f941f8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f927fc640 1 -- 172.21.15.18:0/4164523353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f941f9460 con 0x7f3f9415c520 2024-09-21T07:11:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f927fc640 1 --2- 172.21.15.18:0/4164523353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9415c520 0x7f3f940cee60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c02abc0 tx=0x7f3f7c0316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f8bfff640 1 -- 172.21.15.18:0/4164523353 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c031d60 con 0x7f3f9415c520 2024-09-21T07:11:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.424+0000 7f3f8bfff640 1 -- 172.21.15.18:0/4164523353 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f7c0047a0 con 0x7f3f9415c520 2024-09-21T07:11:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.425+0000 7f3f998e5640 1 -- 172.21.15.18:0/4164523353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f941f9740 con 0x7f3f9415c520 2024-09-21T07:11:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.425+0000 7f3f8bfff640 1 -- 172.21.15.18:0/4164523353 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c004bf0 con 0x7f3f9415c520 2024-09-21T07:11:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.425+0000 7f3f998e5640 1 -- 172.21.15.18:0/4164523353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f940b13e0 con 0x7f3f9415c520 2024-09-21T07:11:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.426+0000 7f3f998e5640 1 -- 172.21.15.18:0/4164523353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f941f91d0 con 0x7f3f9415c520 2024-09-21T07:11:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.426+0000 7f3f8bfff640 1 -- 172.21.15.18:0/4164523353 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3f7c0330d0 con 0x7f3f9415c520 2024-09-21T07:11:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.427+0000 7f3f8bfff640 1 --2- 172.21.15.18:0/4164523353 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3f74078b90 0x7f3f7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.427+0000 7f3f8bfff640 1 -- 172.21.15.18:0/4164523353 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f3f7c0bbbb0 con 0x7f3f9415c520 2024-09-21T07:11:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.427+0000 7f3f92ffd640 1 --2- 172.21.15.18:0/4164523353 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3f74078b90 0x7f3f7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.428+0000 7f3f92ffd640 1 --2- 172.21.15.18:0/4164523353 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3f74078b90 0x7f3f7407b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3f84000f60 tx=0x7f3f84009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:32.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.431+0000 7f3f8bfff640 1 -- 172.21.15.18:0/4164523353 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3f7c03f030 con 0x7f3f9415c520 2024-09-21T07:11:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:32.658+0000 7f3f998e5640 1 -- 172.21.15.18:0/4164523353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f3f940d16c0 con 0x7f3f9415c520 2024-09-21T07:11:33.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.240+0000 7f3f8bfff640 1 -- 172.21.15.18:0/4164523353 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) ==== 136+0+0 (secure 0 0 0) 0x7f3f7c083a30 con 0x7f3f9415c520 2024-09-21T07:11:33.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.243+0000 7f3f998e5640 1 -- 172.21.15.18:0/4164523353 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3f74078b90 msgr2=0x7f3f7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.243+0000 7f3f998e5640 1 --2- 172.21.15.18:0/4164523353 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3f74078b90 0x7f3f7407b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3f84000f60 tx=0x7f3f84009040 comp rx=0 tx=0).stop 2024-09-21T07:11:33.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.243+0000 7f3f998e5640 1 -- 172.21.15.18:0/4164523353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9415c520 msgr2=0x7f3f940cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.243+0000 7f3f998e5640 1 --2- 172.21.15.18:0/4164523353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9415c520 0x7f3f940cee60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c02abc0 tx=0x7f3f7c0316b0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.243+0000 7f3f998e5640 1 -- 172.21.15.18:0/4164523353 shutdown_connections 2024-09-21T07:11:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.243+0000 7f3f998e5640 1 --2- 172.21.15.18:0/4164523353 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3f74078b90 0x7f3f7407b0a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.243+0000 7f3f998e5640 1 --2- 172.21.15.18:0/4164523353 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f3f9415ef50 0x7f3f940b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.243+0000 7f3f998e5640 1 --2- 172.21.15.18:0/4164523353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9415c520 0x7f3f940cee60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.243+0000 7f3f998e5640 1 --2- 172.21.15.18:0/4164523353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f940d3580 0x7f3f941f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.243+0000 7f3f998e5640 1 -- 172.21.15.18:0/4164523353 >> 172.21.15.18:0/4164523353 conn(0x7f3f94073f30 msgr2=0x7f3f9415d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.243+0000 7f3f998e5640 1 -- 172.21.15.18:0/4164523353 shutdown_connections 2024-09-21T07:11:33.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.244+0000 7f3f998e5640 1 -- 172.21.15.18:0/4164523353 wait complete. 2024-09-21T07:11:33.259 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-21T07:11:33.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.383+0000 7f03016ec640 1 -- 172.21.15.18:0/2249231638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02fc15ef50 msgr2=0x7f02fc15c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.383+0000 7f03016ec640 1 --2- 172.21.15.18:0/2249231638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02fc15ef50 0x7f02fc15c520 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f02ec005fd0 tx=0x7f02ec02a5d0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.383+0000 7f03016ec640 1 -- 172.21.15.18:0/2249231638 shutdown_connections 2024-09-21T07:11:33.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.383+0000 7f03016ec640 1 --2- 172.21.15.18:0/2249231638 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f02fc162a40 0x7f02fc162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.383+0000 7f03016ec640 1 --2- 172.21.15.18:0/2249231638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02fc15ef50 0x7f02fc15c520 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.383+0000 7f03016ec640 1 -- 172.21.15.18:0/2249231638 >> 172.21.15.18:0/2249231638 conn(0x7f02fc073f30 msgr2=0x7f02fc0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:33.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.383+0000 7f03016ec640 1 -- 172.21.15.18:0/2249231638 shutdown_connections 2024-09-21T07:11:33.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.383+0000 7f03016ec640 1 -- 172.21.15.18:0/2249231638 wait complete. 2024-09-21T07:11:33.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.385+0000 7f03016ec640 1 Processor -- start 2024-09-21T07:11:33.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.385+0000 7f03016ec640 1 -- start start 2024-09-21T07:11:33.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.386+0000 7f03016ec640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f02fc0cef70 0x7f02fc151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:33.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.386+0000 7f03016ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02fc15ef50 0x7f02fc1f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:33.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.386+0000 7f03016ec640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02fc162a40 0x7f02fc1f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:33.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.386+0000 7f03016ec640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc0d11a0 con 0x7f02fc162a40 2024-09-21T07:11:33.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.386+0000 7f03016ec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc0d1020 con 0x7f02fc15ef50 2024-09-21T07:11:33.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.386+0000 7f03016ec640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f02fc0d1320 con 0x7f02fc0cef70 2024-09-21T07:11:33.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.386+0000 7f02fb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02fc162a40 0x7f02fc1f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:33.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.386+0000 7f02fb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02fc162a40 0x7f02fc1f92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60252/0 (socket says 172.21.15.18:60252) 2024-09-21T07:11:33.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.386+0000 7f02faffd640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f02fc0cef70 0x7f02fc151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:33.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.386+0000 7f02fb7fe640 1 -- 172.21.15.18:0/2026747471 learned_addr learned my addr 172.21.15.18:0/2026747471 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:33.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.386+0000 7f02fa7fc640 1 --2- 172.21.15.18:0/2026747471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02fc15ef50 0x7f02fc1f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:33.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.387+0000 7f02fb7fe640 1 -- 172.21.15.18:0/2026747471 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f02fc0cef70 msgr2=0x7f02fc151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.387+0000 7f02fb7fe640 1 --2- 172.21.15.18:0/2026747471 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f02fc0cef70 0x7f02fc151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.387+0000 7f02fb7fe640 1 -- 172.21.15.18:0/2026747471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02fc15ef50 msgr2=0x7f02fc1f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.387+0000 7f02fb7fe640 1 --2- 172.21.15.18:0/2026747471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02fc15ef50 0x7f02fc1f8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.387+0000 7f02fb7fe640 1 -- 172.21.15.18:0/2026747471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02fc155140 con 0x7f02fc162a40 2024-09-21T07:11:33.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.387+0000 7f02fb7fe640 1 --2- 172.21.15.18:0/2026747471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02fc162a40 0x7f02fc1f92f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f02f400ea40 tx=0x7f02f400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:33.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.387+0000 7f02e37fe640 1 -- 172.21.15.18:0/2026747471 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f400ce40 con 0x7f02fc162a40 2024-09-21T07:11:33.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.387+0000 7f02e37fe640 1 -- 172.21.15.18:0/2026747471 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02f4004c10 con 0x7f02fc162a40 2024-09-21T07:11:33.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.387+0000 7f03016ec640 1 -- 172.21.15.18:0/2026747471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02fc155420 con 0x7f02fc162a40 2024-09-21T07:11:33.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.387+0000 7f02e37fe640 1 -- 172.21.15.18:0/2026747471 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4005020 con 0x7f02fc162a40 2024-09-21T07:11:33.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.387+0000 7f03016ec640 1 -- 172.21.15.18:0/2026747471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02fc1587e0 con 0x7f02fc162a40 2024-09-21T07:11:33.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.388+0000 7f03016ec640 1 -- 172.21.15.18:0/2026747471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02fc0d17d0 con 0x7f02fc162a40 2024-09-21T07:11:33.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.389+0000 7f02e37fe640 1 -- 172.21.15.18:0/2026747471 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f02f40051c0 con 0x7f02fc162a40 2024-09-21T07:11:33.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.389+0000 7f02e37fe640 1 --2- 172.21.15.18:0/2026747471 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f02e8078b90 0x7f02e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:33.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.390+0000 7f02e37fe640 1 -- 172.21.15.18:0/2026747471 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f02f409ba00 con 0x7f02fc162a40 2024-09-21T07:11:33.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.390+0000 7f02faffd640 1 --2- 172.21.15.18:0/2026747471 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f02e8078b90 0x7f02e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:33.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.390+0000 7f02faffd640 1 --2- 172.21.15.18:0/2026747471 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f02e8078b90 0x7f02e807b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f02ec033000 tx=0x7f02ec004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:33.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.394+0000 7f02e37fe640 1 -- 172.21.15.18:0/2026747471 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f02f4063870 con 0x7f02fc162a40 2024-09-21T07:11:33.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.603+0000 7f03016ec640 1 -- 172.21.15.18:0/2026747471 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f02fc158a80 con 0x7f02e8078b90 2024-09-21T07:11:33.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.606+0000 7f02e37fe640 1 -- 172.21.15.18:0/2026747471 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f02fc158a80 con 0x7f02e8078b90 2024-09-21T07:11:33.607 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-21T07:11:33.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:33.607 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephfs" 2024-09-21T07:11:33.607 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:33.607 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-21T07:11:33.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.608+0000 7f03016ec640 1 -- 172.21.15.18:0/2026747471 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f02e8078b90 msgr2=0x7f02e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.608+0000 7f03016ec640 1 --2- 172.21.15.18:0/2026747471 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f02e8078b90 0x7f02e807b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f02ec033000 tx=0x7f02ec004730 comp rx=0 tx=0).stop 2024-09-21T07:11:33.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.608+0000 7f03016ec640 1 -- 172.21.15.18:0/2026747471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02fc162a40 msgr2=0x7f02fc1f92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.608+0000 7f03016ec640 1 --2- 172.21.15.18:0/2026747471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02fc162a40 0x7f02fc1f92f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f02f400ea40 tx=0x7f02f400ef00 comp rx=0 tx=0).stop 2024-09-21T07:11:33.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.608+0000 7f03016ec640 1 -- 172.21.15.18:0/2026747471 shutdown_connections 2024-09-21T07:11:33.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.608+0000 7f03016ec640 1 --2- 172.21.15.18:0/2026747471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02fc162a40 0x7f02fc1f92f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.608+0000 7f03016ec640 1 --2- 172.21.15.18:0/2026747471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02fc15ef50 0x7f02fc1f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.608+0000 7f03016ec640 1 --2- 172.21.15.18:0/2026747471 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f02e8078b90 0x7f02e807b0a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.608+0000 7f03016ec640 1 --2- 172.21.15.18:0/2026747471 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f02fc0cef70 0x7f02fc151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.608+0000 7f03016ec640 1 -- 172.21.15.18:0/2026747471 >> 172.21.15.18:0/2026747471 conn(0x7f02fc073f30 msgr2=0x7f02fc15ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:33.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.608+0000 7f03016ec640 1 -- 172.21.15.18:0/2026747471 shutdown_connections 2024-09-21T07:11:33.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.608+0000 7f03016ec640 1 -- 172.21.15.18:0/2026747471 wait complete. 2024-09-21T07:11:33.621 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:11:33.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.738+0000 7f6479bc3640 1 -- 172.21.15.18:0/3072681177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6474162a40 msgr2=0x7f6474162e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.738+0000 7f6479bc3640 1 --2- 172.21.15.18:0/3072681177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6474162a40 0x7f6474162e50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f647406dd50 tx=0x7f646c02aac0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.738+0000 7f6479bc3640 1 -- 172.21.15.18:0/3072681177 shutdown_connections 2024-09-21T07:11:33.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.738+0000 7f6479bc3640 1 --2- 172.21.15.18:0/3072681177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6474162a40 0x7f6474162e50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.738+0000 7f6479bc3640 1 --2- 172.21.15.18:0/3072681177 >> v2:172.21.15.49:3300/0 conn(0x7f647415ef50 0x7f647415c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.738+0000 7f6479bc3640 1 -- 172.21.15.18:0/3072681177 >> 172.21.15.18:0/3072681177 conn(0x7f6474073f30 msgr2=0x7f64740b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:33.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.739+0000 7f6479bc3640 1 -- 172.21.15.18:0/3072681177 shutdown_connections 2024-09-21T07:11:33.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.739+0000 7f6479bc3640 1 -- 172.21.15.18:0/3072681177 wait complete. 2024-09-21T07:11:33.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.740+0000 7f6479bc3640 1 Processor -- start 2024-09-21T07:11:33.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.740+0000 7f6479bc3640 1 -- start start 2024-09-21T07:11:33.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f6479bc3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64740cef70 0x7f64740b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:33.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f6479bc3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f647415ef50 0x7f64740b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:33.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f6479bc3640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6474162a40 0x7f64740ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:33.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f6479bc3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f64740d11a0 con 0x7f64740cef70 2024-09-21T07:11:33.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f6479bc3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f64740d1020 con 0x7f647415ef50 2024-09-21T07:11:33.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f6479bc3640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f64740d1320 con 0x7f6474162a40 2024-09-21T07:11:33.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f64737fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64740cef70 0x7f64740b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:33.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f64737fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64740cef70 0x7f64740b56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60268/0 (socket says 172.21.15.18:60268) 2024-09-21T07:11:33.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f64737fe640 1 -- 172.21.15.18:0/3040018856 learned_addr learned my addr 172.21.15.18:0/3040018856 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:33.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f6472ffd640 1 --2- 172.21.15.18:0/3040018856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f647415ef50 0x7f64740b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:33.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f6473fff640 1 --2- 172.21.15.18:0/3040018856 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6474162a40 0x7f64740ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:33.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f64737fe640 1 -- 172.21.15.18:0/3040018856 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6474162a40 msgr2=0x7f64740ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f64737fe640 1 --2- 172.21.15.18:0/3040018856 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6474162a40 0x7f64740ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f64737fe640 1 -- 172.21.15.18:0/3040018856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f647415ef50 msgr2=0x7f64740b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f64737fe640 1 --2- 172.21.15.18:0/3040018856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f647415ef50 0x7f64740b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f64737fe640 1 -- 172.21.15.18:0/3040018856 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64741f5260 con 0x7f64740cef70 2024-09-21T07:11:33.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.742+0000 7f64737fe640 1 --2- 172.21.15.18:0/3040018856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64740cef70 0x7f64740b56d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f646400c970 tx=0x7f646400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:33.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.743+0000 7f646bfff640 1 -- 172.21.15.18:0/3040018856 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6464007bb0 con 0x7f64740cef70 2024-09-21T07:11:33.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.743+0000 7f646bfff640 1 -- 172.21.15.18:0/3040018856 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6464007e40 con 0x7f64740cef70 2024-09-21T07:11:33.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.743+0000 7f6479bc3640 1 -- 172.21.15.18:0/3040018856 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64740b5c10 con 0x7f64740cef70 2024-09-21T07:11:33.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.743+0000 7f646bfff640 1 -- 172.21.15.18:0/3040018856 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646400f690 con 0x7f64740cef70 2024-09-21T07:11:33.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.743+0000 7f6479bc3640 1 -- 172.21.15.18:0/3040018856 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64741f5a40 con 0x7f64740cef70 2024-09-21T07:11:33.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.744+0000 7f6479bc3640 1 -- 172.21.15.18:0/3040018856 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64740d17d0 con 0x7f64740cef70 2024-09-21T07:11:33.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.744+0000 7f646bfff640 1 -- 172.21.15.18:0/3040018856 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f646400f830 con 0x7f64740cef70 2024-09-21T07:11:33.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.745+0000 7f646bfff640 1 --2- 172.21.15.18:0/3040018856 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6454078b90 0x7f645407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:33.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.745+0000 7f646bfff640 1 -- 172.21.15.18:0/3040018856 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f646409b4f0 con 0x7f64740cef70 2024-09-21T07:11:33.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.745+0000 7f6472ffd640 1 --2- 172.21.15.18:0/3040018856 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6454078b90 0x7f645407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:33.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.746+0000 7f6472ffd640 1 --2- 172.21.15.18:0/3040018856 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6454078b90 0x7f645407b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f64740b3370 tx=0x7f645c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:33.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.749+0000 7f646bfff640 1 -- 172.21.15.18:0/3040018856 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6464014030 con 0x7f64740cef70 2024-09-21T07:11:33.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.937+0000 7f6479bc3640 1 -- 172.21.15.18:0/3040018856 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f64740cb8a0 con 0x7f64740cef70 2024-09-21T07:11:33.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.937+0000 7f646bfff640 1 -- 172.21.15.18:0/3040018856 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f6464063260 con 0x7f64740cef70 2024-09-21T07:11:33.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.939+0000 7f6479bc3640 1 -- 172.21.15.18:0/3040018856 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6454078b90 msgr2=0x7f645407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.939+0000 7f6479bc3640 1 --2- 172.21.15.18:0/3040018856 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6454078b90 0x7f645407b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f64740b3370 tx=0x7f645c009040 comp rx=0 tx=0).stop 2024-09-21T07:11:33.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.939+0000 7f6479bc3640 1 -- 172.21.15.18:0/3040018856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64740cef70 msgr2=0x7f64740b56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:33.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.939+0000 7f6479bc3640 1 --2- 172.21.15.18:0/3040018856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64740cef70 0x7f64740b56d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f646400c970 tx=0x7f646400ce30 comp rx=0 tx=0).stop 2024-09-21T07:11:33.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.939+0000 7f6479bc3640 1 -- 172.21.15.18:0/3040018856 shutdown_connections 2024-09-21T07:11:33.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.939+0000 7f6479bc3640 1 --2- 172.21.15.18:0/3040018856 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6454078b90 0x7f645407b0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.939+0000 7f6479bc3640 1 --2- 172.21.15.18:0/3040018856 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f6474162a40 0x7f64740ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.939+0000 7f6479bc3640 1 --2- 172.21.15.18:0/3040018856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f647415ef50 0x7f64740b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.939+0000 7f6479bc3640 1 --2- 172.21.15.18:0/3040018856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64740cef70 0x7f64740b56d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:33.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.939+0000 7f6479bc3640 1 -- 172.21.15.18:0/3040018856 >> 172.21.15.18:0/3040018856 conn(0x7f6474073f30 msgr2=0x7f64740d4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:33.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.939+0000 7f6479bc3640 1 -- 172.21.15.18:0/3040018856 shutdown_connections 2024-09-21T07:11:33.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:33.940+0000 7f6479bc3640 1 -- 172.21.15.18:0/3040018856 wait complete. 2024-09-21T07:11:33.953 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs subvol_grp87960 2024-09-21T07:11:34.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.070+0000 7f25cd63f640 1 -- 172.21.15.18:0/1549346215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c815ef50 msgr2=0x7f25c815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:34.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.070+0000 7f25cd63f640 1 --2- 172.21.15.18:0/1549346215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c815ef50 0x7f25c815c520 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f25c80d1fb0 tx=0x7f25b802a530 comp rx=0 tx=0).stop 2024-09-21T07:11:34.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.070+0000 7f25cd63f640 1 -- 172.21.15.18:0/1549346215 shutdown_connections 2024-09-21T07:11:34.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.070+0000 7f25cd63f640 1 --2- 172.21.15.18:0/1549346215 >> v2:172.21.15.49:3300/0 conn(0x7f25c80cef70 0x7f25c80d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.070+0000 7f25cd63f640 1 --2- 172.21.15.18:0/1549346215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c815ef50 0x7f25c815c520 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.070+0000 7f25cd63f640 1 -- 172.21.15.18:0/1549346215 >> 172.21.15.18:0/1549346215 conn(0x7f25c8073f30 msgr2=0x7f25c80b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:34.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.071+0000 7f25cd63f640 1 -- 172.21.15.18:0/1549346215 shutdown_connections 2024-09-21T07:11:34.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.071+0000 7f25cd63f640 1 -- 172.21.15.18:0/1549346215 wait complete. 2024-09-21T07:11:34.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.072+0000 7f25cd63f640 1 Processor -- start 2024-09-21T07:11:34.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.073+0000 7f25cd63f640 1 -- start start 2024-09-21T07:11:34.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25cd63f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c80cef70 0x7f25c8151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:34.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25cd63f640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f25c80d3580 0x7f25c80ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:34.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25cd63f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25c815ef50 0x7f25c80b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:34.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25cd63f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25c80d1020 con 0x7f25c80cef70 2024-09-21T07:11:34.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25cd63f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f25c8163360 con 0x7f25c815ef50 2024-09-21T07:11:34.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25cd63f640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f25c80d11a0 con 0x7f25c80d3580 2024-09-21T07:11:34.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25c6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c80cef70 0x7f25c8151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:34.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25c6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c80cef70 0x7f25c8151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60292/0 (socket says 172.21.15.18:60292) 2024-09-21T07:11:34.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25c6ffd640 1 -- 172.21.15.18:0/3002731278 learned_addr learned my addr 172.21.15.18:0/3002731278 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:34.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25c67fc640 1 --2- 172.21.15.18:0/3002731278 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f25c80d3580 0x7f25c80ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:34.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25c77fe640 1 --2- 172.21.15.18:0/3002731278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25c815ef50 0x7f25c80b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:34.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25c6ffd640 1 -- 172.21.15.18:0/3002731278 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f25c80d3580 msgr2=0x7f25c80ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:34.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25c6ffd640 1 --2- 172.21.15.18:0/3002731278 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f25c80d3580 0x7f25c80ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25c6ffd640 1 -- 172.21.15.18:0/3002731278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25c815ef50 msgr2=0x7f25c80b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:34.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25c6ffd640 1 --2- 172.21.15.18:0/3002731278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25c815ef50 0x7f25c80b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.074+0000 7f25c6ffd640 1 -- 172.21.15.18:0/3002731278 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c81520c0 con 0x7f25c80cef70 2024-09-21T07:11:34.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.075+0000 7f25c6ffd640 1 --2- 172.21.15.18:0/3002731278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c80cef70 0x7f25c8151b80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009780 tx=0x7f25b8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:34.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.075+0000 7f25af7fe640 1 -- 172.21.15.18:0/3002731278 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8031d60 con 0x7f25c80cef70 2024-09-21T07:11:34.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.075+0000 7f25af7fe640 1 -- 172.21.15.18:0/3002731278 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25b8033e10 con 0x7f25c80cef70 2024-09-21T07:11:34.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.075+0000 7f25cd63f640 1 -- 172.21.15.18:0/3002731278 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c81f59b0 con 0x7f25c80cef70 2024-09-21T07:11:34.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.075+0000 7f25af7fe640 1 -- 172.21.15.18:0/3002731278 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8005260 con 0x7f25c80cef70 2024-09-21T07:11:34.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.075+0000 7f25cd63f640 1 -- 172.21.15.18:0/3002731278 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c80cc800 con 0x7f25c80cef70 2024-09-21T07:11:34.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.076+0000 7f25cd63f640 1 -- 172.21.15.18:0/3002731278 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c815cd50 con 0x7f25c80cef70 2024-09-21T07:11:34.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.077+0000 7f25af7fe640 1 -- 172.21.15.18:0/3002731278 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f25b8005400 con 0x7f25c80cef70 2024-09-21T07:11:34.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.077+0000 7f25af7fe640 1 --2- 172.21.15.18:0/3002731278 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f25b4078b90 0x7f25b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:34.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.077+0000 7f25af7fe640 1 -- 172.21.15.18:0/3002731278 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f25b80bbf80 con 0x7f25c80cef70 2024-09-21T07:11:34.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.077+0000 7f25c67fc640 1 --2- 172.21.15.18:0/3002731278 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f25b4078b90 0x7f25b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:34.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.078+0000 7f25c67fc640 1 --2- 172.21.15.18:0/3002731278 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f25b4078b90 0x7f25b407b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f25bc005fd0 tx=0x7f25bc005e20 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:34.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.082+0000 7f25af7fe640 1 -- 172.21.15.18:0/3002731278 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f25c815cd50 con 0x7f25c80cef70 2024-09-21T07:11:34.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.297+0000 7f25cd63f640 1 -- 172.21.15.18:0/3002731278 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "subvol_grp87960", "target": ["mon-mgr", ""]}) -- 0x7f25c806b490 con 0x7f25b4078b90 2024-09-21T07:11:34.305 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:11:34.303+0000 7efe4a513640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:34.305 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:11:34.303+0000 7efe4a513640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:34.305 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:11:34.303+0000 7efe4a513640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:34.305 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:11:34.303+0000 7efe4a513640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:34.305 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:11:34.303+0000 7efe4a513640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:34.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.319+0000 7f25af7fe640 1 -- 172.21.15.18:0/3002731278 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f25bc00b710 con 0x7f25b4078b90 2024-09-21T07:11:34.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.322+0000 7f25cd63f640 1 -- 172.21.15.18:0/3002731278 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f25b4078b90 msgr2=0x7f25b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:34.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.322+0000 7f25cd63f640 1 --2- 172.21.15.18:0/3002731278 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f25b4078b90 0x7f25b407b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f25bc005fd0 tx=0x7f25bc005e20 comp rx=0 tx=0).stop 2024-09-21T07:11:34.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.322+0000 7f25cd63f640 1 -- 172.21.15.18:0/3002731278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c80cef70 msgr2=0x7f25c8151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:34.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.322+0000 7f25cd63f640 1 --2- 172.21.15.18:0/3002731278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c80cef70 0x7f25c8151b80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009780 tx=0x7f25b8033c20 comp rx=0 tx=0).stop 2024-09-21T07:11:34.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.322+0000 7f25cd63f640 1 -- 172.21.15.18:0/3002731278 shutdown_connections 2024-09-21T07:11:34.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.322+0000 7f25cd63f640 1 --2- 172.21.15.18:0/3002731278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25c815ef50 0x7f25c80b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.322+0000 7f25cd63f640 1 --2- 172.21.15.18:0/3002731278 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f25b4078b90 0x7f25b407b0a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.322+0000 7f25cd63f640 1 --2- 172.21.15.18:0/3002731278 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f25c80d3580 0x7f25c80ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.322+0000 7f25cd63f640 1 --2- 172.21.15.18:0/3002731278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c80cef70 0x7f25c8151b80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.322+0000 7f25cd63f640 1 -- 172.21.15.18:0/3002731278 >> 172.21.15.18:0/3002731278 conn(0x7f25c8073f30 msgr2=0x7f25c815bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:34.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.322+0000 7f25cd63f640 1 -- 172.21.15.18:0/3002731278 shutdown_connections 2024-09-21T07:11:34.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.322+0000 7f25cd63f640 1 -- 172.21.15.18:0/3002731278 wait complete. 2024-09-21T07:11:34.335 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol33400 --group_name subvol_grp87960 2024-09-21T07:11:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.455+0000 7f0449641640 1 -- 172.21.15.18:0/1297868924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04440b67f0 msgr2=0x7f0444167740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.455+0000 7f0449641640 1 --2- 172.21.15.18:0/1297868924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04440b67f0 0x7f0444167740 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f043c005fd0 tx=0x7f043c02aaa0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.455+0000 7f0449641640 1 -- 172.21.15.18:0/1297868924 shutdown_connections 2024-09-21T07:11:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.455+0000 7f0449641640 1 --2- 172.21.15.18:0/1297868924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04440b67f0 0x7f0444167740 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.455+0000 7f0449641640 1 -- 172.21.15.18:0/1297868924 >> 172.21.15.18:0/1297868924 conn(0x7f04440b78b0 msgr2=0x7f04440b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.455+0000 7f0449641640 1 -- 172.21.15.18:0/1297868924 shutdown_connections 2024-09-21T07:11:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.455+0000 7f0449641640 1 -- 172.21.15.18:0/1297868924 wait complete. 2024-09-21T07:11:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.457+0000 7f0449641640 1 Processor -- start 2024-09-21T07:11:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.457+0000 7f0449641640 1 -- start start 2024-09-21T07:11:34.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.458+0000 7f0449641640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04440b4760 0x7f04441f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:34.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.458+0000 7f0449641640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f04440b67f0 0x7f04441f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:34.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.458+0000 7f0449641640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04441605e0 0x7f04441f7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:34.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.458+0000 7f0449641640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0444167e00 con 0x7f04440b4760 2024-09-21T07:11:34.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.458+0000 7f0449641640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0444167c80 con 0x7f04441605e0 2024-09-21T07:11:34.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.458+0000 7f0449641640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f0444167f80 con 0x7f04440b67f0 2024-09-21T07:11:34.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.458+0000 7f0442ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04440b4760 0x7f04441f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:34.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.458+0000 7f0442ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04440b4760 0x7f04441f3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60310/0 (socket says 172.21.15.18:60310) 2024-09-21T07:11:34.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.458+0000 7f0442ffd640 1 -- 172.21.15.18:0/470567631 learned_addr learned my addr 172.21.15.18:0/470567631 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:34.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.458+0000 7f04427fc640 1 --2- 172.21.15.18:0/470567631 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f04440b67f0 0x7f04441f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:34.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.458+0000 7f04437fe640 1 --2- 172.21.15.18:0/470567631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04441605e0 0x7f04441f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:34.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.458+0000 7f0442ffd640 1 -- 172.21.15.18:0/470567631 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f04440b67f0 msgr2=0x7f04441f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:34.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.458+0000 7f0442ffd640 1 --2- 172.21.15.18:0/470567631 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f04440b67f0 0x7f04441f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.458+0000 7f0442ffd640 1 -- 172.21.15.18:0/470567631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04441605e0 msgr2=0x7f04441f7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:34.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.458+0000 7f0442ffd640 1 --2- 172.21.15.18:0/470567631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04441605e0 0x7f04441f7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.459+0000 7f0442ffd640 1 -- 172.21.15.18:0/470567631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04441519c0 con 0x7f04440b4760 2024-09-21T07:11:34.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.459+0000 7f04437fe640 1 --2- 172.21.15.18:0/470567631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04441605e0 0x7f04441f7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:34.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.459+0000 7f0442ffd640 1 --2- 172.21.15.18:0/470567631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04440b4760 0x7f04441f3a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f043400c3a0 tx=0x7f043400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:34.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.459+0000 7f042b7fe640 1 -- 172.21.15.18:0/470567631 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434017070 con 0x7f04440b4760 2024-09-21T07:11:34.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.459+0000 7f042b7fe640 1 -- 172.21.15.18:0/470567631 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04340053c0 con 0x7f04440b4760 2024-09-21T07:11:34.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.459+0000 7f0449641640 1 -- 172.21.15.18:0/470567631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0444151ca0 con 0x7f04440b4760 2024-09-21T07:11:34.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.459+0000 7f042b7fe640 1 -- 172.21.15.18:0/470567631 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434003850 con 0x7f04440b4760 2024-09-21T07:11:34.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.459+0000 7f0449641640 1 -- 172.21.15.18:0/470567631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0444152260 con 0x7f04440b4760 2024-09-21T07:11:34.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.460+0000 7f0449641640 1 -- 172.21.15.18:0/470567631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0444153900 con 0x7f04440b4760 2024-09-21T07:11:34.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.461+0000 7f042b7fe640 1 -- 172.21.15.18:0/470567631 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f043401a070 con 0x7f04440b4760 2024-09-21T07:11:34.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.461+0000 7f042b7fe640 1 --2- 172.21.15.18:0/470567631 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0430078bc0 0x7f043007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:34.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.461+0000 7f042b7fe640 1 -- 172.21.15.18:0/470567631 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0434099f90 con 0x7f04440b4760 2024-09-21T07:11:34.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.462+0000 7f04427fc640 1 --2- 172.21.15.18:0/470567631 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0430078bc0 0x7f043007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:34.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.462+0000 7f04427fc640 1 --2- 172.21.15.18:0/470567631 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0430078bc0 0x7f043007b0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0444161da0 tx=0x7f0438009060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:34.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.466+0000 7f042b7fe640 1 -- 172.21.15.18:0/470567631 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0434061e20 con 0x7f04440b4760 2024-09-21T07:11:34.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.679+0000 7f0449641640 1 -- 172.21.15.18:0/470567631 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol33400", "group_name": "subvol_grp87960", "target": ["mon-mgr", ""]}) -- 0x7f04441f47b0 con 0x7f0430078bc0 2024-09-21T07:11:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.706+0000 7f042b7fe640 1 -- 172.21.15.18:0/470567631 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f04441f47b0 con 0x7f0430078bc0 2024-09-21T07:11:34.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.708+0000 7f0449641640 1 -- 172.21.15.18:0/470567631 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0430078bc0 msgr2=0x7f043007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:34.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.708+0000 7f0449641640 1 --2- 172.21.15.18:0/470567631 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0430078bc0 0x7f043007b0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0444161da0 tx=0x7f0438009060 comp rx=0 tx=0).stop 2024-09-21T07:11:34.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.708+0000 7f0449641640 1 -- 172.21.15.18:0/470567631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04440b4760 msgr2=0x7f04441f3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:34.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.708+0000 7f0449641640 1 --2- 172.21.15.18:0/470567631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04440b4760 0x7f04441f3a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f043400c3a0 tx=0x7f043400c860 comp rx=0 tx=0).stop 2024-09-21T07:11:34.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.708+0000 7f0449641640 1 -- 172.21.15.18:0/470567631 shutdown_connections 2024-09-21T07:11:34.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.708+0000 7f0449641640 1 --2- 172.21.15.18:0/470567631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04441605e0 0x7f04441f7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.708+0000 7f0449641640 1 --2- 172.21.15.18:0/470567631 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f0430078bc0 0x7f043007b0d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.708+0000 7f0449641640 1 --2- 172.21.15.18:0/470567631 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f04440b67f0 0x7f04441f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.708+0000 7f0449641640 1 --2- 172.21.15.18:0/470567631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04440b4760 0x7f04441f3a40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.708+0000 7f0449641640 1 -- 172.21.15.18:0/470567631 >> 172.21.15.18:0/470567631 conn(0x7f04440b78b0 msgr2=0x7f044415cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.708+0000 7f0449641640 1 -- 172.21.15.18:0/470567631 shutdown_connections 2024-09-21T07:11:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.708+0000 7f0449641640 1 -- 172.21.15.18:0/470567631 wait complete. 2024-09-21T07:11:34.722 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol29271 --group_name subvol_grp87960 2024-09-21T07:11:34.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.842+0000 7f999088b640 1 -- 172.21.15.18:0/3364728124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f998c0b4760 msgr2=0x7f998c153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:34.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.842+0000 7f999088b640 1 --2- 172.21.15.18:0/3364728124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f998c0b4760 0x7f998c153900 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f998c0b81a0 tx=0x7f997c02a560 comp rx=0 tx=0).stop 2024-09-21T07:11:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.842+0000 7f999088b640 1 -- 172.21.15.18:0/3364728124 shutdown_connections 2024-09-21T07:11:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.842+0000 7f999088b640 1 --2- 172.21.15.18:0/3364728124 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f998c15d9b0 0x7f998c1605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.842+0000 7f999088b640 1 --2- 172.21.15.18:0/3364728124 >> v2:172.21.15.49:3300/0 conn(0x7f998c15d060 0x7f998c15d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.842+0000 7f999088b640 1 --2- 172.21.15.18:0/3364728124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f998c0b4760 0x7f998c153900 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.842+0000 7f999088b640 1 -- 172.21.15.18:0/3364728124 >> 172.21.15.18:0/3364728124 conn(0x7f998c0b78b0 msgr2=0x7f998c0b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.842+0000 7f999088b640 1 -- 172.21.15.18:0/3364728124 shutdown_connections 2024-09-21T07:11:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.842+0000 7f999088b640 1 -- 172.21.15.18:0/3364728124 wait complete. 2024-09-21T07:11:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.844+0000 7f999088b640 1 Processor -- start 2024-09-21T07:11:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.844+0000 7f999088b640 1 -- start start 2024-09-21T07:11:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.845+0000 7f999088b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f998c0b4760 0x7f998c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.845+0000 7f999088b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f998c15d060 0x7f998c14fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.845+0000 7f999088b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f998c15d9b0 0x7f998c1f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.845+0000 7f999088b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f998c160ca0 con 0x7f998c15d060 2024-09-21T07:11:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.845+0000 7f999088b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f998c160b20 con 0x7f998c15d9b0 2024-09-21T07:11:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.845+0000 7f999088b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f998c160e20 con 0x7f998c0b4760 2024-09-21T07:11:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.845+0000 7f9989d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f998c15d060 0x7f998c14fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f9989d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f998c15d060 0x7f998c14fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60324/0 (socket says 172.21.15.18:60324) 2024-09-21T07:11:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f9989d9b640 1 -- 172.21.15.18:0/2028239167 learned_addr learned my addr 172.21.15.18:0/2028239167 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f998a59c640 1 --2- 172.21.15.18:0/2028239167 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f998c0b4760 0x7f998c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f998ad9d640 1 --2- 172.21.15.18:0/2028239167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f998c15d9b0 0x7f998c1f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f9989d9b640 1 -- 172.21.15.18:0/2028239167 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f998c0b4760 msgr2=0x7f998c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f9989d9b640 1 --2- 172.21.15.18:0/2028239167 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f998c0b4760 0x7f998c15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f9989d9b640 1 -- 172.21.15.18:0/2028239167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f998c15d9b0 msgr2=0x7f998c1f69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f9989d9b640 1 --2- 172.21.15.18:0/2028239167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f998c15d9b0 0x7f998c1f69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f9989d9b640 1 -- 172.21.15.18:0/2028239167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998c0718f0 con 0x7f998c15d060 2024-09-21T07:11:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f998a59c640 1 --2- 172.21.15.18:0/2028239167 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f998c0b4760 0x7f998c15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f9989d9b640 1 --2- 172.21.15.18:0/2028239167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f998c15d060 0x7f998c14fd10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f998000c940 tx=0x7f998000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f997affd640 1 -- 172.21.15.18:0/2028239167 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9980007bb0 con 0x7f998c15d060 2024-09-21T07:11:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f997affd640 1 -- 172.21.15.18:0/2028239167 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9980007e40 con 0x7f998c15d060 2024-09-21T07:11:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f999088b640 1 -- 172.21.15.18:0/2028239167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f998c071be0 con 0x7f998c15d060 2024-09-21T07:11:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f997affd640 1 -- 172.21.15.18:0/2028239167 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998000f690 con 0x7f998c15d060 2024-09-21T07:11:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.846+0000 7f999088b640 1 -- 172.21.15.18:0/2028239167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f998c0b1bb0 con 0x7f998c15d060 2024-09-21T07:11:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.847+0000 7f999088b640 1 -- 172.21.15.18:0/2028239167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f998c077190 con 0x7f998c15d060 2024-09-21T07:11:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.848+0000 7f997affd640 1 -- 172.21.15.18:0/2028239167 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f998000f830 con 0x7f998c15d060 2024-09-21T07:11:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.849+0000 7f997affd640 1 --2- 172.21.15.18:0/2028239167 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f996c078bc0 0x7f996c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:34.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.849+0000 7f997affd640 1 -- 172.21.15.18:0/2028239167 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f998009b440 con 0x7f998c15d060 2024-09-21T07:11:34.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.849+0000 7f998a59c640 1 --2- 172.21.15.18:0/2028239167 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f996c078bc0 0x7f996c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:34.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.850+0000 7f998a59c640 1 --2- 172.21.15.18:0/2028239167 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f996c078bc0 0x7f996c07b0d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f997c033000 tx=0x7f997c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:34.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:34.853+0000 7f997affd640 1 -- 172.21.15.18:0/2028239167 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f998c077190 con 0x7f998c15d060 2024-09-21T07:11:35.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.069+0000 7f999088b640 1 -- 172.21.15.18:0/2028239167 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol29271", "group_name": "subvol_grp87960", "target": ["mon-mgr", ""]}) -- 0x7f998c161340 con 0x7f996c078bc0 2024-09-21T07:11:35.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.096+0000 7f997affd640 1 -- 172.21.15.18:0/2028239167 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f998c161340 con 0x7f996c078bc0 2024-09-21T07:11:35.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.099+0000 7f999088b640 1 -- 172.21.15.18:0/2028239167 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f996c078bc0 msgr2=0x7f996c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.099+0000 7f999088b640 1 --2- 172.21.15.18:0/2028239167 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f996c078bc0 0x7f996c07b0d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f997c033000 tx=0x7f997c004730 comp rx=0 tx=0).stop 2024-09-21T07:11:35.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.099+0000 7f999088b640 1 -- 172.21.15.18:0/2028239167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f998c15d060 msgr2=0x7f998c14fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.099+0000 7f999088b640 1 --2- 172.21.15.18:0/2028239167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f998c15d060 0x7f998c14fd10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f998000c940 tx=0x7f998000ce00 comp rx=0 tx=0).stop 2024-09-21T07:11:35.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.099+0000 7f999088b640 1 -- 172.21.15.18:0/2028239167 shutdown_connections 2024-09-21T07:11:35.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.099+0000 7f999088b640 1 --2- 172.21.15.18:0/2028239167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f998c15d9b0 0x7f998c1f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.099+0000 7f999088b640 1 --2- 172.21.15.18:0/2028239167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f998c15d060 0x7f998c14fd10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.099+0000 7f999088b640 1 --2- 172.21.15.18:0/2028239167 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f996c078bc0 0x7f996c07b0d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.099+0000 7f999088b640 1 --2- 172.21.15.18:0/2028239167 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f998c0b4760 0x7f998c15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.099+0000 7f999088b640 1 -- 172.21.15.18:0/2028239167 >> 172.21.15.18:0/2028239167 conn(0x7f998c0b78b0 msgr2=0x7f998c0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:35.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.099+0000 7f999088b640 1 -- 172.21.15.18:0/2028239167 shutdown_connections 2024-09-21T07:11:35.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.099+0000 7f999088b640 1 -- 172.21.15.18:0/2028239167 wait complete. 2024-09-21T07:11:35.112 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol67402 --group_name subvol_grp87960 2024-09-21T07:11:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.232+0000 7f1f94b50640 1 -- 172.21.15.18:0/1511638044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f9015ef50 msgr2=0x7f1f9015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.232+0000 7f1f94b50640 1 --2- 172.21.15.18:0/1511638044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f9015ef50 0x7f1f9015c520 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1f80005fd0 tx=0x7f1f8002a940 comp rx=0 tx=0).stop 2024-09-21T07:11:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.232+0000 7f1f94b50640 1 -- 172.21.15.18:0/1511638044 shutdown_connections 2024-09-21T07:11:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.232+0000 7f1f94b50640 1 --2- 172.21.15.18:0/1511638044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f9015ef50 0x7f1f9015c520 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.232+0000 7f1f94b50640 1 -- 172.21.15.18:0/1511638044 >> 172.21.15.18:0/1511638044 conn(0x7f1f90073f30 msgr2=0x7f1f900b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.232+0000 7f1f94b50640 1 -- 172.21.15.18:0/1511638044 shutdown_connections 2024-09-21T07:11:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.232+0000 7f1f94b50640 1 -- 172.21.15.18:0/1511638044 wait complete. 2024-09-21T07:11:35.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.234+0000 7f1f94b50640 1 Processor -- start 2024-09-21T07:11:35.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.234+0000 7f1f94b50640 1 -- start start 2024-09-21T07:11:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f94b50640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1f900cef70 0x7f1f901518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f94b50640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f9015ef50 0x7f1f900b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f94b50640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f90162a40 0x7f1f900abf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f94b50640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1f900d13b0 con 0x7f1f9015ef50 2024-09-21T07:11:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f94b50640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1f900d1230 con 0x7f1f90162a40 2024-09-21T07:11:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f94b50640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f1f900d1530 con 0x7f1f900cef70 2024-09-21T07:11:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f8dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f9015ef50 0x7f1f900b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f8dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f9015ef50 0x7f1f900b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60342/0 (socket says 172.21.15.18:60342) 2024-09-21T07:11:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f8dd9b640 1 -- 172.21.15.18:0/2017871084 learned_addr learned my addr 172.21.15.18:0/2017871084 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f8ed9d640 1 --2- 172.21.15.18:0/2017871084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f90162a40 0x7f1f900abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f8e59c640 1 --2- 172.21.15.18:0/2017871084 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1f900cef70 0x7f1f901518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f8dd9b640 1 -- 172.21.15.18:0/2017871084 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1f900cef70 msgr2=0x7f1f901518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f8dd9b640 1 --2- 172.21.15.18:0/2017871084 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1f900cef70 0x7f1f901518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f8dd9b640 1 -- 172.21.15.18:0/2017871084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f90162a40 msgr2=0x7f1f900abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f8dd9b640 1 --2- 172.21.15.18:0/2017871084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f90162a40 0x7f1f900abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f8dd9b640 1 -- 172.21.15.18:0/2017871084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f900b5f50 con 0x7f1f9015ef50 2024-09-21T07:11:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f8dd9b640 1 --2- 172.21.15.18:0/2017871084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f9015ef50 0x7f1f900b5600 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400c390 tx=0x7f1f8400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f7effd640 1 -- 172.21.15.18:0/2017871084 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84017070 con 0x7f1f9015ef50 2024-09-21T07:11:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f7effd640 1 -- 172.21.15.18:0/2017871084 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f840053c0 con 0x7f1f9015ef50 2024-09-21T07:11:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f94b50640 1 -- 172.21.15.18:0/2017871084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f900cb860 con 0x7f1f9015ef50 2024-09-21T07:11:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.236+0000 7f1f7effd640 1 -- 172.21.15.18:0/2017871084 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84003880 con 0x7f1f9015ef50 2024-09-21T07:11:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.237+0000 7f1f94b50640 1 -- 172.21.15.18:0/2017871084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f900cbe20 con 0x7f1f9015ef50 2024-09-21T07:11:35.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.238+0000 7f1f94b50640 1 -- 172.21.15.18:0/2017871084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f900d19e0 con 0x7f1f9015ef50 2024-09-21T07:11:35.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.239+0000 7f1f7effd640 1 -- 172.21.15.18:0/2017871084 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1f8401a070 con 0x7f1f9015ef50 2024-09-21T07:11:35.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.239+0000 7f1f7effd640 1 --2- 172.21.15.18:0/2017871084 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1f70078b90 0x7f1f7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:35.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.239+0000 7f1f7effd640 1 -- 172.21.15.18:0/2017871084 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f1f8409a0b0 con 0x7f1f9015ef50 2024-09-21T07:11:35.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.239+0000 7f1f8e59c640 1 --2- 172.21.15.18:0/2017871084 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1f70078b90 0x7f1f7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:35.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.240+0000 7f1f8e59c640 1 --2- 172.21.15.18:0/2017871084 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1f70078b90 0x7f1f7007b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1f80034000 tx=0x7f1f80004ab0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:35.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.244+0000 7f1f7effd640 1 -- 172.21.15.18:0/2017871084 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1f84062580 con 0x7f1f9015ef50 2024-09-21T07:11:35.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.254+0000 7f1f7effd640 1 -- 172.21.15.18:0/2017871084 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 6) ==== 101492+0+0 (secure 0 0 0) 0x7f1f8405e0f0 con 0x7f1f9015ef50 2024-09-21T07:11:35.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.463+0000 7f1f94b50640 1 -- 172.21.15.18:0/2017871084 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol67402", "group_name": "subvol_grp87960", "target": ["mon-mgr", ""]}) -- 0x7f1f9006b490 con 0x7f1f70078b90 2024-09-21T07:11:35.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.491+0000 7f1f7effd640 1 -- 172.21.15.18:0/2017871084 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1f80003c90 con 0x7f1f70078b90 2024-09-21T07:11:35.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.494+0000 7f1f94b50640 1 -- 172.21.15.18:0/2017871084 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1f70078b90 msgr2=0x7f1f7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.494+0000 7f1f94b50640 1 --2- 172.21.15.18:0/2017871084 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1f70078b90 0x7f1f7007b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1f80034000 tx=0x7f1f80004ab0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.494+0000 7f1f94b50640 1 -- 172.21.15.18:0/2017871084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f9015ef50 msgr2=0x7f1f900b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.494+0000 7f1f94b50640 1 --2- 172.21.15.18:0/2017871084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f9015ef50 0x7f1f900b5600 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400c390 tx=0x7f1f8400c850 comp rx=0 tx=0).stop 2024-09-21T07:11:35.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.494+0000 7f1f94b50640 1 -- 172.21.15.18:0/2017871084 shutdown_connections 2024-09-21T07:11:35.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.494+0000 7f1f94b50640 1 --2- 172.21.15.18:0/2017871084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f90162a40 0x7f1f900abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.494+0000 7f1f94b50640 1 --2- 172.21.15.18:0/2017871084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f9015ef50 0x7f1f900b5600 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.494+0000 7f1f94b50640 1 --2- 172.21.15.18:0/2017871084 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1f70078b90 0x7f1f7007b0a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.494+0000 7f1f94b50640 1 --2- 172.21.15.18:0/2017871084 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1f900cef70 0x7f1f901518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.494+0000 7f1f94b50640 1 -- 172.21.15.18:0/2017871084 >> 172.21.15.18:0/2017871084 conn(0x7f1f90073f30 msgr2=0x7f1f9015cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:35.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.494+0000 7f1f94b50640 1 -- 172.21.15.18:0/2017871084 shutdown_connections 2024-09-21T07:11:35.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.494+0000 7f1f94b50640 1 -- 172.21.15.18:0/2017871084 wait complete. 2024-09-21T07:11:35.508 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol33400 subvol_grp87960 2024-09-21T07:11:35.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.627+0000 7fdc1b6de640 1 -- 172.21.15.18:0/2557729680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdbfc004800 msgr2=0x7fdbfc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.627+0000 7fdc1b6de640 1 --2- 172.21.15.18:0/2557729680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdbfc004800 0x7fdbfc004c10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800c310 tx=0x7fdbfc005830 comp rx=0 tx=0).stop 2024-09-21T07:11:35.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.627+0000 7fdc19c7b640 1 -- 172.21.15.18:0/2557729680 reap_dead start 2024-09-21T07:11:35.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.627+0000 7fdc1b6de640 1 -- 172.21.15.18:0/2557729680 shutdown_connections 2024-09-21T07:11:35.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.627+0000 7fdc1b6de640 1 -- 172.21.15.18:0/2557729680 >> 172.21.15.18:0/2557729680 conn(0x7fdc14073340 msgr2=0x7fdc14073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:35.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.627+0000 7fdc1b6de640 1 -- 172.21.15.18:0/2557729680 shutdown_connections 2024-09-21T07:11:35.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.627+0000 7fdc1b6de640 1 -- 172.21.15.18:0/2557729680 wait complete. 2024-09-21T07:11:35.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.629+0000 7fdc1b6de640 1 Processor -- start 2024-09-21T07:11:35.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.629+0000 7fdc1b6de640 1 -- start start 2024-09-21T07:11:35.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.630+0000 7fdc1b6de640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbfc004800 0x7fdc140ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:35.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.630+0000 7fdc1b6de640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc140cce80 0x7fdc14140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:35.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.630+0000 7fdc1b6de640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdc14141010 0x7fdc141f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:35.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.630+0000 7fdc1b6de640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1415d330 con 0x7fdc140cce80 2024-09-21T07:11:35.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.630+0000 7fdc1b6de640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1415d1b0 con 0x7fdbfc004800 2024-09-21T07:11:35.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.630+0000 7fdc1b6de640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fdc1415d4b0 con 0x7fdc14141010 2024-09-21T07:11:35.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.630+0000 7fdc18c79640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc140cce80 0x7fdc14140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:35.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.630+0000 7fdc18c79640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc140cce80 0x7fdc14140ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60360/0 (socket says 172.21.15.18:60360) 2024-09-21T07:11:35.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.630+0000 7fdc18c79640 1 -- 172.21.15.18:0/929835920 learned_addr learned my addr 172.21.15.18:0/929835920 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:35.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.630+0000 7fdc1947a640 1 --2- 172.21.15.18:0/929835920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbfc004800 0x7fdc140ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:35.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.630+0000 7fdc19c7b640 1 --2- 172.21.15.18:0/929835920 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdc14141010 0x7fdc141f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:35.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.631+0000 7fdc18c79640 1 -- 172.21.15.18:0/929835920 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdc14141010 msgr2=0x7fdc141f2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.631+0000 7fdc18c79640 1 --2- 172.21.15.18:0/929835920 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdc14141010 0x7fdc141f2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.631+0000 7fdc18c79640 1 -- 172.21.15.18:0/929835920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbfc004800 msgr2=0x7fdc140ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.631+0000 7fdc18c79640 1 --2- 172.21.15.18:0/929835920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbfc004800 0x7fdc140ab9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.631+0000 7fdc18c79640 1 -- 172.21.15.18:0/929835920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc140aa910 con 0x7fdc140cce80 2024-09-21T07:11:35.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.631+0000 7fdc18c79640 1 --2- 172.21.15.18:0/929835920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc140cce80 0x7fdc14140ad0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdc08000f60 tx=0x7fdc08001d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:35.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.631+0000 7fdc11ffb640 1 -- 172.21.15.18:0/929835920 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc08031040 con 0x7fdc140cce80 2024-09-21T07:11:35.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.631+0000 7fdc11ffb640 1 -- 172.21.15.18:0/929835920 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc080035f0 con 0x7fdc140cce80 2024-09-21T07:11:35.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.631+0000 7fdc1b6de640 1 -- 172.21.15.18:0/929835920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc140aabf0 con 0x7fdc140cce80 2024-09-21T07:11:35.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.631+0000 7fdc11ffb640 1 -- 172.21.15.18:0/929835920 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc080039e0 con 0x7fdc140cce80 2024-09-21T07:11:35.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.631+0000 7fdc1b6de640 1 -- 172.21.15.18:0/929835920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc140ab1b0 con 0x7fdc140cce80 2024-09-21T07:11:35.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.632+0000 7fdc1b6de640 1 -- 172.21.15.18:0/929835920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc140aa680 con 0x7fdc140cce80 2024-09-21T07:11:35.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.633+0000 7fdc11ffb640 1 -- 172.21.15.18:0/929835920 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 6) ==== 101492+0+0 (secure 0 0 0) 0x7fdc08034070 con 0x7fdc140cce80 2024-09-21T07:11:35.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.634+0000 7fdc11ffb640 1 --2- 172.21.15.18:0/929835920 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fdc00078c20 0x7fdc0007b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:35.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.634+0000 7fdc11ffb640 1 -- 172.21.15.18:0/929835920 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fdc080baf40 con 0x7fdc140cce80 2024-09-21T07:11:35.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.634+0000 7fdc1947a640 1 --2- 172.21.15.18:0/929835920 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fdc00078c20 0x7fdc0007b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:35.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.635+0000 7fdc1947a640 1 --2- 172.21.15.18:0/929835920 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fdc00078c20 0x7fdc0007b130 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c000c00 tx=0x7fdc0c006dc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:35.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.639+0000 7fdc11ffb640 1 -- 172.21.15.18:0/929835920 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdc08082b30 con 0x7fdc140cce80 2024-09-21T07:11:35.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.855+0000 7fdc1b6de640 1 -- 172.21.15.18:0/929835920 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol33400", "group_name": "subvol_grp87960", "target": ["mon-mgr", ""]}) -- 0x7fdc140abef0 con 0x7fdc00078c20 2024-09-21T07:11:35.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.869+0000 7fdc11ffb640 1 -- 172.21.15.18:0/929835920 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdc0c016070 con 0x7fdc00078c20 2024-09-21T07:11:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.871+0000 7fdc1b6de640 1 -- 172.21.15.18:0/929835920 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fdc00078c20 msgr2=0x7fdc0007b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.871+0000 7fdc1b6de640 1 --2- 172.21.15.18:0/929835920 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fdc00078c20 0x7fdc0007b130 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c000c00 tx=0x7fdc0c006dc0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.871+0000 7fdc1b6de640 1 -- 172.21.15.18:0/929835920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc140cce80 msgr2=0x7fdc14140ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.871+0000 7fdc1b6de640 1 --2- 172.21.15.18:0/929835920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc140cce80 0x7fdc14140ad0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdc08000f60 tx=0x7fdc08001d90 comp rx=0 tx=0).stop 2024-09-21T07:11:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.871+0000 7fdc1b6de640 1 -- 172.21.15.18:0/929835920 shutdown_connections 2024-09-21T07:11:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.871+0000 7fdc1b6de640 1 --2- 172.21.15.18:0/929835920 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fdc00078c20 0x7fdc0007b130 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.871+0000 7fdc1b6de640 1 --2- 172.21.15.18:0/929835920 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fdc14141010 0x7fdc141f2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.871+0000 7fdc1b6de640 1 --2- 172.21.15.18:0/929835920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc140cce80 0x7fdc14140ad0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.871+0000 7fdc1b6de640 1 --2- 172.21.15.18:0/929835920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbfc004800 0x7fdc140ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:35.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.871+0000 7fdc1b6de640 1 -- 172.21.15.18:0/929835920 >> 172.21.15.18:0/929835920 conn(0x7fdc14073340 msgr2=0x7fdc14152df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:35.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.871+0000 7fdc1b6de640 1 -- 172.21.15.18:0/929835920 shutdown_connections 2024-09-21T07:11:35.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:35.871+0000 7fdc1b6de640 1 -- 172.21.15.18:0/929835920 wait complete. 2024-09-21T07:11:35.874 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:11:35.872+0000 7efe4d519640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:35.874 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:11:35.872+0000 7efe4d519640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:35.874 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:11:35.872+0000 7efe4d519640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:35.874 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:11:35.872+0000 7efe4d519640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:35.875 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:11:35.872+0000 7efe4d519640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:35.884 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol29271 subvol_grp87960 2024-09-21T07:11:35.890 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:11:35.889+0000 7efe4bd16640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:35.891 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:11:35.889+0000 7efe4bd16640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:35.891 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:11:35.889+0000 7efe4bd16640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:35.891 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:11:35.889+0000 7efe4bd16640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:35.891 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-09-21T07:11:35.889+0000 7efe4bd16640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:11:36.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.003+0000 7f6649f20640 1 -- 172.21.15.18:0/2406791764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662c004800 msgr2=0x7f662c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:36.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.003+0000 7f6649f20640 1 --2- 172.21.15.18:0/2406791764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662c004800 0x7f662c004c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f66440b3fa0 tx=0x7f662c005830 comp rx=0 tx=0).stop 2024-09-21T07:11:36.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.003+0000 7f6643fff640 1 -- 172.21.15.18:0/2406791764 reap_dead start 2024-09-21T07:11:36.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.003+0000 7f6649f20640 1 -- 172.21.15.18:0/2406791764 shutdown_connections 2024-09-21T07:11:36.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.003+0000 7f6649f20640 1 -- 172.21.15.18:0/2406791764 >> 172.21.15.18:0/2406791764 conn(0x7f6644073f30 msgr2=0x7f66440b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:36.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.003+0000 7f6649f20640 1 -- 172.21.15.18:0/2406791764 shutdown_connections 2024-09-21T07:11:36.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.003+0000 7f6649f20640 1 -- 172.21.15.18:0/2406791764 wait complete. 2024-09-21T07:11:36.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.005+0000 7f6649f20640 1 Processor -- start 2024-09-21T07:11:36.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.005+0000 7f6649f20640 1 -- start start 2024-09-21T07:11:36.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f6649f20640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662c004800 0x7f66440b9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:36.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f6649f20640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f66440b2910 0x7f664414a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:36.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f6649f20640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f664414ad40 0x7f66441f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:36.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f6649f20640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f664415c6a0 con 0x7f662c004800 2024-09-21T07:11:36.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f6649f20640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f664415c520 con 0x7f664414ad40 2024-09-21T07:11:36.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f6649f20640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f664415c820 con 0x7f66440b2910 2024-09-21T07:11:36.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f66437fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662c004800 0x7f66440b9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:36.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f66437fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662c004800 0x7f66440b9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60374/0 (socket says 172.21.15.18:60374) 2024-09-21T07:11:36.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f66437fe640 1 -- 172.21.15.18:0/1535660972 learned_addr learned my addr 172.21.15.18:0/1535660972 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:36.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f6643fff640 1 --2- 172.21.15.18:0/1535660972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f664414ad40 0x7f66441f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:36.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f6642ffd640 1 --2- 172.21.15.18:0/1535660972 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f66440b2910 0x7f664414a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:36.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f66437fe640 1 -- 172.21.15.18:0/1535660972 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f66440b2910 msgr2=0x7f664414a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:36.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f66437fe640 1 --2- 172.21.15.18:0/1535660972 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f66440b2910 0x7f664414a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f66437fe640 1 -- 172.21.15.18:0/1535660972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f664414ad40 msgr2=0x7f66441f42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:36.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f66437fe640 1 --2- 172.21.15.18:0/1535660972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f664414ad40 0x7f66441f42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f66437fe640 1 -- 172.21.15.18:0/1535660972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66440b7f70 con 0x7f662c004800 2024-09-21T07:11:36.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f6643fff640 1 --2- 172.21.15.18:0/1535660972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f664414ad40 0x7f66441f42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:36.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f66437fe640 1 --2- 172.21.15.18:0/1535660972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662c004800 0x7f66440b9010 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6634011ab0 tx=0x7f6634011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:36.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.007+0000 7f662bfff640 1 -- 172.21.15.18:0/1535660972 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663401e070 con 0x7f662c004800 2024-09-21T07:11:36.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.008+0000 7f662bfff640 1 -- 172.21.15.18:0/1535660972 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f663400fe70 con 0x7f662c004800 2024-09-21T07:11:36.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.008+0000 7f6649f20640 1 -- 172.21.15.18:0/1535660972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66440b8250 con 0x7f662c004800 2024-09-21T07:11:36.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.008+0000 7f662bfff640 1 -- 172.21.15.18:0/1535660972 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66340042b0 con 0x7f662c004800 2024-09-21T07:11:36.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.008+0000 7f6649f20640 1 -- 172.21.15.18:0/1535660972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66440b8810 con 0x7f662c004800 2024-09-21T07:11:36.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.009+0000 7f6649f20640 1 -- 172.21.15.18:0/1535660972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66440b3ab0 con 0x7f662c004800 2024-09-21T07:11:36.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.009+0000 7f662bfff640 1 -- 172.21.15.18:0/1535660972 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 6) ==== 101492+0+0 (secure 0 0 0) 0x7f6634021070 con 0x7f662c004800 2024-09-21T07:11:36.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.010+0000 7f662bfff640 1 --2- 172.21.15.18:0/1535660972 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6630078c20 0x7f663007b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:36.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.010+0000 7f662bfff640 1 -- 172.21.15.18:0/1535660972 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f663409b8d0 con 0x7f662c004800 2024-09-21T07:11:36.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.010+0000 7f6642ffd640 1 --2- 172.21.15.18:0/1535660972 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6630078c20 0x7f663007b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:36.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.011+0000 7f6642ffd640 1 --2- 172.21.15.18:0/1535660972 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6630078c20 0x7f663007b130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f66440b3fa0 tx=0x7f663802d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.014+0000 7f662bfff640 1 -- 172.21.15.18:0/1535660972 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6634063540 con 0x7f662c004800 2024-09-21T07:11:36.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.229+0000 7f6649f20640 1 -- 172.21.15.18:0/1535660972 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol29271", "group_name": "subvol_grp87960", "target": ["mon-mgr", ""]}) -- 0x7f664406b490 con 0x7f6630078c20 2024-09-21T07:11:36.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.256+0000 7f662bfff640 1 -- 172.21.15.18:0/1535660972 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f663802bb50 con 0x7f6630078c20 2024-09-21T07:11:36.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.258+0000 7f6649f20640 1 -- 172.21.15.18:0/1535660972 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6630078c20 msgr2=0x7f663007b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:36.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.258+0000 7f6649f20640 1 --2- 172.21.15.18:0/1535660972 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6630078c20 0x7f663007b130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f66440b3fa0 tx=0x7f663802d040 comp rx=0 tx=0).stop 2024-09-21T07:11:36.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.258+0000 7f6649f20640 1 -- 172.21.15.18:0/1535660972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662c004800 msgr2=0x7f66440b9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:36.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.258+0000 7f6649f20640 1 --2- 172.21.15.18:0/1535660972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662c004800 0x7f66440b9010 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6634011ab0 tx=0x7f6634011f70 comp rx=0 tx=0).stop 2024-09-21T07:11:36.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.258+0000 7f6649f20640 1 -- 172.21.15.18:0/1535660972 shutdown_connections 2024-09-21T07:11:36.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.258+0000 7f6649f20640 1 --2- 172.21.15.18:0/1535660972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f664414ad40 0x7f66441f42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.258+0000 7f6649f20640 1 --2- 172.21.15.18:0/1535660972 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f6630078c20 0x7f663007b130 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.258+0000 7f6649f20640 1 --2- 172.21.15.18:0/1535660972 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f66440b2910 0x7f664414a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.258+0000 7f6649f20640 1 --2- 172.21.15.18:0/1535660972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662c004800 0x7f66440b9010 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.258+0000 7f6649f20640 1 -- 172.21.15.18:0/1535660972 >> 172.21.15.18:0/1535660972 conn(0x7f6644073f30 msgr2=0x7f664415cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:36.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.258+0000 7f6649f20640 1 -- 172.21.15.18:0/1535660972 shutdown_connections 2024-09-21T07:11:36.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.258+0000 7f6649f20640 1 -- 172.21.15.18:0/1535660972 wait complete. 2024-09-21T07:11:36.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol67402 subvol_grp87960 2024-09-21T07:11:36.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.391+0000 7f59d33c3640 1 -- 172.21.15.18:0/555294655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59b8004d40 msgr2=0x7f59b8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:36.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.391+0000 7f59d33c3640 1 --2- 172.21.15.18:0/555294655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59b8004d40 0x7f59b8005150 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f59cc074380 tx=0x7f59b8005830 comp rx=0 tx=0).stop 2024-09-21T07:11:36.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.391+0000 7f59d1960640 1 -- 172.21.15.18:0/555294655 reap_dead start 2024-09-21T07:11:36.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.391+0000 7f59d33c3640 1 -- 172.21.15.18:0/555294655 shutdown_connections 2024-09-21T07:11:36.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.391+0000 7f59d33c3640 1 -- 172.21.15.18:0/555294655 >> 172.21.15.18:0/555294655 conn(0x7f59cc0b78b0 msgr2=0x7f59cc0b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:36.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.392+0000 7f59d33c3640 1 -- 172.21.15.18:0/555294655 shutdown_connections 2024-09-21T07:11:36.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.392+0000 7f59d33c3640 1 -- 172.21.15.18:0/555294655 wait complete. 2024-09-21T07:11:36.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.393+0000 7f59d33c3640 1 Processor -- start 2024-09-21T07:11:36.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.393+0000 7f59d33c3640 1 -- start start 2024-09-21T07:11:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d33c3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59b8004d40 0x7f59cc1508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d33c3640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f59cc14f170 0x7f59cc13c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d33c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59cc09fd90 0x7f59cc139680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d33c3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc0b5b70 con 0x7f59cc09fd90 2024-09-21T07:11:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d33c3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc0b59f0 con 0x7f59b8004d40 2024-09-21T07:11:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d33c3640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f59cc0b5cf0 con 0x7f59cc14f170 2024-09-21T07:11:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d1960640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59cc09fd90 0x7f59cc139680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d1960640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59cc09fd90 0x7f59cc139680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42860/0 (socket says 172.21.15.18:42860) 2024-09-21T07:11:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d1960640 1 -- 172.21.15.18:0/2466173664 learned_addr learned my addr 172.21.15.18:0/2466173664 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d115f640 1 --2- 172.21.15.18:0/2466173664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59b8004d40 0x7f59cc1508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d095e640 1 --2- 172.21.15.18:0/2466173664 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f59cc14f170 0x7f59cc13c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d1960640 1 -- 172.21.15.18:0/2466173664 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f59cc14f170 msgr2=0x7f59cc13c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d1960640 1 --2- 172.21.15.18:0/2466173664 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f59cc14f170 0x7f59cc13c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d1960640 1 -- 172.21.15.18:0/2466173664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59b8004d40 msgr2=0x7f59cc1508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:36.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d1960640 1 --2- 172.21.15.18:0/2466173664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59b8004d40 0x7f59cc1508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d1960640 1 -- 172.21.15.18:0/2466173664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc14f850 con 0x7f59cc09fd90 2024-09-21T07:11:36.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d115f640 1 --2- 172.21.15.18:0/2466173664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59b8004d40 0x7f59cc1508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:11:36.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.395+0000 7f59d1960640 1 --2- 172.21.15.18:0/2466173664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59cc09fd90 0x7f59cc139680 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009f90 tx=0x7f59c4033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:36.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.396+0000 7f59c1ffb640 1 -- 172.21.15.18:0/2466173664 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c4043070 con 0x7f59cc09fd90 2024-09-21T07:11:36.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.396+0000 7f59c1ffb640 1 -- 172.21.15.18:0/2466173664 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59c4033c90 con 0x7f59cc09fd90 2024-09-21T07:11:36.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.396+0000 7f59d33c3640 1 -- 172.21.15.18:0/2466173664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59cc14fb30 con 0x7f59cc09fd90 2024-09-21T07:11:36.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.396+0000 7f59c1ffb640 1 -- 172.21.15.18:0/2466173664 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c4038040 con 0x7f59cc09fd90 2024-09-21T07:11:36.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.396+0000 7f59d33c3640 1 -- 172.21.15.18:0/2466173664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59cc1500f0 con 0x7f59cc09fd90 2024-09-21T07:11:36.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.397+0000 7f59d33c3640 1 -- 172.21.15.18:0/2466173664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59cc153900 con 0x7f59cc09fd90 2024-09-21T07:11:36.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.398+0000 7f59c1ffb640 1 -- 172.21.15.18:0/2466173664 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 6) ==== 101492+0+0 (secure 0 0 0) 0x7f59c4003bd0 con 0x7f59cc09fd90 2024-09-21T07:11:36.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.398+0000 7f59c1ffb640 1 --2- 172.21.15.18:0/2466173664 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f59b0078c50 0x7f59b007b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:36.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.398+0000 7f59c1ffb640 1 -- 172.21.15.18:0/2466173664 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f59c40baef0 con 0x7f59cc09fd90 2024-09-21T07:11:36.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.398+0000 7f59d115f640 1 --2- 172.21.15.18:0/2466173664 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f59b0078c50 0x7f59b007b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:36.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.399+0000 7f59d115f640 1 --2- 172.21.15.18:0/2466173664 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f59b0078c50 0x7f59b007b160 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f59c8012510 tx=0x7f59c8005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:36.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.403+0000 7f59c1ffb640 1 -- 172.21.15.18:0/2466173664 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f59c4082be0 con 0x7f59cc09fd90 2024-09-21T07:11:36.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.618+0000 7f59d33c3640 1 -- 172.21.15.18:0/2466173664 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol67402", "group_name": "subvol_grp87960", "target": ["mon-mgr", ""]}) -- 0x7f59cc06b490 con 0x7f59b0078c50 2024-09-21T07:11:36.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.636+0000 7f59c1ffb640 1 -- 172.21.15.18:0/2466173664 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f59c8005020 con 0x7f59b0078c50 2024-09-21T07:11:36.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.638+0000 7f59d33c3640 1 -- 172.21.15.18:0/2466173664 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f59b0078c50 msgr2=0x7f59b007b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:36.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.638+0000 7f59d33c3640 1 --2- 172.21.15.18:0/2466173664 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f59b0078c50 0x7f59b007b160 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f59c8012510 tx=0x7f59c8005f90 comp rx=0 tx=0).stop 2024-09-21T07:11:36.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.638+0000 7f59d33c3640 1 -- 172.21.15.18:0/2466173664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59cc09fd90 msgr2=0x7f59cc139680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:36.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.638+0000 7f59d33c3640 1 --2- 172.21.15.18:0/2466173664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59cc09fd90 0x7f59cc139680 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009f90 tx=0x7f59c4033ba0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.638+0000 7f59d33c3640 1 -- 172.21.15.18:0/2466173664 shutdown_connections 2024-09-21T07:11:36.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.638+0000 7f59d33c3640 1 --2- 172.21.15.18:0/2466173664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59cc09fd90 0x7f59cc139680 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.638+0000 7f59d33c3640 1 --2- 172.21.15.18:0/2466173664 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f59b0078c50 0x7f59b007b160 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.638+0000 7f59d33c3640 1 --2- 172.21.15.18:0/2466173664 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f59cc14f170 0x7f59cc13c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.638+0000 7f59d33c3640 1 --2- 172.21.15.18:0/2466173664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59b8004d40 0x7f59cc1508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.638+0000 7f59d33c3640 1 -- 172.21.15.18:0/2466173664 >> 172.21.15.18:0/2466173664 conn(0x7f59cc0b78b0 msgr2=0x7f59cc152c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:36.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.638+0000 7f59d33c3640 1 -- 172.21.15.18:0/2466173664 shutdown_connections 2024-09-21T07:11:36.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.638+0000 7f59d33c3640 1 -- 172.21.15.18:0/2466173664 wait complete. 2024-09-21T07:11:36.652 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp87960 2024-09-21T07:11:36.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.771+0000 7f64126f9640 1 -- 172.21.15.18:0/1388520946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63f4004800 msgr2=0x7f63f4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:36.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.771+0000 7f64126f9640 1 --2- 172.21.15.18:0/1388520946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63f4004800 0x7f63f4004c10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6400001710 tx=0x7f63f4005830 comp rx=0 tx=0).stop 2024-09-21T07:11:36.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.771+0000 7f64126f9640 1 -- 172.21.15.18:0/1388520946 shutdown_connections 2024-09-21T07:11:36.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.771+0000 7f64126f9640 1 --2- 172.21.15.18:0/1388520946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63f4004800 0x7f63f4004c10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.771+0000 7f64126f9640 1 -- 172.21.15.18:0/1388520946 >> 172.21.15.18:0/1388520946 conn(0x7f640c073f30 msgr2=0x7f640c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:36.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.771+0000 7f64126f9640 1 -- 172.21.15.18:0/1388520946 shutdown_connections 2024-09-21T07:11:36.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.771+0000 7f64126f9640 1 -- 172.21.15.18:0/1388520946 wait complete. 2024-09-21T07:11:36.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.773+0000 7f64126f9640 1 Processor -- start 2024-09-21T07:11:36.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.773+0000 7f64126f9640 1 -- start start 2024-09-21T07:11:36.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f64126f9640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f63f4004800 0x7f640c1543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:36.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f64126f9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f640c0b3950 0x7f640c151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f64126f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f640c15a3c0 0x7f640c15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f64126f9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f640c15c960 con 0x7f640c0b3950 2024-09-21T07:11:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f64126f9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f640c15c7e0 con 0x7f640c15a3c0 2024-09-21T07:11:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f64126f9640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f640c162e50 con 0x7f63f4004800 2024-09-21T07:11:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f640b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f640c0b3950 0x7f640c151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f640b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f640c0b3950 0x7f640c151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42878/0 (socket says 172.21.15.18:42878) 2024-09-21T07:11:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f640b7fe640 1 -- 172.21.15.18:0/1069110212 learned_addr learned my addr 172.21.15.18:0/1069110212 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f6410c96640 1 --2- 172.21.15.18:0/1069110212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f640c15a3c0 0x7f640c15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f640bfff640 1 --2- 172.21.15.18:0/1069110212 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f63f4004800 0x7f640c1543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f640b7fe640 1 -- 172.21.15.18:0/1069110212 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f63f4004800 msgr2=0x7f640c1543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f640b7fe640 1 --2- 172.21.15.18:0/1069110212 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f63f4004800 0x7f640c1543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f640b7fe640 1 -- 172.21.15.18:0/1069110212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f640c15a3c0 msgr2=0x7f640c15a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f640b7fe640 1 --2- 172.21.15.18:0/1069110212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f640c15a3c0 0x7f640c15a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f640b7fe640 1 -- 172.21.15.18:0/1069110212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640c15ad10 con 0x7f640c0b3950 2024-09-21T07:11:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f6410c96640 1 --2- 172.21.15.18:0/1069110212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f640c15a3c0 0x7f640c15a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.775+0000 7f640b7fe640 1 --2- 172.21.15.18:0/1069110212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f640c0b3950 0x7f640c151b80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f640002a8e0 tx=0x7f64000062f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.776+0000 7f6408ff9640 1 -- 172.21.15.18:0/1069110212 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400003840 con 0x7f640c0b3950 2024-09-21T07:11:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.776+0000 7f6408ff9640 1 -- 172.21.15.18:0/1069110212 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6400039070 con 0x7f640c0b3950 2024-09-21T07:11:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.776+0000 7f64126f9640 1 -- 172.21.15.18:0/1069110212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f640c0b8a80 con 0x7f640c0b3950 2024-09-21T07:11:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.776+0000 7f6408ff9640 1 -- 172.21.15.18:0/1069110212 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400003d70 con 0x7f640c0b3950 2024-09-21T07:11:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.776+0000 7f64126f9640 1 -- 172.21.15.18:0/1069110212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f640c0b7fa0 con 0x7f640c0b3950 2024-09-21T07:11:36.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.777+0000 7f64126f9640 1 -- 172.21.15.18:0/1069110212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f640c163320 con 0x7f640c0b3950 2024-09-21T07:11:36.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.777+0000 7f6408ff9640 1 -- 172.21.15.18:0/1069110212 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 6) ==== 101492+0+0 (secure 0 0 0) 0x7f6400044020 con 0x7f640c0b3950 2024-09-21T07:11:36.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.778+0000 7f6408ff9640 1 --2- 172.21.15.18:0/1069110212 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f63f8078c20 0x7f63f807b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:36.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.778+0000 7f6408ff9640 1 -- 172.21.15.18:0/1069110212 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f64000ba780 con 0x7f640c0b3950 2024-09-21T07:11:36.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.778+0000 7f640bfff640 1 --2- 172.21.15.18:0/1069110212 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f63f8078c20 0x7f63f807b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:36.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.779+0000 7f640bfff640 1 --2- 172.21.15.18:0/1069110212 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f63f8078c20 0x7f63f807b130 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f63fc009c10 tx=0x7f63fc005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:36.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.782+0000 7f6408ff9640 1 -- 172.21.15.18:0/1069110212 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f640c15ad10 con 0x7f640c0b3950 2024-09-21T07:11:36.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:36.994+0000 7f64126f9640 1 -- 172.21.15.18:0/1069110212 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp87960", "target": ["mon-mgr", ""]}) -- 0x7f640c06b490 con 0x7f63f8078c20 2024-09-21T07:11:37.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.000+0000 7f6408ff9640 1 -- 172.21.15.18:0/1069110212 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f63fc009860 con 0x7f63f8078c20 2024-09-21T07:11:37.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.003+0000 7f64126f9640 1 -- 172.21.15.18:0/1069110212 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f63f8078c20 msgr2=0x7f63f807b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:37.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.003+0000 7f64126f9640 1 --2- 172.21.15.18:0/1069110212 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f63f8078c20 0x7f63f807b130 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f63fc009c10 tx=0x7f63fc005f90 comp rx=0 tx=0).stop 2024-09-21T07:11:37.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.003+0000 7f64126f9640 1 -- 172.21.15.18:0/1069110212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f640c0b3950 msgr2=0x7f640c151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:37.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.003+0000 7f64126f9640 1 --2- 172.21.15.18:0/1069110212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f640c0b3950 0x7f640c151b80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f640002a8e0 tx=0x7f64000062f0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.003+0000 7f64126f9640 1 -- 172.21.15.18:0/1069110212 shutdown_connections 2024-09-21T07:11:37.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.003+0000 7f64126f9640 1 --2- 172.21.15.18:0/1069110212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f640c15a3c0 0x7f640c15a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.003+0000 7f64126f9640 1 --2- 172.21.15.18:0/1069110212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f640c0b3950 0x7f640c151b80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.003+0000 7f64126f9640 1 --2- 172.21.15.18:0/1069110212 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f63f8078c20 0x7f63f807b130 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.003+0000 7f64126f9640 1 --2- 172.21.15.18:0/1069110212 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f63f4004800 0x7f640c1543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.003+0000 7f64126f9640 1 -- 172.21.15.18:0/1069110212 >> 172.21.15.18:0/1069110212 conn(0x7f640c073f30 msgr2=0x7f640c15df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:37.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.003+0000 7f64126f9640 1 -- 172.21.15.18:0/1069110212 shutdown_connections 2024-09-21T07:11:37.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.003+0000 7f64126f9640 1 -- 172.21.15.18:0/1069110212 wait complete. 2024-09-21T07:11:37.017 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-21T07:11:37.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:11:37.073 INFO:teuthology.orchestra.run.smithi018.stdout:2 2024-09-21T07:11:37.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:11:37.080 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:11:37.080 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:11:37.126 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:11:37.173 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:11:37.173 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:11:37.173 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:11:37.173 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:37.189 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:11:37.189 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:37.246 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:11:37.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.403+0000 7fcc0e15e640 1 -- 172.21.15.18:0/3620757004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc08162a40 msgr2=0x7fcc08162e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:37.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.403+0000 7fcc0e15e640 1 --2- 172.21.15.18:0/3620757004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc08162a40 0x7fcc08162e50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcc00005fd0 tx=0x7fcc0002aa90 comp rx=0 tx=0).stop 2024-09-21T07:11:37.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.403+0000 7fcc0e15e640 1 -- 172.21.15.18:0/3620757004 shutdown_connections 2024-09-21T07:11:37.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.403+0000 7fcc0e15e640 1 --2- 172.21.15.18:0/3620757004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc08162a40 0x7fcc08162e50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.403+0000 7fcc0e15e640 1 --2- 172.21.15.18:0/3620757004 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc0815ef50 0x7fcc0815c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.403+0000 7fcc0e15e640 1 -- 172.21.15.18:0/3620757004 >> 172.21.15.18:0/3620757004 conn(0x7fcc08073f30 msgr2=0x7fcc080b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:37.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.403+0000 7fcc0e15e640 1 -- 172.21.15.18:0/3620757004 shutdown_connections 2024-09-21T07:11:37.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.403+0000 7fcc0e15e640 1 -- 172.21.15.18:0/3620757004 wait complete. 2024-09-21T07:11:37.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.405+0000 7fcc0e15e640 1 Processor -- start 2024-09-21T07:11:37.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.405+0000 7fcc0e15e640 1 -- start start 2024-09-21T07:11:37.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.406+0000 7fcc0e15e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc080cef70 0x7fcc08151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:37.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.406+0000 7fcc0e15e640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc0815ef50 0x7fcc080cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:37.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc0e15e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc08162a40 0x7fcc080b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:37.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc0e15e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcc080d11a0 con 0x7fcc08162a40 2024-09-21T07:11:37.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc0e15e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcc080d1020 con 0x7fcc080cef70 2024-09-21T07:11:37.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc0e15e640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fcc080d1320 con 0x7fcc0815ef50 2024-09-21T07:11:37.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc07fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc08162a40 0x7fcc080b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:37.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc07fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc08162a40 0x7fcc080b5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42894/0 (socket says 172.21.15.18:42894) 2024-09-21T07:11:37.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc07fff640 1 -- 172.21.15.18:0/795286166 learned_addr learned my addr 172.21.15.18:0/795286166 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:37.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc06ffd640 1 --2- 172.21.15.18:0/795286166 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc0815ef50 0x7fcc080cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:37.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc077fe640 1 --2- 172.21.15.18:0/795286166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc080cef70 0x7fcc08151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:37.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc07fff640 1 -- 172.21.15.18:0/795286166 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc0815ef50 msgr2=0x7fcc080cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:37.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc07fff640 1 --2- 172.21.15.18:0/795286166 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc0815ef50 0x7fcc080cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc07fff640 1 -- 172.21.15.18:0/795286166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc080cef70 msgr2=0x7fcc08151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:37.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc07fff640 1 --2- 172.21.15.18:0/795286166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc080cef70 0x7fcc08151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc07fff640 1 -- 172.21.15.18:0/795286166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc081520a0 con 0x7fcc08162a40 2024-09-21T07:11:37.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc077fe640 1 --2- 172.21.15.18:0/795286166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc080cef70 0x7fcc08151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:37.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc07fff640 1 --2- 172.21.15.18:0/795286166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc08162a40 0x7fcc080b5160 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcc00009d90 tx=0x7fcc00003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:37.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcbfffff640 1 -- 172.21.15.18:0/795286166 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc00044070 con 0x7fcc08162a40 2024-09-21T07:11:37.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcbfffff640 1 -- 172.21.15.18:0/795286166 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc00004040 con 0x7fcc08162a40 2024-09-21T07:11:37.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcc0e15e640 1 -- 172.21.15.18:0/795286166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc080cc710 con 0x7fcc08162a40 2024-09-21T07:11:37.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.407+0000 7fcbfffff640 1 -- 172.21.15.18:0/795286166 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc00004430 con 0x7fcc08162a40 2024-09-21T07:11:37.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.408+0000 7fcc0e15e640 1 -- 172.21.15.18:0/795286166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc080abef0 con 0x7fcc08162a40 2024-09-21T07:11:37.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.409+0000 7fcc0e15e640 1 -- 172.21.15.18:0/795286166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc080ac130 con 0x7fcc08162a40 2024-09-21T07:11:37.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.409+0000 7fcbfffff640 1 -- 172.21.15.18:0/795286166 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fcc00047070 con 0x7fcc08162a40 2024-09-21T07:11:37.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.410+0000 7fcbfffff640 1 --2- 172.21.15.18:0/795286166 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbe8078d40 0x7fcbe807b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:37.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.410+0000 7fcbfffff640 1 -- 172.21.15.18:0/795286166 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fcc000bbf80 con 0x7fcc08162a40 2024-09-21T07:11:37.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.410+0000 7fcc077fe640 1 --2- 172.21.15.18:0/795286166 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbe8078d40 0x7fcbe807b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:37.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.411+0000 7fcc077fe640 1 --2- 172.21.15.18:0/795286166 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbe8078d40 0x7fcbe807b250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009ab0 tx=0x7fcbf0005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:37.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.415+0000 7fcbfffff640 1 -- 172.21.15.18:0/795286166 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcc00032030 con 0x7fcc08162a40 2024-09-21T07:11:37.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.616+0000 7fcc0e15e640 1 -- 172.21.15.18:0/795286166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcc080ab9a0 con 0x7fcc08162a40 2024-09-21T07:11:37.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.617+0000 7fcbfffff640 1 -- 172.21.15.18:0/795286166 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7fcc00084150 con 0x7fcc08162a40 2024-09-21T07:11:37.619 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-21T07:11:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.619+0000 7fcc0e15e640 1 -- 172.21.15.18:0/795286166 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbe8078d40 msgr2=0x7fcbe807b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.619+0000 7fcc0e15e640 1 --2- 172.21.15.18:0/795286166 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbe8078d40 0x7fcbe807b250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009ab0 tx=0x7fcbf0005f90 comp rx=0 tx=0).stop 2024-09-21T07:11:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.619+0000 7fcc0e15e640 1 -- 172.21.15.18:0/795286166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc08162a40 msgr2=0x7fcc080b5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.619+0000 7fcc0e15e640 1 --2- 172.21.15.18:0/795286166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc08162a40 0x7fcc080b5160 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcc00009d90 tx=0x7fcc00003ce0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.619+0000 7fcc0e15e640 1 -- 172.21.15.18:0/795286166 shutdown_connections 2024-09-21T07:11:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.619+0000 7fcc0e15e640 1 --2- 172.21.15.18:0/795286166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc08162a40 0x7fcc080b5160 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.619+0000 7fcc0e15e640 1 --2- 172.21.15.18:0/795286166 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbe8078d40 0x7fcbe807b250 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.619+0000 7fcc0e15e640 1 --2- 172.21.15.18:0/795286166 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc0815ef50 0x7fcc080cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.619+0000 7fcc0e15e640 1 --2- 172.21.15.18:0/795286166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc080cef70 0x7fcc08151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.619+0000 7fcc0e15e640 1 -- 172.21.15.18:0/795286166 >> 172.21.15.18:0/795286166 conn(0x7fcc08073f30 msgr2=0x7fcc080cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.619+0000 7fcc0e15e640 1 -- 172.21.15.18:0/795286166 shutdown_connections 2024-09-21T07:11:37.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.619+0000 7fcc0e15e640 1 -- 172.21.15.18:0/795286166 wait complete. 2024-09-21T07:11:37.632 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:11:37.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:37.632 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:11:37.663 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T07:11:37.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:37.664 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:11:37.720 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:11:37.720 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:11:37.720 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:37.740 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:11:37.740 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:37.800 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:11:37.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.916+0000 7fee454a2640 1 -- 172.21.15.18:0/1037921837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee400afe70 msgr2=0x7fee40070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:37.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.916+0000 7fee454a2640 1 --2- 172.21.15.18:0/1037921837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee400afe70 0x7fee40070470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fee28009830 tx=0x7fee2802a510 comp rx=0 tx=0).stop 2024-09-21T07:11:37.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.916+0000 7fee454a2640 1 -- 172.21.15.18:0/1037921837 shutdown_connections 2024-09-21T07:11:37.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.916+0000 7fee454a2640 1 --2- 172.21.15.18:0/1037921837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee400afe70 0x7fee40070470 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.916+0000 7fee454a2640 1 --2- 172.21.15.18:0/1037921837 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee400b6a00 0x7fee400b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.916+0000 7fee454a2640 1 -- 172.21.15.18:0/1037921837 >> 172.21.15.18:0/1037921837 conn(0x7fee4009ba60 msgr2=0x7fee400b78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:37.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.916+0000 7fee454a2640 1 -- 172.21.15.18:0/1037921837 shutdown_connections 2024-09-21T07:11:37.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.916+0000 7fee454a2640 1 -- 172.21.15.18:0/1037921837 wait complete. 2024-09-21T07:11:37.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.918+0000 7fee454a2640 1 Processor -- start 2024-09-21T07:11:37.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.918+0000 7fee454a2640 1 -- start start 2024-09-21T07:11:37.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.919+0000 7fee454a2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee400709b0 0x7fee400cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:37.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.919+0000 7fee454a2640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee400afe70 0x7fee4009f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:37.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.919+0000 7fee454a2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee400b6a00 0x7fee4009f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:37.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.919+0000 7fee454a2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fee4015d800 con 0x7fee400b6a00 2024-09-21T07:11:37.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.919+0000 7fee454a2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fee40070fd0 con 0x7fee400709b0 2024-09-21T07:11:37.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.919+0000 7fee454a2640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fee4015d980 con 0x7fee400afe70 2024-09-21T07:11:37.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.919+0000 7fee3f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee400b6a00 0x7fee4009f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:37.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.919+0000 7fee3e7fc640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee400afe70 0x7fee4009f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:37.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.919+0000 7fee3f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee400b6a00 0x7fee4009f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42902/0 (socket says 172.21.15.18:42902) 2024-09-21T07:11:37.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.919+0000 7fee3f7fe640 1 -- 172.21.15.18:0/4054050114 learned_addr learned my addr 172.21.15.18:0/4054050114 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:37.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.919+0000 7fee3effd640 1 --2- 172.21.15.18:0/4054050114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee400709b0 0x7fee400cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:37.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.920+0000 7fee3e7fc640 1 -- 172.21.15.18:0/4054050114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee400709b0 msgr2=0x7fee400cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:37.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.920+0000 7fee3e7fc640 1 --2- 172.21.15.18:0/4054050114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee400709b0 0x7fee400cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.920+0000 7fee3e7fc640 1 -- 172.21.15.18:0/4054050114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee400b6a00 msgr2=0x7fee4009f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:37.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.920+0000 7fee3e7fc640 1 --2- 172.21.15.18:0/4054050114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee400b6a00 0x7fee4009f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:37.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.920+0000 7fee3e7fc640 1 -- 172.21.15.18:0/4054050114 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee400cf820 con 0x7fee400afe70 2024-09-21T07:11:37.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.920+0000 7fee3f7fe640 1 --2- 172.21.15.18:0/4054050114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee400b6a00 0x7fee4009f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:11:37.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.920+0000 7fee3e7fc640 1 --2- 172.21.15.18:0/4054050114 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee400afe70 0x7fee4009f140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee400b5160 tx=0x7fee28033ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:37.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.920+0000 7fee377fe640 1 -- 172.21.15.18:0/4054050114 <== mon.2 v2:172.21.15.49:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee28031b50 con 0x7fee400afe70 2024-09-21T07:11:37.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.920+0000 7fee377fe640 1 -- 172.21.15.18:0/4054050114 <== mon.2 v2:172.21.15.49:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee28031de0 con 0x7fee400afe70 2024-09-21T07:11:37.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.920+0000 7fee454a2640 1 -- 172.21.15.18:0/4054050114 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee400d2210 con 0x7fee400afe70 2024-09-21T07:11:37.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.920+0000 7fee377fe640 1 -- 172.21.15.18:0/4054050114 <== mon.2 v2:172.21.15.49:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee28005280 con 0x7fee400afe70 2024-09-21T07:11:37.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.920+0000 7fee454a2640 1 -- 172.21.15.18:0/4054050114 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fee4009c9d0 con 0x7fee400afe70 2024-09-21T07:11:37.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.921+0000 7fee454a2640 1 -- 172.21.15.18:0/4054050114 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee40070470 con 0x7fee400afe70 2024-09-21T07:11:37.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.922+0000 7fee377fe640 1 -- 172.21.15.18:0/4054050114 <== mon.2 v2:172.21.15.49:3301/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fee28005420 con 0x7fee400afe70 2024-09-21T07:11:37.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.922+0000 7fee377fe640 1 --2- 172.21.15.18:0/4054050114 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee20078d40 0x7fee2007b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:37.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.923+0000 7fee377fe640 1 -- 172.21.15.18:0/4054050114 <== mon.2 v2:172.21.15.49:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fee280bcc10 con 0x7fee400afe70 2024-09-21T07:11:37.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.923+0000 7fee3effd640 1 --2- 172.21.15.18:0/4054050114 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee20078d40 0x7fee2007b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:37.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.923+0000 7fee3effd640 1 --2- 172.21.15.18:0/4054050114 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee20078d40 0x7fee2007b250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fee38009a60 tx=0x7fee38010040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:37.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:37.927+0000 7fee377fe640 1 -- 172.21.15.18:0/4054050114 <== mon.2 v2:172.21.15.49:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fee2803f030 con 0x7fee400afe70 2024-09-21T07:11:38.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.127+0000 7fee454a2640 1 -- 172.21.15.18:0/4054050114 --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fee400d32c0 con 0x7fee400afe70 2024-09-21T07:11:38.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.128+0000 7fee377fe640 1 -- 172.21.15.18:0/4054050114 <== mon.2 v2:172.21.15.49:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7fee28031770 con 0x7fee400afe70 2024-09-21T07:11:38.129 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-21T07:11:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.130+0000 7fee454a2640 1 -- 172.21.15.18:0/4054050114 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee20078d40 msgr2=0x7fee2007b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.130+0000 7fee454a2640 1 --2- 172.21.15.18:0/4054050114 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee20078d40 0x7fee2007b250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fee38009a60 tx=0x7fee38010040 comp rx=0 tx=0).stop 2024-09-21T07:11:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.130+0000 7fee454a2640 1 -- 172.21.15.18:0/4054050114 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee400afe70 msgr2=0x7fee4009f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.130+0000 7fee454a2640 1 --2- 172.21.15.18:0/4054050114 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee400afe70 0x7fee4009f140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee400b5160 tx=0x7fee28033ba0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.130+0000 7fee454a2640 1 -- 172.21.15.18:0/4054050114 shutdown_connections 2024-09-21T07:11:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.130+0000 7fee454a2640 1 --2- 172.21.15.18:0/4054050114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee400b6a00 0x7fee4009f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.130+0000 7fee454a2640 1 --2- 172.21.15.18:0/4054050114 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee20078d40 0x7fee2007b250 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.130+0000 7fee454a2640 1 --2- 172.21.15.18:0/4054050114 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee400afe70 0x7fee4009f140 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.130+0000 7fee454a2640 1 --2- 172.21.15.18:0/4054050114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee400709b0 0x7fee400cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.130+0000 7fee454a2640 1 -- 172.21.15.18:0/4054050114 >> 172.21.15.18:0/4054050114 conn(0x7fee4009ba60 msgr2=0x7fee400b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.130+0000 7fee454a2640 1 -- 172.21.15.18:0/4054050114 shutdown_connections 2024-09-21T07:11:38.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.130+0000 7fee454a2640 1 -- 172.21.15.18:0/4054050114 wait complete. 2024-09-21T07:11:38.143 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T07:11:38.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:38.143 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T07:11:38.178 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T07:11:38.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:38.179 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T07:11:38.238 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:11:38.238 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:11:38.238 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:38.254 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056793,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17771 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249344k,nr_inodes=812336,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:11:38.254 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:11:38.254 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:11:38.254 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:38.296 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056005,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19803 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:11:38.296 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:11:38.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.410+0000 7fac0490b640 1 -- 172.21.15.18:0/1410788111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac000afe70 msgr2=0x7fac00070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:38.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.410+0000 7fac0490b640 1 --2- 172.21.15.18:0/1410788111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac000afe70 0x7fac00070470 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009830 tx=0x7fabe802a510 comp rx=0 tx=0).stop 2024-09-21T07:11:38.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.410+0000 7fac0490b640 1 -- 172.21.15.18:0/1410788111 shutdown_connections 2024-09-21T07:11:38.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.410+0000 7fac0490b640 1 --2- 172.21.15.18:0/1410788111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac000afe70 0x7fac00070470 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.410+0000 7fac0490b640 1 --2- 172.21.15.18:0/1410788111 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac000b6a00 0x7fac000b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.410+0000 7fac0490b640 1 -- 172.21.15.18:0/1410788111 >> 172.21.15.18:0/1410788111 conn(0x7fac0009ba60 msgr2=0x7fac000b78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:38.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.411+0000 7fac0490b640 1 -- 172.21.15.18:0/1410788111 shutdown_connections 2024-09-21T07:11:38.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.411+0000 7fac0490b640 1 -- 172.21.15.18:0/1410788111 wait complete. 2024-09-21T07:11:38.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.412+0000 7fac0490b640 1 Processor -- start 2024-09-21T07:11:38.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.412+0000 7fac0490b640 1 -- start start 2024-09-21T07:11:38.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fac0490b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac000709b0 0x7fac0006e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fac0490b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac000afe70 0x7fac00159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fac0490b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac000b6a00 0x7fac00159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fac0490b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fac0015d800 con 0x7fac000afe70 2024-09-21T07:11:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fac0490b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fac00070fd0 con 0x7fac000709b0 2024-09-21T07:11:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fac0490b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fac0015d980 con 0x7fac000b6a00 2024-09-21T07:11:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fabfdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac000afe70 0x7fac00159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fabfdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac000afe70 0x7fac00159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42912/0 (socket says 172.21.15.18:42912) 2024-09-21T07:11:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fabfdd9b640 1 -- 172.21.15.18:0/1251129964 learned_addr learned my addr 172.21.15.18:0/1251129964 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fabfed9d640 1 --2- 172.21.15.18:0/1251129964 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac000b6a00 0x7fac00159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fabfe59c640 1 --2- 172.21.15.18:0/1251129964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac000709b0 0x7fac0006e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fabfdd9b640 1 -- 172.21.15.18:0/1251129964 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac000b6a00 msgr2=0x7fac00159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fabfdd9b640 1 --2- 172.21.15.18:0/1251129964 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac000b6a00 0x7fac00159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fabfdd9b640 1 -- 172.21.15.18:0/1251129964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac000709b0 msgr2=0x7fac0006e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fabfdd9b640 1 --2- 172.21.15.18:0/1251129964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac000709b0 0x7fac0006e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fabfdd9b640 1 -- 172.21.15.18:0/1251129964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0006d140 con 0x7fac000afe70 2024-09-21T07:11:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.414+0000 7fabfed9d640 1 --2- 172.21.15.18:0/1251129964 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac000b6a00 0x7fac00159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.415+0000 7fabfdd9b640 1 --2- 172.21.15.18:0/1251129964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac000afe70 0x7fac00159220 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fabe8000c00 tx=0x7fabe8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.415+0000 7fabf6ffd640 1 -- 172.21.15.18:0/1251129964 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8031d60 con 0x7fac000afe70 2024-09-21T07:11:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.415+0000 7fabf6ffd640 1 -- 172.21.15.18:0/1251129964 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabe8033e10 con 0x7fac000afe70 2024-09-21T07:11:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.415+0000 7fac0490b640 1 -- 172.21.15.18:0/1251129964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac000ccaa0 con 0x7fac000afe70 2024-09-21T07:11:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.415+0000 7fabf6ffd640 1 -- 172.21.15.18:0/1251129964 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8033310 con 0x7fac000afe70 2024-09-21T07:11:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.415+0000 7fac0490b640 1 -- 172.21.15.18:0/1251129964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0006d700 con 0x7fac000afe70 2024-09-21T07:11:38.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.416+0000 7fac0490b640 1 -- 172.21.15.18:0/1251129964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac00070470 con 0x7fac000afe70 2024-09-21T07:11:38.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.416+0000 7fabf6ffd640 1 -- 172.21.15.18:0/1251129964 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fabe80334b0 con 0x7fac000afe70 2024-09-21T07:11:38.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.417+0000 7fabf6ffd640 1 --2- 172.21.15.18:0/1251129964 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fabe0078d70 0x7fabe007b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:38.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.417+0000 7fabf6ffd640 1 -- 172.21.15.18:0/1251129964 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fabe80bc590 con 0x7fac000afe70 2024-09-21T07:11:38.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.417+0000 7fabfe59c640 1 --2- 172.21.15.18:0/1251129964 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fabe0078d70 0x7fabe007b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:38.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.418+0000 7fabfe59c640 1 --2- 172.21.15.18:0/1251129964 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fabe0078d70 0x7fabe007b280 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009a00 tx=0x7fabf8005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:38.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.422+0000 7fabf6ffd640 1 -- 172.21.15.18:0/1251129964 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fabe803f030 con 0x7fac000afe70 2024-09-21T07:11:38.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.645+0000 7fac0490b640 1 -- 172.21.15.18:0/1251129964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac0015fb40 con 0x7fac000afe70 2024-09-21T07:11:38.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.646+0000 7fabf6ffd640 1 -- 172.21.15.18:0/1251129964 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5220 (secure 0 0 0) 0x7fabe80846d0 con 0x7fac000afe70 2024-09-21T07:11:38.647 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:38.648 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":18,"btime":"2024-09-21T07:11:33:236312+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/492466681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":492466681},{"type":"v1","addr":"172.21.15.18:6834","nonce":492466681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4777,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/2411496903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2411496903},{"type":"v1","addr":"172.21.15.18:6835","nonce":2411496903}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4780,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2997359476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2997359476},{"type":"v1","addr":"172.21.15.49:6836","nonce":2997359476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:11:23.587887+0000","modified":"2024-09-21T07:11:26.595981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3575557854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3575557854},{"type":"v1","addr":"172.21.15.49:6837","nonce":3575557854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4905,"qdb_cluster":[4905]},"id":2}]} 2024-09-21T07:11:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 18 2024-09-21T07:11:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.648+0000 7fac0490b640 1 -- 172.21.15.18:0/1251129964 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fabe0078d70 msgr2=0x7fabe007b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.648+0000 7fac0490b640 1 --2- 172.21.15.18:0/1251129964 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fabe0078d70 0x7fabe007b280 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009a00 tx=0x7fabf8005f90 comp rx=0 tx=0).stop 2024-09-21T07:11:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.648+0000 7fac0490b640 1 -- 172.21.15.18:0/1251129964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac000afe70 msgr2=0x7fac00159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.648+0000 7fac0490b640 1 --2- 172.21.15.18:0/1251129964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac000afe70 0x7fac00159220 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fabe8000c00 tx=0x7fabe8033c20 comp rx=0 tx=0).stop 2024-09-21T07:11:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.648+0000 7fac0490b640 1 -- 172.21.15.18:0/1251129964 shutdown_connections 2024-09-21T07:11:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.648+0000 7fac0490b640 1 --2- 172.21.15.18:0/1251129964 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fabe0078d70 0x7fabe007b280 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.648+0000 7fac0490b640 1 --2- 172.21.15.18:0/1251129964 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac000b6a00 0x7fac00159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.648+0000 7fac0490b640 1 --2- 172.21.15.18:0/1251129964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac000afe70 0x7fac00159220 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.648+0000 7fac0490b640 1 --2- 172.21.15.18:0/1251129964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac000709b0 0x7fac0006e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.648+0000 7fac0490b640 1 -- 172.21.15.18:0/1251129964 >> 172.21.15.18:0/1251129964 conn(0x7fac0009ba60 msgr2=0x7fac0015aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.648+0000 7fac0490b640 1 -- 172.21.15.18:0/1251129964 shutdown_connections 2024-09-21T07:11:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.648+0000 7fac0490b640 1 -- 172.21.15.18:0/1251129964 wait complete. 2024-09-21T07:11:38.661 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:11:38.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.775+0000 7f7609c8c640 1 -- 172.21.15.18:0/7915468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76040b6a00 msgr2=0x7f76040b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:38.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.775+0000 7f7609c8c640 1 --2- 172.21.15.18:0/7915468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76040b6a00 0x7f76040b1780 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f75f4009830 tx=0x7f75f402a510 comp rx=0 tx=0).stop 2024-09-21T07:11:38.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.775+0000 7f7609c8c640 1 -- 172.21.15.18:0/7915468 shutdown_connections 2024-09-21T07:11:38.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.775+0000 7f7609c8c640 1 --2- 172.21.15.18:0/7915468 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f76040afe70 0x7f7604070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.775+0000 7f7609c8c640 1 --2- 172.21.15.18:0/7915468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76040b6a00 0x7f76040b1780 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.775+0000 7f7609c8c640 1 -- 172.21.15.18:0/7915468 >> 172.21.15.18:0/7915468 conn(0x7f760409ba60 msgr2=0x7f76040b78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:38.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.775+0000 7f7609c8c640 1 -- 172.21.15.18:0/7915468 shutdown_connections 2024-09-21T07:11:38.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.775+0000 7f7609c8c640 1 -- 172.21.15.18:0/7915468 wait complete. 2024-09-21T07:11:38.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.777+0000 7f7609c8c640 1 Processor -- start 2024-09-21T07:11:38.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.777+0000 7f7609c8c640 1 -- start start 2024-09-21T07:11:38.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7609c8c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76040709b0 0x7f76040cea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7609c8c640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f76040afe70 0x7f76041f3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7609c8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76040b6a00 0x7f76041f41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7609c8c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f760415d800 con 0x7f76040b6a00 2024-09-21T07:11:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7609c8c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7604070fd0 con 0x7f76040709b0 2024-09-21T07:11:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7609c8c640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f760415d980 con 0x7f76040afe70 2024-09-21T07:11:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7603fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76040b6a00 0x7f76041f41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7603fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76040b6a00 0x7f76041f41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42924/0 (socket says 172.21.15.18:42924) 2024-09-21T07:11:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7603fff640 1 -- 172.21.15.18:0/1485010834 learned_addr learned my addr 172.21.15.18:0/1485010834 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7602ffd640 1 --2- 172.21.15.18:0/1485010834 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f76040afe70 0x7f76041f3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f76037fe640 1 --2- 172.21.15.18:0/1485010834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76040709b0 0x7f76040cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7603fff640 1 -- 172.21.15.18:0/1485010834 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f76040afe70 msgr2=0x7f76041f3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7603fff640 1 --2- 172.21.15.18:0/1485010834 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f76040afe70 0x7f76041f3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7603fff640 1 -- 172.21.15.18:0/1485010834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76040709b0 msgr2=0x7f76040cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7603fff640 1 --2- 172.21.15.18:0/1485010834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76040709b0 0x7f76040cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7603fff640 1 -- 172.21.15.18:0/1485010834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76040cf4d0 con 0x7f76040b6a00 2024-09-21T07:11:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f7603fff640 1 --2- 172.21.15.18:0/1485010834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76040b6a00 0x7f76041f41c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00c760 tx=0x7f75fc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f75ebfff640 1 -- 172.21.15.18:0/1485010834 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc017070 con 0x7f76040b6a00 2024-09-21T07:11:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.779+0000 7f75ebfff640 1 -- 172.21.15.18:0/1485010834 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75fc00ce10 con 0x7f76040b6a00 2024-09-21T07:11:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.780+0000 7f75ebfff640 1 -- 172.21.15.18:0/1485010834 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0052b0 con 0x7f76040b6a00 2024-09-21T07:11:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.780+0000 7f7609c8c640 1 -- 172.21.15.18:0/1485010834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7604138d00 con 0x7f76040b6a00 2024-09-21T07:11:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.780+0000 7f7609c8c640 1 -- 172.21.15.18:0/1485010834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76041392c0 con 0x7f76040b6a00 2024-09-21T07:11:38.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.781+0000 7f7609c8c640 1 -- 172.21.15.18:0/1485010834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7604070470 con 0x7f76040b6a00 2024-09-21T07:11:38.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.781+0000 7f75ebfff640 1 -- 172.21.15.18:0/1485010834 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f75fc01a070 con 0x7f76040b6a00 2024-09-21T07:11:38.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.782+0000 7f75ebfff640 1 --2- 172.21.15.18:0/1485010834 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f75f0078d40 0x7f75f007b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:38.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.782+0000 7f75ebfff640 1 -- 172.21.15.18:0/1485010834 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f75fc09a840 con 0x7f76040b6a00 2024-09-21T07:11:38.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.782+0000 7f76037fe640 1 --2- 172.21.15.18:0/1485010834 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f75f0078d40 0x7f75f007b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:38.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.783+0000 7f76037fe640 1 --2- 172.21.15.18:0/1485010834 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f75f0078d40 0x7f75f007b250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f75f4034000 tx=0x7f75f4004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:38.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:38.787+0000 7f75ebfff640 1 -- 172.21.15.18:0/1485010834 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f75fc062870 con 0x7f76040b6a00 2024-09-21T07:11:39.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.012+0000 7f7609c8c640 1 -- 172.21.15.18:0/1485010834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7604074cf0 con 0x7f76040b6a00 2024-09-21T07:11:39.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.012+0000 7f75ebfff640 1 -- 172.21.15.18:0/1485010834 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5220 (secure 0 0 0) 0x7f75fc062170 con 0x7f76040b6a00 2024-09-21T07:11:39.014 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:39.014 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":18,"btime":"2024-09-21T07:11:33:236312+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/492466681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":492466681},{"type":"v1","addr":"172.21.15.18:6834","nonce":492466681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4777,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/2411496903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2411496903},{"type":"v1","addr":"172.21.15.18:6835","nonce":2411496903}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4780,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2997359476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2997359476},{"type":"v1","addr":"172.21.15.49:6836","nonce":2997359476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:11:23.587887+0000","modified":"2024-09-21T07:11:26.595981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3575557854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3575557854},{"type":"v1","addr":"172.21.15.49:6837","nonce":3575557854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4905,"qdb_cluster":[4905]},"id":2}]} 2024-09-21T07:11:39.015 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 18 2024-09-21T07:11:39.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.014+0000 7f7609c8c640 1 -- 172.21.15.18:0/1485010834 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f75f0078d40 msgr2=0x7f75f007b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.014+0000 7f7609c8c640 1 --2- 172.21.15.18:0/1485010834 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f75f0078d40 0x7f75f007b250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f75f4034000 tx=0x7f75f4004730 comp rx=0 tx=0).stop 2024-09-21T07:11:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.014+0000 7f7609c8c640 1 -- 172.21.15.18:0/1485010834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76040b6a00 msgr2=0x7f76041f41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.014+0000 7f7609c8c640 1 --2- 172.21.15.18:0/1485010834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76040b6a00 0x7f76041f41c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00c760 tx=0x7f75fc00cc20 comp rx=0 tx=0).stop 2024-09-21T07:11:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.014+0000 7f7609c8c640 1 -- 172.21.15.18:0/1485010834 shutdown_connections 2024-09-21T07:11:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.014+0000 7f7609c8c640 1 --2- 172.21.15.18:0/1485010834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76040b6a00 0x7f76041f41c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.014+0000 7f7609c8c640 1 --2- 172.21.15.18:0/1485010834 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f75f0078d40 0x7f75f007b250 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.014+0000 7f7609c8c640 1 --2- 172.21.15.18:0/1485010834 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f76040afe70 0x7f76041f3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.014+0000 7f7609c8c640 1 --2- 172.21.15.18:0/1485010834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76040709b0 0x7f76040cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.014+0000 7f7609c8c640 1 -- 172.21.15.18:0/1485010834 >> 172.21.15.18:0/1485010834 conn(0x7f760409ba60 msgr2=0x7f76040b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:39.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.014+0000 7f7609c8c640 1 -- 172.21.15.18:0/1485010834 shutdown_connections 2024-09-21T07:11:39.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.014+0000 7f7609c8c640 1 -- 172.21.15.18:0/1485010834 wait complete. 2024-09-21T07:11:39.028 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:11:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.142+0000 7fd03e19b640 1 -- 172.21.15.18:0/1456969613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd020004d40 msgr2=0x7fd020005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.142+0000 7fd03e19b640 1 --2- 172.21.15.18:0/1456969613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd020004d40 0x7fd020005210 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd038070870 tx=0x7fd020005830 comp rx=0 tx=0).stop 2024-09-21T07:11:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.142+0000 7fd037fff640 1 -- 172.21.15.18:0/1456969613 reap_dead start 2024-09-21T07:11:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.142+0000 7fd03e19b640 1 -- 172.21.15.18:0/1456969613 shutdown_connections 2024-09-21T07:11:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.142+0000 7fd03e19b640 1 -- 172.21.15.18:0/1456969613 >> 172.21.15.18:0/1456969613 conn(0x7fd038073340 msgr2=0x7fd038073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.142+0000 7fd03e19b640 1 -- 172.21.15.18:0/1456969613 shutdown_connections 2024-09-21T07:11:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.142+0000 7fd03e19b640 1 -- 172.21.15.18:0/1456969613 wait complete. 2024-09-21T07:11:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.144+0000 7fd03e19b640 1 Processor -- start 2024-09-21T07:11:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.144+0000 7fd03e19b640 1 -- start start 2024-09-21T07:11:39.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.145+0000 7fd03e19b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd0381429b0 0x7fd0380b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:39.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.145+0000 7fd03e19b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0380b2ad0 0x7fd03813fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.145+0000 7fd03e19b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd038142dc0 0x7fd038140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.145+0000 7fd03e19b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd03815d5f0 con 0x7fd0380b2ad0 2024-09-21T07:11:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.145+0000 7fd03e19b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd03815d470 con 0x7fd038142dc0 2024-09-21T07:11:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.145+0000 7fd03e19b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fd038070ab0 con 0x7fd0381429b0 2024-09-21T07:11:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.145+0000 7fd036ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0380b2ad0 0x7fd03813fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.145+0000 7fd036ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0380b2ad0 0x7fd03813fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42940/0 (socket says 172.21.15.18:42940) 2024-09-21T07:11:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.146+0000 7fd036ffd640 1 -- 172.21.15.18:0/2750418389 learned_addr learned my addr 172.21.15.18:0/2750418389 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.146+0000 7fd037fff640 1 --2- 172.21.15.18:0/2750418389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd038142dc0 0x7fd038140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.146+0000 7fd0377fe640 1 --2- 172.21.15.18:0/2750418389 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd0381429b0 0x7fd0380b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.146+0000 7fd036ffd640 1 -- 172.21.15.18:0/2750418389 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd0381429b0 msgr2=0x7fd0380b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.146+0000 7fd036ffd640 1 --2- 172.21.15.18:0/2750418389 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd0381429b0 0x7fd0380b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.146+0000 7fd036ffd640 1 -- 172.21.15.18:0/2750418389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd038142dc0 msgr2=0x7fd038140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.146+0000 7fd036ffd640 1 --2- 172.21.15.18:0/2750418389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd038142dc0 0x7fd038140210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.146+0000 7fd036ffd640 1 -- 172.21.15.18:0/2750418389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0381438e0 con 0x7fd0380b2ad0 2024-09-21T07:11:39.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.146+0000 7fd036ffd640 1 --2- 172.21.15.18:0/2750418389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0380b2ad0 0x7fd03813fcd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd02c011ae0 tx=0x7fd02c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:39.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.146+0000 7fd01ffff640 1 -- 172.21.15.18:0/2750418389 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c01e070 con 0x7fd0380b2ad0 2024-09-21T07:11:39.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.146+0000 7fd01ffff640 1 -- 172.21.15.18:0/2750418389 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd02c00fe70 con 0x7fd0380b2ad0 2024-09-21T07:11:39.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.146+0000 7fd03e19b640 1 -- 172.21.15.18:0/2750418389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd038143320 con 0x7fd0380b2ad0 2024-09-21T07:11:39.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.146+0000 7fd01ffff640 1 -- 172.21.15.18:0/2750418389 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c004290 con 0x7fd0380b2ad0 2024-09-21T07:11:39.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.146+0000 7fd03e19b640 1 -- 172.21.15.18:0/2750418389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0381409c0 con 0x7fd0380b2ad0 2024-09-21T07:11:39.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.147+0000 7fd03e19b640 1 -- 172.21.15.18:0/2750418389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd038140df0 con 0x7fd0380b2ad0 2024-09-21T07:11:39.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.148+0000 7fd01ffff640 1 -- 172.21.15.18:0/2750418389 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fd02c021070 con 0x7fd0380b2ad0 2024-09-21T07:11:39.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.148+0000 7fd01ffff640 1 --2- 172.21.15.18:0/2750418389 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd024078d40 0x7fd02407b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:39.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.149+0000 7fd01ffff640 1 -- 172.21.15.18:0/2750418389 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fd02c09bac0 con 0x7fd0380b2ad0 2024-09-21T07:11:39.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.149+0000 7fd0377fe640 1 --2- 172.21.15.18:0/2750418389 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd024078d40 0x7fd02407b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:39.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.149+0000 7fd0377fe640 1 --2- 172.21.15.18:0/2750418389 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd024078d40 0x7fd02407b250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd028000c00 tx=0x7fd028006bc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:39.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.153+0000 7fd01ffff640 1 -- 172.21.15.18:0/2750418389 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd02c063710 con 0x7fd0380b2ad0 2024-09-21T07:11:39.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.343+0000 7fd03e19b640 1 -- 172.21.15.18:0/2750418389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd038160d10 con 0x7fd0380b2ad0 2024-09-21T07:11:39.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.344+0000 7fd01ffff640 1 -- 172.21.15.18:0/2750418389 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16705 (secure 0 0 0) 0x7fd02c068140 con 0x7fd0380b2ad0 2024-09-21T07:11:39.346 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:39.346 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":32,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:11:25.200034+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:11:21.656195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T07:11:22.531227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:39.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.346+0000 7fd03e19b640 1 -- 172.21.15.18:0/2750418389 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd024078d40 msgr2=0x7fd02407b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.346+0000 7fd03e19b640 1 --2- 172.21.15.18:0/2750418389 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd024078d40 0x7fd02407b250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd028000c00 tx=0x7fd028006bc0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.346+0000 7fd03e19b640 1 -- 172.21.15.18:0/2750418389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0380b2ad0 msgr2=0x7fd03813fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.346+0000 7fd03e19b640 1 --2- 172.21.15.18:0/2750418389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0380b2ad0 0x7fd03813fcd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd02c011ae0 tx=0x7fd02c009e90 comp rx=0 tx=0).stop 2024-09-21T07:11:39.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.346+0000 7fd03e19b640 1 -- 172.21.15.18:0/2750418389 shutdown_connections 2024-09-21T07:11:39.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.346+0000 7fd03e19b640 1 --2- 172.21.15.18:0/2750418389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd038142dc0 0x7fd038140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.346+0000 7fd03e19b640 1 --2- 172.21.15.18:0/2750418389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0380b2ad0 0x7fd03813fcd0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.346+0000 7fd03e19b640 1 --2- 172.21.15.18:0/2750418389 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd024078d40 0x7fd02407b250 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.346+0000 7fd03e19b640 1 --2- 172.21.15.18:0/2750418389 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd0381429b0 0x7fd0380b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.346+0000 7fd03e19b640 1 -- 172.21.15.18:0/2750418389 >> 172.21.15.18:0/2750418389 conn(0x7fd038073340 msgr2=0x7fd03806e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.346+0000 7fd03e19b640 1 -- 172.21.15.18:0/2750418389 shutdown_connections 2024-09-21T07:11:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.346+0000 7fd03e19b640 1 -- 172.21.15.18:0/2750418389 wait complete. 2024-09-21T07:11:39.360 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:11:39.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:11:39.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.476+0000 7fa6b08e5640 1 -- 172.21.15.18:0/420831826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa698004800 msgr2=0x7fa698004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.476+0000 7fa6b08e5640 1 --2- 172.21.15.18:0/420831826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa698004800 0x7fa698004c10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa694009b40 tx=0x7fa698005830 comp rx=0 tx=0).stop 2024-09-21T07:11:39.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.476+0000 7fa6b08e5640 1 -- 172.21.15.18:0/420831826 shutdown_connections 2024-09-21T07:11:39.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.476+0000 7fa6b08e5640 1 --2- 172.21.15.18:0/420831826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa698004800 0x7fa698004c10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.476+0000 7fa6b08e5640 1 -- 172.21.15.18:0/420831826 >> 172.21.15.18:0/420831826 conn(0x7fa6ac073f30 msgr2=0x7fa6ac0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:39.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.476+0000 7fa6b08e5640 1 -- 172.21.15.18:0/420831826 shutdown_connections 2024-09-21T07:11:39.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.476+0000 7fa6b08e5640 1 -- 172.21.15.18:0/420831826 wait complete. 2024-09-21T07:11:39.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.478+0000 7fa6b08e5640 1 Processor -- start 2024-09-21T07:11:39.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.478+0000 7fa6b08e5640 1 -- start start 2024-09-21T07:11:39.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6b08e5640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa698004800 0x7fa6ac15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:39.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6b08e5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac0ab860 0x7fa6ac0abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6b08e5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ac0b51c0 0x7fa6ac0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6b08e5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac0cef70 con 0x7fa6ac0ab860 2024-09-21T07:11:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6b08e5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac0d33b0 con 0x7fa6ac0b51c0 2024-09-21T07:11:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6b08e5640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fa6ac0cf0f0 con 0x7fa698004800 2024-09-21T07:11:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6a9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac0ab860 0x7fa6ac0abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6a9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac0ab860 0x7fa6ac0abc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42948/0 (socket says 172.21.15.18:42948) 2024-09-21T07:11:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6a9d9b640 1 -- 172.21.15.18:0/4168313500 learned_addr learned my addr 172.21.15.18:0/4168313500 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6aa59c640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa698004800 0x7fa6ac15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6aad9d640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ac0b51c0 0x7fa6ac0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6a9d9b640 1 -- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa698004800 msgr2=0x7fa6ac15ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6a9d9b640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa698004800 0x7fa6ac15ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6a9d9b640 1 -- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ac0b51c0 msgr2=0x7fa6ac0b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6a9d9b640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ac0b51c0 0x7fa6ac0b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6a9d9b640 1 -- 172.21.15.18:0/4168313500 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ac0b5b10 con 0x7fa6ac0ab860 2024-09-21T07:11:39.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6aad9d640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ac0b51c0 0x7fa6ac0b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:39.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.479+0000 7fa6aa59c640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa698004800 0x7fa6ac15ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:39.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.480+0000 7fa6a9d9b640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac0ab860 0x7fa6ac0abc70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa694009c60 tx=0x7fa6940336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:39.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.480+0000 7fa6a2ffd640 1 -- 172.21.15.18:0/4168313500 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694038040 con 0x7fa6ac0ab860 2024-09-21T07:11:39.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.480+0000 7fa6a2ffd640 1 -- 172.21.15.18:0/4168313500 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa694041070 con 0x7fa6ac0ab860 2024-09-21T07:11:39.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.480+0000 7fa6a2ffd640 1 -- 172.21.15.18:0/4168313500 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69403c430 con 0x7fa6ac0ab860 2024-09-21T07:11:39.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.480+0000 7fa6b08e5640 1 -- 172.21.15.18:0/4168313500 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6ac0cca00 con 0x7fa6ac0ab860 2024-09-21T07:11:39.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.480+0000 7fa6b08e5640 1 -- 172.21.15.18:0/4168313500 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6ac0ccfc0 con 0x7fa6ac0ab860 2024-09-21T07:11:39.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.481+0000 7fa6b08e5640 1 -- 172.21.15.18:0/4168313500 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6ac162a40 con 0x7fa6ac0ab860 2024-09-21T07:11:39.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.482+0000 7fa6a2ffd640 1 -- 172.21.15.18:0/4168313500 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fa69402b820 con 0x7fa6ac0ab860 2024-09-21T07:11:39.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.482+0000 7fa6a2ffd640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa68c078d40 0x7fa68c07b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:39.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.482+0000 7fa6a2ffd640 1 -- 172.21.15.18:0/4168313500 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa6940bbb40 con 0x7fa6ac0ab860 2024-09-21T07:11:39.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.483+0000 7fa6aa59c640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa68c078d40 0x7fa68c07b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:39.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.483+0000 7fa6aa59c640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa68c078d40 0x7fa68c07b250 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4006290 tx=0x7fa6a4006eb0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:39.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.487+0000 7fa6a2ffd640 1 -- 172.21.15.18:0/4168313500 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa6ac0b5b10 con 0x7fa6ac0ab860 2024-09-21T07:11:39.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.712+0000 7fa6b08e5640 1 -- 172.21.15.18:0/4168313500 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6ac0cfd00 con 0x7fa6ac0ab860 2024-09-21T07:11:39.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.712+0000 7fa6a2ffd640 1 -- 172.21.15.18:0/4168313500 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5220 (secure 0 0 0) 0x7fa694083d10 con 0x7fa6ac0ab860 2024-09-21T07:11:39.714 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:39.714 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":18,"btime":"2024-09-21T07:11:33:236312+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/492466681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":492466681},{"type":"v1","addr":"172.21.15.18:6834","nonce":492466681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4777,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/2411496903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2411496903},{"type":"v1","addr":"172.21.15.18:6835","nonce":2411496903}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4780,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2997359476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2997359476},{"type":"v1","addr":"172.21.15.49:6836","nonce":2997359476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:11:23.587887+0000","modified":"2024-09-21T07:11:26.595981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3575557854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3575557854},{"type":"v1","addr":"172.21.15.49:6837","nonce":3575557854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4905,"qdb_cluster":[4905]},"id":2}]} 2024-09-21T07:11:39.715 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 18 2024-09-21T07:11:39.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.715+0000 7fa6b08e5640 1 -- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa68c078d40 msgr2=0x7fa68c07b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.715+0000 7fa6b08e5640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa68c078d40 0x7fa68c07b250 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4006290 tx=0x7fa6a4006eb0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.715+0000 7fa6b08e5640 1 -- 172.21.15.18:0/4168313500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac0ab860 msgr2=0x7fa6ac0abc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.715+0000 7fa6b08e5640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac0ab860 0x7fa6ac0abc70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa694009c60 tx=0x7fa6940336f0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.715+0000 7fa6b08e5640 1 -- 172.21.15.18:0/4168313500 shutdown_connections 2024-09-21T07:11:39.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.715+0000 7fa6b08e5640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6ac0b51c0 0x7fa6ac0b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.715+0000 7fa6b08e5640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac0ab860 0x7fa6ac0abc70 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.715+0000 7fa6b08e5640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa68c078d40 0x7fa68c07b250 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.715+0000 7fa6b08e5640 1 --2- 172.21.15.18:0/4168313500 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa698004800 0x7fa6ac15ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.715+0000 7fa6b08e5640 1 -- 172.21.15.18:0/4168313500 >> 172.21.15.18:0/4168313500 conn(0x7fa6ac073f30 msgr2=0x7fa6ac06d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:39.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.715+0000 7fa6b08e5640 1 -- 172.21.15.18:0/4168313500 shutdown_connections 2024-09-21T07:11:39.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.715+0000 7fa6b08e5640 1 -- 172.21.15.18:0/4168313500 wait complete. 2024-09-21T07:11:39.728 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:11:39.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.843+0000 7fcc209ba640 1 -- 172.21.15.18:0/351071710 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc1c0b4760 msgr2=0x7fcc1c153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.843+0000 7fcc209ba640 1 --2- 172.21.15.18:0/351071710 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc1c0b4760 0x7fcc1c153900 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c005fd0 tx=0x7fcc0c02a5d0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.843+0000 7fcc209ba640 1 -- 172.21.15.18:0/351071710 shutdown_connections 2024-09-21T07:11:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.843+0000 7fcc209ba640 1 --2- 172.21.15.18:0/351071710 >> v2:172.21.15.49:3300/0 conn(0x7fcc1c15db80 0x7fcc1c0b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.843+0000 7fcc209ba640 1 --2- 172.21.15.18:0/351071710 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc1c0b4760 0x7fcc1c153900 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.843+0000 7fcc209ba640 1 -- 172.21.15.18:0/351071710 >> 172.21.15.18:0/351071710 conn(0x7fcc1c0b78b0 msgr2=0x7fcc1c0b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.843+0000 7fcc209ba640 1 -- 172.21.15.18:0/351071710 shutdown_connections 2024-09-21T07:11:39.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.843+0000 7fcc209ba640 1 -- 172.21.15.18:0/351071710 wait complete. 2024-09-21T07:11:39.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.845+0000 7fcc209ba640 1 Processor -- start 2024-09-21T07:11:39.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.845+0000 7fcc209ba640 1 -- start start 2024-09-21T07:11:39.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc209ba640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc1c0b4760 0x7fcc1c1f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc209ba640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c15d060 0x7fcc1c0b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc209ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc1c15db80 0x7fcc1c0b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc209ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c0b6190 con 0x7fcc1c15db80 2024-09-21T07:11:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc209ba640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c0b6010 con 0x7fcc1c15d060 2024-09-21T07:11:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc209ba640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fcc1c0b6310 con 0x7fcc1c0b4760 2024-09-21T07:11:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc1ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc1c15db80 0x7fcc1c0b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc1ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc1c15db80 0x7fcc1c0b1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42950/0 (socket says 172.21.15.18:42950) 2024-09-21T07:11:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc1ad9d640 1 -- 172.21.15.18:0/2130428446 learned_addr learned my addr 172.21.15.18:0/2130428446 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc1a59c640 1 --2- 172.21.15.18:0/2130428446 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc1c0b4760 0x7fcc1c1f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc19d9b640 1 --2- 172.21.15.18:0/2130428446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c15d060 0x7fcc1c0b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc1ad9d640 1 -- 172.21.15.18:0/2130428446 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc1c0b4760 msgr2=0x7fcc1c1f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc1ad9d640 1 --2- 172.21.15.18:0/2130428446 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc1c0b4760 0x7fcc1c1f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc1ad9d640 1 -- 172.21.15.18:0/2130428446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c15d060 msgr2=0x7fcc1c0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc1ad9d640 1 --2- 172.21.15.18:0/2130428446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c15d060 0x7fcc1c0b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc1ad9d640 1 -- 172.21.15.18:0/2130428446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1c0b26c0 con 0x7fcc1c15db80 2024-09-21T07:11:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc19d9b640 1 --2- 172.21.15.18:0/2130428446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c15d060 0x7fcc1c0b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.847+0000 7fcc1ad9d640 1 --2- 172.21.15.18:0/2130428446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc1c15db80 0x7fcc1c0b1b50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400ec50 tx=0x7fcc1400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.848+0000 7fcc0affd640 1 -- 172.21.15.18:0/2130428446 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc14003b70 con 0x7fcc1c15db80 2024-09-21T07:11:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.848+0000 7fcc0affd640 1 -- 172.21.15.18:0/2130428446 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc14003d10 con 0x7fcc1c15db80 2024-09-21T07:11:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.848+0000 7fcc0affd640 1 -- 172.21.15.18:0/2130428446 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc14004280 con 0x7fcc1c15db80 2024-09-21T07:11:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.848+0000 7fcc209ba640 1 -- 172.21.15.18:0/2130428446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1c1f5580 con 0x7fcc1c15db80 2024-09-21T07:11:39.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.848+0000 7fcc209ba640 1 -- 172.21.15.18:0/2130428446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc1c0b2930 con 0x7fcc1c15db80 2024-09-21T07:11:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.849+0000 7fcc209ba640 1 -- 172.21.15.18:0/2130428446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc1c1587e0 con 0x7fcc1c15db80 2024-09-21T07:11:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.850+0000 7fcc0affd640 1 -- 172.21.15.18:0/2130428446 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fcc14004420 con 0x7fcc1c15db80 2024-09-21T07:11:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.850+0000 7fcc0affd640 1 --2- 172.21.15.18:0/2130428446 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbfc078d70 0x7fcbfc07b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.850+0000 7fcc0affd640 1 -- 172.21.15.18:0/2130428446 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fcc1409c020 con 0x7fcc1c15db80 2024-09-21T07:11:39.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.850+0000 7fcc1a59c640 1 --2- 172.21.15.18:0/2130428446 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbfc078d70 0x7fcbfc07b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:39.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.851+0000 7fcc1a59c640 1 --2- 172.21.15.18:0/2130428446 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbfc078d70 0x7fcbfc07b280 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c033000 tx=0x7fcc0c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:39.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:39.855+0000 7fcc0affd640 1 -- 172.21.15.18:0/2130428446 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcc140640d0 con 0x7fcc1c15db80 2024-09-21T07:11:40.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.085+0000 7fcc209ba640 1 -- 172.21.15.18:0/2130428446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc1c0b67c0 con 0x7fcc1c15db80 2024-09-21T07:11:40.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.085+0000 7fcc0affd640 1 -- 172.21.15.18:0/2130428446 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5220 (secure 0 0 0) 0x7fcc140639d0 con 0x7fcc1c15db80 2024-09-21T07:11:40.087 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:40.087 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":18,"btime":"2024-09-21T07:11:33:236312+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/492466681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":492466681},{"type":"v1","addr":"172.21.15.18:6834","nonce":492466681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4777,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/2411496903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2411496903},{"type":"v1","addr":"172.21.15.18:6835","nonce":2411496903}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4780,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2997359476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2997359476},{"type":"v1","addr":"172.21.15.49:6836","nonce":2997359476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:11:23.587887+0000","modified":"2024-09-21T07:11:26.595981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6837/3575557854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":3575557854},{"type":"v1","addr":"172.21.15.49:6837","nonce":3575557854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4905,"qdb_cluster":[4905]},"id":2}]} 2024-09-21T07:11:40.087 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 18 2024-09-21T07:11:40.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.088+0000 7fcc209ba640 1 -- 172.21.15.18:0/2130428446 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbfc078d70 msgr2=0x7fcbfc07b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.088+0000 7fcc209ba640 1 --2- 172.21.15.18:0/2130428446 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbfc078d70 0x7fcbfc07b280 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c033000 tx=0x7fcc0c004730 comp rx=0 tx=0).stop 2024-09-21T07:11:40.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.088+0000 7fcc209ba640 1 -- 172.21.15.18:0/2130428446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc1c15db80 msgr2=0x7fcc1c0b1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.088+0000 7fcc209ba640 1 --2- 172.21.15.18:0/2130428446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc1c15db80 0x7fcc1c0b1b50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400ec50 tx=0x7fcc1400c6a0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.088+0000 7fcc209ba640 1 -- 172.21.15.18:0/2130428446 shutdown_connections 2024-09-21T07:11:40.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.088+0000 7fcc209ba640 1 --2- 172.21.15.18:0/2130428446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc1c15db80 0x7fcc1c0b1b50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.088+0000 7fcc209ba640 1 --2- 172.21.15.18:0/2130428446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c15d060 0x7fcc1c0b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.088+0000 7fcc209ba640 1 --2- 172.21.15.18:0/2130428446 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcbfc078d70 0x7fcbfc07b280 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.088+0000 7fcc209ba640 1 --2- 172.21.15.18:0/2130428446 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc1c0b4760 0x7fcc1c1f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.088+0000 7fcc209ba640 1 -- 172.21.15.18:0/2130428446 >> 172.21.15.18:0/2130428446 conn(0x7fcc1c0b78b0 msgr2=0x7fcc1c1e8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:40.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.088+0000 7fcc209ba640 1 -- 172.21.15.18:0/2130428446 shutdown_connections 2024-09-21T07:11:40.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.088+0000 7fcc209ba640 1 -- 172.21.15.18:0/2130428446 wait complete. 2024-09-21T07:11:40.101 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:11:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.218+0000 7f988b732640 1 -- 172.21.15.18:0/3245849868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f988415c810 msgr2=0x7f988406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.218+0000 7f988b732640 1 --2- 172.21.15.18:0/3245849868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f988415c810 0x7f988406e340 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9880009830 tx=0x7f988002a480 comp rx=0 tx=0).stop 2024-09-21T07:11:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.218+0000 7f988b732640 1 -- 172.21.15.18:0/3245849868 shutdown_connections 2024-09-21T07:11:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.218+0000 7f988b732640 1 --2- 172.21.15.18:0/3245849868 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f98840b5260 0x7f9884070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.218+0000 7f988b732640 1 --2- 172.21.15.18:0/3245849868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f988415c810 0x7f988406e340 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.218+0000 7f988b732640 1 -- 172.21.15.18:0/3245849868 >> 172.21.15.18:0/3245849868 conn(0x7f98840b3a40 msgr2=0x7f98840d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.219+0000 7f988b732640 1 -- 172.21.15.18:0/3245849868 shutdown_connections 2024-09-21T07:11:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.219+0000 7f988b732640 1 -- 172.21.15.18:0/3245849868 wait complete. 2024-09-21T07:11:40.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.220+0000 7f988b732640 1 Processor -- start 2024-09-21T07:11:40.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.220+0000 7f988b732640 1 -- start start 2024-09-21T07:11:40.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f988b732640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98840b5260 0x7f98841e4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f988b732640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98840b5670 0x7f9884153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f988b732640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f988415c810 0x7f988415bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f988b732640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f988406d0d0 con 0x7f98840b5670 2024-09-21T07:11:40.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f988b732640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f988406cf50 con 0x7f98840b5260 2024-09-21T07:11:40.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f988b732640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f988406d250 con 0x7f988415c810 2024-09-21T07:11:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f9888ccd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98840b5670 0x7f9884153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f9888ccd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98840b5670 0x7f9884153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42956/0 (socket says 172.21.15.18:42956) 2024-09-21T07:11:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f9888ccd640 1 -- 172.21.15.18:0/3807948379 learned_addr learned my addr 172.21.15.18:0/3807948379 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f98894ce640 1 --2- 172.21.15.18:0/3807948379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98840b5260 0x7f98841e4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f9889ccf640 1 --2- 172.21.15.18:0/3807948379 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f988415c810 0x7f988415bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f9888ccd640 1 -- 172.21.15.18:0/3807948379 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f988415c810 msgr2=0x7f988415bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f9888ccd640 1 --2- 172.21.15.18:0/3807948379 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f988415c810 0x7f988415bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f9888ccd640 1 -- 172.21.15.18:0/3807948379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98840b5260 msgr2=0x7f98841e4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f9888ccd640 1 --2- 172.21.15.18:0/3807948379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98840b5260 0x7f98841e4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f9888ccd640 1 -- 172.21.15.18:0/3807948379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98841e5c10 con 0x7f98840b5670 2024-09-21T07:11:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f98894ce640 1 --2- 172.21.15.18:0/3807948379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98840b5260 0x7f98841e4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.222+0000 7f9888ccd640 1 --2- 172.21.15.18:0/3807948379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98840b5670 0x7f9884153a70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f987400e7c0 tx=0x7f987400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.223+0000 7f9879ffb640 1 -- 172.21.15.18:0/3807948379 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987400ccc0 con 0x7f98840b5670 2024-09-21T07:11:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.223+0000 7f9879ffb640 1 -- 172.21.15.18:0/3807948379 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f987400ee70 con 0x7f98840b5670 2024-09-21T07:11:40.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.223+0000 7f988b732640 1 -- 172.21.15.18:0/3807948379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98840b1c90 con 0x7f98840b5670 2024-09-21T07:11:40.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.223+0000 7f9879ffb640 1 -- 172.21.15.18:0/3807948379 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874010690 con 0x7f98840b5670 2024-09-21T07:11:40.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.223+0000 7f988b732640 1 -- 172.21.15.18:0/3807948379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98840aec90 con 0x7f98840b5670 2024-09-21T07:11:40.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.224+0000 7f988b732640 1 -- 172.21.15.18:0/3807948379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9884153fb0 con 0x7f98840b5670 2024-09-21T07:11:40.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.225+0000 7f9879ffb640 1 -- 172.21.15.18:0/3807948379 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f9874010830 con 0x7f98840b5670 2024-09-21T07:11:40.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.225+0000 7f9879ffb640 1 --2- 172.21.15.18:0/3807948379 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9868078d40 0x7f986807b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.225+0000 7f9879ffb640 1 -- 172.21.15.18:0/3807948379 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f987409bae0 con 0x7f98840b5670 2024-09-21T07:11:40.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.225+0000 7f98894ce640 1 --2- 172.21.15.18:0/3807948379 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9868078d40 0x7f986807b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.226+0000 7f98894ce640 1 --2- 172.21.15.18:0/3807948379 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9868078d40 0x7f986807b250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9880034000 tx=0x7f9880004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:40.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.230+0000 7f9879ffb640 1 -- 172.21.15.18:0/3807948379 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9884153fb0 con 0x7f98840b5670 2024-09-21T07:11:40.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.419+0000 7f988b732640 1 -- 172.21.15.18:0/3807948379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f988406d700 con 0x7f98840b5670 2024-09-21T07:11:40.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.420+0000 7f9879ffb640 1 -- 172.21.15.18:0/3807948379 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16705 (secure 0 0 0) 0x7f9874063540 con 0x7f98840b5670 2024-09-21T07:11:40.422 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:40.422 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":32,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:11:25.200034+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:11:21.656195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T07:11:22.531227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:40.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.423+0000 7f988b732640 1 -- 172.21.15.18:0/3807948379 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9868078d40 msgr2=0x7f986807b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.423+0000 7f988b732640 1 --2- 172.21.15.18:0/3807948379 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9868078d40 0x7f986807b250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9880034000 tx=0x7f9880004730 comp rx=0 tx=0).stop 2024-09-21T07:11:40.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.423+0000 7f988b732640 1 -- 172.21.15.18:0/3807948379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98840b5670 msgr2=0x7f9884153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.423+0000 7f988b732640 1 --2- 172.21.15.18:0/3807948379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98840b5670 0x7f9884153a70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f987400e7c0 tx=0x7f987400ec80 comp rx=0 tx=0).stop 2024-09-21T07:11:40.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.423+0000 7f988b732640 1 -- 172.21.15.18:0/3807948379 shutdown_connections 2024-09-21T07:11:40.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.423+0000 7f988b732640 1 --2- 172.21.15.18:0/3807948379 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9868078d40 0x7f986807b250 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.423+0000 7f988b732640 1 --2- 172.21.15.18:0/3807948379 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f988415c810 0x7f988415bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.423+0000 7f988b732640 1 --2- 172.21.15.18:0/3807948379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98840b5670 0x7f9884153a70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.423+0000 7f988b732640 1 --2- 172.21.15.18:0/3807948379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98840b5260 0x7f98841e4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.423+0000 7f988b732640 1 -- 172.21.15.18:0/3807948379 >> 172.21.15.18:0/3807948379 conn(0x7f98840b3a40 msgr2=0x7f98840b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:40.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.423+0000 7f988b732640 1 -- 172.21.15.18:0/3807948379 shutdown_connections 2024-09-21T07:11:40.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.423+0000 7f988b732640 1 -- 172.21.15.18:0/3807948379 wait complete. 2024-09-21T07:11:40.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:11:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.553+0000 7fc65cf0b640 1 -- 172.21.15.18:0/367823705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65815ef50 msgr2=0x7fc65815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.553+0000 7fc65cf0b640 1 --2- 172.21.15.18:0/367823705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65815ef50 0x7fc65815c520 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc648009830 tx=0x7fc64802a510 comp rx=0 tx=0).stop 2024-09-21T07:11:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.553+0000 7fc65cf0b640 1 -- 172.21.15.18:0/367823705 shutdown_connections 2024-09-21T07:11:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.553+0000 7fc65cf0b640 1 --2- 172.21.15.18:0/367823705 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc658162a40 0x7fc658162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.553+0000 7fc65cf0b640 1 --2- 172.21.15.18:0/367823705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65815ef50 0x7fc65815c520 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.553+0000 7fc65cf0b640 1 -- 172.21.15.18:0/367823705 >> 172.21.15.18:0/367823705 conn(0x7fc658073f30 msgr2=0x7fc6580b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.553+0000 7fc65cf0b640 1 -- 172.21.15.18:0/367823705 shutdown_connections 2024-09-21T07:11:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.553+0000 7fc65cf0b640 1 -- 172.21.15.18:0/367823705 wait complete. 2024-09-21T07:11:40.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.555+0000 7fc65cf0b640 1 Processor -- start 2024-09-21T07:11:40.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.555+0000 7fc65cf0b640 1 -- start start 2024-09-21T07:11:40.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.556+0000 7fc65cf0b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc6580cef70 0x7fc658155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.556+0000 7fc65cf0b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65815ef50 0x7fc658151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.556+0000 7fc65cf0b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc658162a40 0x7fc6581538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.556+0000 7fc65cf0b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc6580d11a0 con 0x7fc658162a40 2024-09-21T07:11:40.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.556+0000 7fc65cf0b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc6580d1020 con 0x7fc65815ef50 2024-09-21T07:11:40.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.556+0000 7fc65cf0b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fc6580d1320 con 0x7fc6580cef70 2024-09-21T07:11:40.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.556+0000 7fc656d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc658162a40 0x7fc6581538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.556+0000 7fc656d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc658162a40 0x7fc6581538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42958/0 (socket says 172.21.15.18:42958) 2024-09-21T07:11:40.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.556+0000 7fc656d9d640 1 -- 172.21.15.18:0/654180794 learned_addr learned my addr 172.21.15.18:0/654180794 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:40.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.556+0000 7fc65659c640 1 --2- 172.21.15.18:0/654180794 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc6580cef70 0x7fc658155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.556+0000 7fc655d9b640 1 --2- 172.21.15.18:0/654180794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65815ef50 0x7fc658151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.557+0000 7fc656d9d640 1 -- 172.21.15.18:0/654180794 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc6580cef70 msgr2=0x7fc658155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.557+0000 7fc656d9d640 1 --2- 172.21.15.18:0/654180794 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc6580cef70 0x7fc658155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.557+0000 7fc656d9d640 1 -- 172.21.15.18:0/654180794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65815ef50 msgr2=0x7fc658151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.557+0000 7fc656d9d640 1 --2- 172.21.15.18:0/654180794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65815ef50 0x7fc658151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.557+0000 7fc656d9d640 1 -- 172.21.15.18:0/654180794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc658154380 con 0x7fc658162a40 2024-09-21T07:11:40.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.557+0000 7fc656d9d640 1 --2- 172.21.15.18:0/654180794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc658162a40 0x7fc6581538e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc65000ec20 tx=0x7fc65000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:40.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.557+0000 7fc646ffd640 1 -- 172.21.15.18:0/654180794 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc650010630 con 0x7fc658162a40 2024-09-21T07:11:40.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.557+0000 7fc646ffd640 1 -- 172.21.15.18:0/654180794 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6500107d0 con 0x7fc658162a40 2024-09-21T07:11:40.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.557+0000 7fc65cf0b640 1 -- 172.21.15.18:0/654180794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc658154660 con 0x7fc658162a40 2024-09-21T07:11:40.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.557+0000 7fc646ffd640 1 -- 172.21.15.18:0/654180794 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc650010c20 con 0x7fc658162a40 2024-09-21T07:11:40.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.557+0000 7fc65cf0b640 1 -- 172.21.15.18:0/654180794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc658154c20 con 0x7fc658162a40 2024-09-21T07:11:40.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.558+0000 7fc65cf0b640 1 -- 172.21.15.18:0/654180794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6580d17d0 con 0x7fc658162a40 2024-09-21T07:11:40.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.559+0000 7fc646ffd640 1 -- 172.21.15.18:0/654180794 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fc650021440 con 0x7fc658162a40 2024-09-21T07:11:40.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.560+0000 7fc646ffd640 1 --2- 172.21.15.18:0/654180794 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc638078d40 0x7fc63807b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.560+0000 7fc646ffd640 1 -- 172.21.15.18:0/654180794 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc65009bfa0 con 0x7fc658162a40 2024-09-21T07:11:40.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.560+0000 7fc65659c640 1 --2- 172.21.15.18:0/654180794 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc638078d40 0x7fc63807b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.560+0000 7fc65659c640 1 --2- 172.21.15.18:0/654180794 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc638078d40 0x7fc63807b250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc648034000 tx=0x7fc648004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:40.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.564+0000 7fc646ffd640 1 -- 172.21.15.18:0/654180794 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc650063960 con 0x7fc658162a40 2024-09-21T07:11:40.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.791+0000 7fc65cf0b640 1 -- 172.21.15.18:0/654180794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc6580b4f50 con 0x7fc658162a40 2024-09-21T07:11:40.793 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-21T07:11:40.792+0000 7fa1c73a1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:11:40.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.793+0000 7fc646ffd640 1 -- 172.21.15.18:0/654180794 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7fc650068390 con 0x7fc658162a40 2024-09-21T07:11:40.795 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:11:40.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.796+0000 7fc65cf0b640 1 -- 172.21.15.18:0/654180794 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc638078d40 msgr2=0x7fc63807b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.796+0000 7fc65cf0b640 1 --2- 172.21.15.18:0/654180794 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc638078d40 0x7fc63807b250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc648034000 tx=0x7fc648004730 comp rx=0 tx=0).stop 2024-09-21T07:11:40.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.796+0000 7fc65cf0b640 1 -- 172.21.15.18:0/654180794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc658162a40 msgr2=0x7fc6581538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.796+0000 7fc65cf0b640 1 --2- 172.21.15.18:0/654180794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc658162a40 0x7fc6581538e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc65000ec20 tx=0x7fc65000c6a0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.796+0000 7fc65cf0b640 1 -- 172.21.15.18:0/654180794 shutdown_connections 2024-09-21T07:11:40.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.796+0000 7fc65cf0b640 1 --2- 172.21.15.18:0/654180794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc658162a40 0x7fc6581538e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.796+0000 7fc65cf0b640 1 --2- 172.21.15.18:0/654180794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc65815ef50 0x7fc658151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.796+0000 7fc65cf0b640 1 --2- 172.21.15.18:0/654180794 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc638078d40 0x7fc63807b250 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.796+0000 7fc65cf0b640 1 --2- 172.21.15.18:0/654180794 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc6580cef70 0x7fc658155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.796+0000 7fc65cf0b640 1 -- 172.21.15.18:0/654180794 >> 172.21.15.18:0/654180794 conn(0x7fc658073f30 msgr2=0x7fc6580b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:40.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.796+0000 7fc65cf0b640 1 -- 172.21.15.18:0/654180794 shutdown_connections 2024-09-21T07:11:40.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.796+0000 7fc65cf0b640 1 -- 172.21.15.18:0/654180794 wait complete. 2024-09-21T07:11:40.809 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:11:40.869 INFO:tasks.ceph.mds.d.smithi049.stdout:starting mds.d at 2024-09-21T07:11:40.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.928+0000 7feeaa67e640 1 -- 172.21.15.18:0/3041897108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea40d15a0 msgr2=0x7feea40d2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.928+0000 7feeaa67e640 1 --2- 172.21.15.18:0/3041897108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea40d15a0 0x7feea40d2a30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fee9c005fd0 tx=0x7fee9c02aa90 comp rx=0 tx=0).stop 2024-09-21T07:11:40.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.928+0000 7feeaa67e640 1 -- 172.21.15.18:0/3041897108 shutdown_connections 2024-09-21T07:11:40.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.928+0000 7feeaa67e640 1 --2- 172.21.15.18:0/3041897108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea40d15a0 0x7feea40d2a30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.928+0000 7feeaa67e640 1 --2- 172.21.15.18:0/3041897108 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7feea415ea10 0x7feea40d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.928+0000 7feeaa67e640 1 -- 172.21.15.18:0/3041897108 >> 172.21.15.18:0/3041897108 conn(0x7feea4073f60 msgr2=0x7feea40b6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:40.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.928+0000 7feeaa67e640 1 -- 172.21.15.18:0/3041897108 shutdown_connections 2024-09-21T07:11:40.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.928+0000 7feeaa67e640 1 -- 172.21.15.18:0/3041897108 wait complete. 2024-09-21T07:11:40.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.929+0000 7feeaa67e640 1 Processor -- start 2024-09-21T07:11:40.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.930+0000 7feeaa67e640 1 -- start start 2024-09-21T07:11:40.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.931+0000 7feeaa67e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feea40b7a60 0x7feea40c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.931+0000 7feeaa67e640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7feea40d15a0 0x7feea4150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.931+0000 7feeaa67e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea415ea10 0x7feea41f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.931+0000 7feeaa67e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feea40d3470 con 0x7feea415ea10 2024-09-21T07:11:40.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.931+0000 7feeaa67e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7feea40d32f0 con 0x7feea40b7a60 2024-09-21T07:11:40.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.931+0000 7feeaa67e640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7feea40d35f0 con 0x7feea40d15a0 2024-09-21T07:11:40.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.931+0000 7feea8c1b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea415ea10 0x7feea41f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.931+0000 7feea3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feea40b7a60 0x7feea40c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.931+0000 7feea8c1b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea415ea10 0x7feea41f5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42978/0 (socket says 172.21.15.18:42978) 2024-09-21T07:11:40.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.931+0000 7feea37fe640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7feea40d15a0 0x7feea4150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.931+0000 7feea8c1b640 1 -- 172.21.15.18:0/3996010400 learned_addr learned my addr 172.21.15.18:0/3996010400 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:40.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.931+0000 7feea8c1b640 1 -- 172.21.15.18:0/3996010400 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7feea40d15a0 msgr2=0x7feea4150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.931+0000 7feea8c1b640 1 --2- 172.21.15.18:0/3996010400 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7feea40d15a0 0x7feea4150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.931+0000 7feea8c1b640 1 -- 172.21.15.18:0/3996010400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feea40b7a60 msgr2=0x7feea40c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:40.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.931+0000 7feea8c1b640 1 --2- 172.21.15.18:0/3996010400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feea40b7a60 0x7feea40c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:40.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.932+0000 7feea8c1b640 1 -- 172.21.15.18:0/3996010400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea40c8800 con 0x7feea415ea10 2024-09-21T07:11:40.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.932+0000 7feea8c1b640 1 --2- 172.21.15.18:0/3996010400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea415ea10 0x7feea41f5e60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009d90 tx=0x7fee9c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:40.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.932+0000 7feea0ff9640 1 -- 172.21.15.18:0/3996010400 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c044070 con 0x7feea415ea10 2024-09-21T07:11:40.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.932+0000 7feea0ff9640 1 -- 172.21.15.18:0/3996010400 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee9c004040 con 0x7feea415ea10 2024-09-21T07:11:40.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.932+0000 7feeaa67e640 1 -- 172.21.15.18:0/3996010400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea40c8ae0 con 0x7feea415ea10 2024-09-21T07:11:40.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.932+0000 7feea0ff9640 1 -- 172.21.15.18:0/3996010400 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c004430 con 0x7feea415ea10 2024-09-21T07:11:40.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.932+0000 7feeaa67e640 1 -- 172.21.15.18:0/3996010400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea40c90a0 con 0x7feea415ea10 2024-09-21T07:11:40.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.933+0000 7feeaa67e640 1 -- 172.21.15.18:0/3996010400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea40d2a30 con 0x7feea415ea10 2024-09-21T07:11:40.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.934+0000 7feea0ff9640 1 -- 172.21.15.18:0/3996010400 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fee9c047070 con 0x7feea415ea10 2024-09-21T07:11:40.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.934+0000 7feea0ff9640 1 --2- 172.21.15.18:0/3996010400 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee90078d40 0x7fee9007b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:40.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.934+0000 7feea0ff9640 1 -- 172.21.15.18:0/3996010400 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fee9c0bbed0 con 0x7feea415ea10 2024-09-21T07:11:40.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.934+0000 7feea3fff640 1 --2- 172.21.15.18:0/3996010400 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee90078d40 0x7fee9007b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:40.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.935+0000 7feea3fff640 1 --2- 172.21.15.18:0/3996010400 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee90078d40 0x7fee9007b250 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fee94001720 tx=0x7fee94009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:40.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:40.939+0000 7feea0ff9640 1 -- 172.21.15.18:0/3996010400 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fee9c032030 con 0x7feea415ea10 2024-09-21T07:11:41.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.168+0000 7feeaa67e640 1 -- 172.21.15.18:0/3996010400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7feea40c8590 con 0x7feea415ea10 2024-09-21T07:11:41.391 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:11:41.393 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:11:41.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.795+0000 7feea0ff9640 1 -- 172.21.15.18:0/3996010400 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7fee9c083980 con 0x7feea415ea10 2024-09-21T07:11:41.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.798+0000 7feeaa67e640 1 -- 172.21.15.18:0/3996010400 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee90078d40 msgr2=0x7fee9007b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:41.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.798+0000 7feeaa67e640 1 --2- 172.21.15.18:0/3996010400 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee90078d40 0x7fee9007b250 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fee94001720 tx=0x7fee94009040 comp rx=0 tx=0).stop 2024-09-21T07:11:41.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.798+0000 7feeaa67e640 1 -- 172.21.15.18:0/3996010400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea415ea10 msgr2=0x7feea41f5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:41.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.798+0000 7feeaa67e640 1 --2- 172.21.15.18:0/3996010400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea415ea10 0x7feea41f5e60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009d90 tx=0x7fee9c003ce0 comp rx=0 tx=0).stop 2024-09-21T07:11:41.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.798+0000 7feeaa67e640 1 -- 172.21.15.18:0/3996010400 shutdown_connections 2024-09-21T07:11:41.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.798+0000 7feeaa67e640 1 --2- 172.21.15.18:0/3996010400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea415ea10 0x7feea41f5e60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:41.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.798+0000 7feeaa67e640 1 --2- 172.21.15.18:0/3996010400 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee90078d40 0x7fee9007b250 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:41.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.798+0000 7feeaa67e640 1 --2- 172.21.15.18:0/3996010400 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7feea40d15a0 0x7feea4150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:41.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.798+0000 7feeaa67e640 1 --2- 172.21.15.18:0/3996010400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feea40b7a60 0x7feea40c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.798+0000 7feeaa67e640 1 -- 172.21.15.18:0/3996010400 >> 172.21.15.18:0/3996010400 conn(0x7feea4073f60 msgr2=0x7feea40d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.798+0000 7feeaa67e640 1 -- 172.21.15.18:0/3996010400 shutdown_connections 2024-09-21T07:11:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.798+0000 7feeaa67e640 1 -- 172.21.15.18:0/3996010400 wait complete. 2024-09-21T07:11:41.813 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:11:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.938+0000 7fcfd709b640 1 -- 172.21.15.18:0/3845283073 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcfd015f980 msgr2=0x7fcfd0151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.938+0000 7fcfd709b640 1 --2- 172.21.15.18:0/3845283073 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcfd015f980 0x7fcfd0151de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8005fd0 tx=0x7fcfc802aa90 comp rx=0 tx=0).stop 2024-09-21T07:11:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.938+0000 7fcfd709b640 1 -- 172.21.15.18:0/3845283073 shutdown_connections 2024-09-21T07:11:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.938+0000 7fcfd709b640 1 --2- 172.21.15.18:0/3845283073 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcfd015f980 0x7fcfd0151de0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.938+0000 7fcfd709b640 1 --2- 172.21.15.18:0/3845283073 >> v2:172.21.15.49:3300/0 conn(0x7fcfd0074240 0x7fcfd015f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.938+0000 7fcfd709b640 1 -- 172.21.15.18:0/3845283073 >> 172.21.15.18:0/3845283073 conn(0x7fcfd00d0d70 msgr2=0x7fcfd00d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.938+0000 7fcfd709b640 1 -- 172.21.15.18:0/3845283073 shutdown_connections 2024-09-21T07:11:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.938+0000 7fcfd709b640 1 -- 172.21.15.18:0/3845283073 wait complete. 2024-09-21T07:11:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.940+0000 7fcfd709b640 1 Processor -- start 2024-09-21T07:11:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.940+0000 7fcfd709b640 1 -- start start 2024-09-21T07:11:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.941+0000 7fcfd709b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcfd00d0050 0x7fcfd01f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.941+0000 7fcfd709b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfd015f980 0x7fcfd014c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.941+0000 7fcfd709b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd0155190 0x7fcfd01555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.941+0000 7fcfd709b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd0152760 con 0x7fcfd0155190 2024-09-21T07:11:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.941+0000 7fcfd709b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd01525e0 con 0x7fcfd015f980 2024-09-21T07:11:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.941+0000 7fcfd709b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd01528e0 con 0x7fcfd00d0050 2024-09-21T07:11:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.941+0000 7fcfd5638640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd0155190 0x7fcfd01555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.941+0000 7fcfd5638640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd0155190 0x7fcfd01555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42988/0 (socket says 172.21.15.18:42988) 2024-09-21T07:11:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.941+0000 7fcfd5638640 1 -- 172.21.15.18:0/2181919022 learned_addr learned my addr 172.21.15.18:0/2181919022 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.942+0000 7fcfd4e37640 1 --2- 172.21.15.18:0/2181919022 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcfd00d0050 0x7fcfd01f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.942+0000 7fcfcffff640 1 --2- 172.21.15.18:0/2181919022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfd015f980 0x7fcfd014c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.942+0000 7fcfd5638640 1 -- 172.21.15.18:0/2181919022 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcfd00d0050 msgr2=0x7fcfd01f21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.942+0000 7fcfd5638640 1 --2- 172.21.15.18:0/2181919022 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcfd00d0050 0x7fcfd01f21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.942+0000 7fcfd5638640 1 -- 172.21.15.18:0/2181919022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfd015f980 msgr2=0x7fcfd014c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.942+0000 7fcfd5638640 1 --2- 172.21.15.18:0/2181919022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfd015f980 0x7fcfd014c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.942+0000 7fcfd5638640 1 -- 172.21.15.18:0/2181919022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd0155ae0 con 0x7fcfd0155190 2024-09-21T07:11:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.942+0000 7fcfd5638640 1 --2- 172.21.15.18:0/2181919022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd0155190 0x7fcfd01555a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009bf0 tx=0x7fcfc8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.942+0000 7fcfcd7fa640 1 -- 172.21.15.18:0/2181919022 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8046070 con 0x7fcfd0155190 2024-09-21T07:11:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.942+0000 7fcfd709b640 1 -- 172.21.15.18:0/2181919022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd01f26e0 con 0x7fcfd0155190 2024-09-21T07:11:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.942+0000 7fcfcd7fa640 1 -- 172.21.15.18:0/2181919022 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfc8030ea0 con 0x7fcfd0155190 2024-09-21T07:11:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.942+0000 7fcfcd7fa640 1 -- 172.21.15.18:0/2181919022 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8003e60 con 0x7fcfd0155190 2024-09-21T07:11:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.942+0000 7fcfd709b640 1 -- 172.21.15.18:0/2181919022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd01f2eb0 con 0x7fcfd0155190 2024-09-21T07:11:41.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.943+0000 7fcfd709b640 1 -- 172.21.15.18:0/2181919022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd015f440 con 0x7fcfd0155190 2024-09-21T07:11:41.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.944+0000 7fcfcd7fa640 1 -- 172.21.15.18:0/2181919022 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fcfc8049070 con 0x7fcfd0155190 2024-09-21T07:11:41.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.945+0000 7fcfcd7fa640 1 --2- 172.21.15.18:0/2181919022 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfb4078d40 0x7fcfb407b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:41.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.945+0000 7fcfcd7fa640 1 -- 172.21.15.18:0/2181919022 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fcfc80bdeb0 con 0x7fcfd0155190 2024-09-21T07:11:41.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.945+0000 7fcfd4e37640 1 --2- 172.21.15.18:0/2181919022 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfb4078d40 0x7fcfb407b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:41.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.946+0000 7fcfd4e37640 1 --2- 172.21.15.18:0/2181919022 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfb4078d40 0x7fcfb407b250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4007fd0 tx=0x7fcfc4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:41.950+0000 7fcfcd7fa640 1 -- 172.21.15.18:0/2181919022 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcfd0155ae0 con 0x7fcfd0155190 2024-09-21T07:11:42.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.137+0000 7fcfd709b640 1 -- 172.21.15.18:0/2181919022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcfd01f2960 con 0x7fcfd0155190 2024-09-21T07:11:42.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.796+0000 7fcfcd7fa640 1 -- 172.21.15.18:0/2181919022 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) ==== 181+0+0 (secure 0 0 0) 0x7fcfc8032030 con 0x7fcfd0155190 2024-09-21T07:11:42.798 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:11:42.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.801+0000 7fcfd709b640 1 -- 172.21.15.18:0/2181919022 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfb4078d40 msgr2=0x7fcfb407b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:42.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.801+0000 7fcfd709b640 1 --2- 172.21.15.18:0/2181919022 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfb4078d40 0x7fcfb407b250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4007fd0 tx=0x7fcfc4009040 comp rx=0 tx=0).stop 2024-09-21T07:11:42.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.802+0000 7fcfd709b640 1 -- 172.21.15.18:0/2181919022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd0155190 msgr2=0x7fcfd01555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:42.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.802+0000 7fcfd709b640 1 --2- 172.21.15.18:0/2181919022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd0155190 0x7fcfd01555a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009bf0 tx=0x7fcfc8004270 comp rx=0 tx=0).stop 2024-09-21T07:11:42.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.802+0000 7fcfd709b640 1 -- 172.21.15.18:0/2181919022 shutdown_connections 2024-09-21T07:11:42.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.802+0000 7fcfd709b640 1 --2- 172.21.15.18:0/2181919022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd0155190 0x7fcfd01555a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.802+0000 7fcfd709b640 1 --2- 172.21.15.18:0/2181919022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfd015f980 0x7fcfd014c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.802+0000 7fcfd709b640 1 --2- 172.21.15.18:0/2181919022 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfb4078d40 0x7fcfb407b250 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.802+0000 7fcfd709b640 1 --2- 172.21.15.18:0/2181919022 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcfd00d0050 0x7fcfd01f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.802+0000 7fcfd709b640 1 -- 172.21.15.18:0/2181919022 >> 172.21.15.18:0/2181919022 conn(0x7fcfd00d0d70 msgr2=0x7fcfd015d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:42.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.802+0000 7fcfd709b640 1 -- 172.21.15.18:0/2181919022 shutdown_connections 2024-09-21T07:11:42.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.802+0000 7fcfd709b640 1 -- 172.21.15.18:0/2181919022 wait complete. 2024-09-21T07:11:42.819 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:11:42.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.948+0000 7ff91a24d640 1 -- 172.21.15.18:0/1787078244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff900003a00 msgr2=0x7ff900003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:42.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.948+0000 7ff91a24d640 1 --2- 172.21.15.18:0/1787078244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff900003a00 0x7ff900003e70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff904009b50 tx=0x7ff900005830 comp rx=0 tx=0).stop 2024-09-21T07:11:42.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.948+0000 7ff913fff640 1 -- 172.21.15.18:0/1787078244 reap_dead start 2024-09-21T07:11:42.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.948+0000 7ff91a24d640 1 -- 172.21.15.18:0/1787078244 shutdown_connections 2024-09-21T07:11:42.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.948+0000 7ff91a24d640 1 -- 172.21.15.18:0/1787078244 >> 172.21.15.18:0/1787078244 conn(0x7ff914073f30 msgr2=0x7ff9140b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:42.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.948+0000 7ff91a24d640 1 -- 172.21.15.18:0/1787078244 shutdown_connections 2024-09-21T07:11:42.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.948+0000 7ff91a24d640 1 -- 172.21.15.18:0/1787078244 wait complete. 2024-09-21T07:11:42.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.950+0000 7ff91a24d640 1 Processor -- start 2024-09-21T07:11:42.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.950+0000 7ff91a24d640 1 -- start start 2024-09-21T07:11:42.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff91a24d640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff900003a00 0x7ff9140b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:42.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff91a24d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9141f51d0 0x7ff9140b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:42.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff91a24d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9141f55e0 0x7ff9140b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:42.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff91a24d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff91415c6a0 con 0x7ff9141f55e0 2024-09-21T07:11:42.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff91a24d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff91415c520 con 0x7ff9141f51d0 2024-09-21T07:11:42.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff91a24d640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7ff91415c820 con 0x7ff900003a00 2024-09-21T07:11:42.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff913fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9141f55e0 0x7ff9140b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:42.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff913fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9141f55e0 0x7ff9140b90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43004/0 (socket says 172.21.15.18:43004) 2024-09-21T07:11:42.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff913fff640 1 -- 172.21.15.18:0/1646861609 learned_addr learned my addr 172.21.15.18:0/1646861609 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:42.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff912ffd640 1 --2- 172.21.15.18:0/1646861609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9141f51d0 0x7ff9140b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:42.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff9137fe640 1 --2- 172.21.15.18:0/1646861609 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff900003a00 0x7ff9140b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:42.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff913fff640 1 -- 172.21.15.18:0/1646861609 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff900003a00 msgr2=0x7ff9140b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:42.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff913fff640 1 --2- 172.21.15.18:0/1646861609 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff900003a00 0x7ff9140b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff913fff640 1 -- 172.21.15.18:0/1646861609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9141f51d0 msgr2=0x7ff9140b8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:42.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff913fff640 1 --2- 172.21.15.18:0/1646861609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9141f51d0 0x7ff9140b8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:42.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff913fff640 1 -- 172.21.15.18:0/1646861609 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9140b2e40 con 0x7ff9141f55e0 2024-09-21T07:11:42.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff912ffd640 1 --2- 172.21.15.18:0/1646861609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9141f51d0 0x7ff9140b8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:42.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff913fff640 1 --2- 172.21.15.18:0/1646861609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9141f55e0 0x7ff9140b90b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff9140b4140 tx=0x7ff90c0064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:42.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.952+0000 7ff90bfff640 1 -- 172.21.15.18:0/1646861609 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c015070 con 0x7ff9141f55e0 2024-09-21T07:11:42.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.953+0000 7ff90bfff640 1 -- 172.21.15.18:0/1646861609 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff90c011a00 con 0x7ff9141f55e0 2024-09-21T07:11:42.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.953+0000 7ff91a24d640 1 -- 172.21.15.18:0/1646861609 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9140b9d30 con 0x7ff9141f55e0 2024-09-21T07:11:42.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.953+0000 7ff90bfff640 1 -- 172.21.15.18:0/1646861609 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c011e50 con 0x7ff9141f55e0 2024-09-21T07:11:42.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.953+0000 7ff91a24d640 1 -- 172.21.15.18:0/1646861609 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9141f60e0 con 0x7ff9141f55e0 2024-09-21T07:11:42.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.954+0000 7ff91a24d640 1 -- 172.21.15.18:0/1646861609 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff91414e360 con 0x7ff9141f55e0 2024-09-21T07:11:42.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.955+0000 7ff90bfff640 1 -- 172.21.15.18:0/1646861609 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7ff90c010420 con 0x7ff9141f55e0 2024-09-21T07:11:42.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.955+0000 7ff90bfff640 1 --2- 172.21.15.18:0/1646861609 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff8f4078ee0 0x7ff8f407b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:42.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.955+0000 7ff90bfff640 1 -- 172.21.15.18:0/1646861609 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5357+0+0 (secure 0 0 0) 0x7ff90c09bd40 con 0x7ff9141f55e0 2024-09-21T07:11:42.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.955+0000 7ff9137fe640 1 --2- 172.21.15.18:0/1646861609 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff8f4078ee0 0x7ff8f407b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:42.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.956+0000 7ff9137fe640 1 --2- 172.21.15.18:0/1646861609 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff8f4078ee0 0x7ff8f407b3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff904009b50 tx=0x7ff90402d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:42.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:42.960+0000 7ff90bfff640 1 -- 172.21.15.18:0/1646861609 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff91414e360 con 0x7ff9141f55e0 2024-09-21T07:11:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.150+0000 7ff91a24d640 1 -- 172.21.15.18:0/1646861609 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff91415e9d0 con 0x7ff9141f55e0 2024-09-21T07:11:43.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.798+0000 7ff90bfff640 1 -- 172.21.15.18:0/1646861609 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) ==== 169+0+0 (secure 0 0 0) 0x7ff90c063fd0 con 0x7ff9141f55e0 2024-09-21T07:11:43.800 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-21T07:11:43.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.802+0000 7ff91a24d640 1 -- 172.21.15.18:0/1646861609 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff8f4078ee0 msgr2=0x7ff8f407b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:43.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.802+0000 7ff91a24d640 1 --2- 172.21.15.18:0/1646861609 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff8f4078ee0 0x7ff8f407b3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff904009b50 tx=0x7ff90402d040 comp rx=0 tx=0).stop 2024-09-21T07:11:43.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.802+0000 7ff91a24d640 1 -- 172.21.15.18:0/1646861609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9141f55e0 msgr2=0x7ff9140b90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:43.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.802+0000 7ff91a24d640 1 --2- 172.21.15.18:0/1646861609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9141f55e0 0x7ff9140b90b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff9140b4140 tx=0x7ff90c0064f0 comp rx=0 tx=0).stop 2024-09-21T07:11:43.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.803+0000 7ff91a24d640 1 -- 172.21.15.18:0/1646861609 shutdown_connections 2024-09-21T07:11:43.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.803+0000 7ff91a24d640 1 --2- 172.21.15.18:0/1646861609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9141f55e0 0x7ff9140b90b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:43.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.803+0000 7ff91a24d640 1 --2- 172.21.15.18:0/1646861609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9141f51d0 0x7ff9140b8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:43.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.803+0000 7ff91a24d640 1 --2- 172.21.15.18:0/1646861609 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff8f4078ee0 0x7ff8f407b3f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:43.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.803+0000 7ff91a24d640 1 --2- 172.21.15.18:0/1646861609 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff900003a00 0x7ff9140b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:43.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.803+0000 7ff91a24d640 1 -- 172.21.15.18:0/1646861609 >> 172.21.15.18:0/1646861609 conn(0x7ff914073f30 msgr2=0x7ff9140d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:43.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.803+0000 7ff91a24d640 1 -- 172.21.15.18:0/1646861609 shutdown_connections 2024-09-21T07:11:43.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.803+0000 7ff91a24d640 1 -- 172.21.15.18:0/1646861609 wait complete. 2024-09-21T07:11:43.820 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:11:43.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.943+0000 7fbbffa7e640 1 -- 172.21.15.18:0/2745540344 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbbf815ef50 msgr2=0x7fbbf815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:43.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.943+0000 7fbbffa7e640 1 --2- 172.21.15.18:0/2745540344 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbbf815ef50 0x7fbbf815c520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009830 tx=0x7fbbf402a4a0 comp rx=0 tx=0).stop 2024-09-21T07:11:43.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.943+0000 7fbbffa7e640 1 -- 172.21.15.18:0/2745540344 shutdown_connections 2024-09-21T07:11:43.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.943+0000 7fbbffa7e640 1 --2- 172.21.15.18:0/2745540344 >> v2:172.21.15.49:3300/0 conn(0x7fbbf8162a40 0x7fbbf8162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:43.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.943+0000 7fbbffa7e640 1 --2- 172.21.15.18:0/2745540344 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbbf815ef50 0x7fbbf815c520 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:43.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.943+0000 7fbbffa7e640 1 -- 172.21.15.18:0/2745540344 >> 172.21.15.18:0/2745540344 conn(0x7fbbf8073f30 msgr2=0x7fbbf80b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:43.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.943+0000 7fbbffa7e640 1 -- 172.21.15.18:0/2745540344 shutdown_connections 2024-09-21T07:11:43.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.943+0000 7fbbffa7e640 1 -- 172.21.15.18:0/2745540344 wait complete. 2024-09-21T07:11:43.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.945+0000 7fbbffa7e640 1 Processor -- start 2024-09-21T07:11:43.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.945+0000 7fbbffa7e640 1 -- start start 2024-09-21T07:11:43.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbffa7e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf80cef70 0x7fbbf80abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:43.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbffa7e640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbbf815ef50 0x7fbbf815aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:43.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbffa7e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf8162a40 0x7fbbf80b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:43.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbffa7e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf80d11a0 con 0x7fbbf80cef70 2024-09-21T07:11:43.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbffa7e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf80d1020 con 0x7fbbf8162a40 2024-09-21T07:11:43.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbffa7e640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf80d1320 con 0x7fbbf815ef50 2024-09-21T07:11:43.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbfd81a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf80cef70 0x7fbbf80abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:43.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbfd81a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf80cef70 0x7fbbf80abbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43014/0 (socket says 172.21.15.18:43014) 2024-09-21T07:11:43.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbfd81a640 1 -- 172.21.15.18:0/1918782079 learned_addr learned my addr 172.21.15.18:0/1918782079 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:43.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbfd019640 1 --2- 172.21.15.18:0/1918782079 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbbf815ef50 0x7fbbf815aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:43.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbfe01b640 1 --2- 172.21.15.18:0/1918782079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf8162a40 0x7fbbf80b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:43.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbfd81a640 1 -- 172.21.15.18:0/1918782079 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbbf815ef50 msgr2=0x7fbbf815aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:43.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbfd81a640 1 --2- 172.21.15.18:0/1918782079 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbbf815ef50 0x7fbbf815aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:43.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbfd81a640 1 -- 172.21.15.18:0/1918782079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf8162a40 msgr2=0x7fbbf80b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:43.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbfd81a640 1 --2- 172.21.15.18:0/1918782079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf8162a40 0x7fbbf80b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:43.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbfd81a640 1 -- 172.21.15.18:0/1918782079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf81f68c0 con 0x7fbbf80cef70 2024-09-21T07:11:43.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.946+0000 7fbbfd019640 1 --2- 172.21.15.18:0/1918782079 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbbf815ef50 0x7fbbf815aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:43.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.947+0000 7fbbfd81a640 1 --2- 172.21.15.18:0/1918782079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf80cef70 0x7fbbf80abbd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbbf402aa90 tx=0x7fbbf4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:43.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.947+0000 7fbbee7fc640 1 -- 172.21.15.18:0/1918782079 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4005c90 con 0x7fbbf80cef70 2024-09-21T07:11:43.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.947+0000 7fbbee7fc640 1 -- 172.21.15.18:0/1918782079 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbf4005020 con 0x7fbbf80cef70 2024-09-21T07:11:43.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.947+0000 7fbbee7fc640 1 -- 172.21.15.18:0/1918782079 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4005450 con 0x7fbbf80cef70 2024-09-21T07:11:43.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.947+0000 7fbbffa7e640 1 -- 172.21.15.18:0/1918782079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf80ccf20 con 0x7fbbf80cef70 2024-09-21T07:11:43.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.947+0000 7fbbffa7e640 1 -- 172.21.15.18:0/1918782079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf80cd4e0 con 0x7fbbf80cef70 2024-09-21T07:11:43.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.948+0000 7fbbffa7e640 1 -- 172.21.15.18:0/1918782079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf80d1800 con 0x7fbbf80cef70 2024-09-21T07:11:43.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.949+0000 7fbbee7fc640 1 -- 172.21.15.18:0/1918782079 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fbbf40317c0 con 0x7fbbf80cef70 2024-09-21T07:11:43.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.949+0000 7fbbee7fc640 1 --2- 172.21.15.18:0/1918782079 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbbdc078d70 0x7fbbdc07b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:43.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.949+0000 7fbbee7fc640 1 -- 172.21.15.18:0/1918782079 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fbbf40bbd10 con 0x7fbbf80cef70 2024-09-21T07:11:43.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.949+0000 7fbbfd019640 1 --2- 172.21.15.18:0/1918782079 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbbdc078d70 0x7fbbdc07b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:43.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.950+0000 7fbbfd019640 1 --2- 172.21.15.18:0/1918782079 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbbdc078d70 0x7fbbdc07b280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80ccca0 tx=0x7fbbe8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:43.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:43.954+0000 7fbbee7fc640 1 -- 172.21.15.18:0/1918782079 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbbf403f030 con 0x7fbbf80cef70 2024-09-21T07:11:44.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.140+0000 7fbbffa7e640 1 -- 172.21.15.18:0/1918782079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fbbf815bf20 con 0x7fbbf80cef70 2024-09-21T07:11:44.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.144+0000 7fbbee7fc640 1 -- 172.21.15.18:0/1918782079 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7fbbf4083b00 con 0x7fbbf80cef70 2024-09-21T07:11:44.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.146+0000 7fbbffa7e640 1 -- 172.21.15.18:0/1918782079 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbbdc078d70 msgr2=0x7fbbdc07b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:44.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.146+0000 7fbbffa7e640 1 --2- 172.21.15.18:0/1918782079 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbbdc078d70 0x7fbbdc07b280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80ccca0 tx=0x7fbbe8009040 comp rx=0 tx=0).stop 2024-09-21T07:11:44.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.146+0000 7fbbffa7e640 1 -- 172.21.15.18:0/1918782079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf80cef70 msgr2=0x7fbbf80abbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:44.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.146+0000 7fbbffa7e640 1 --2- 172.21.15.18:0/1918782079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf80cef70 0x7fbbf80abbd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbbf402aa90 tx=0x7fbbf4003c10 comp rx=0 tx=0).stop 2024-09-21T07:11:44.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.146+0000 7fbbffa7e640 1 -- 172.21.15.18:0/1918782079 shutdown_connections 2024-09-21T07:11:44.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.146+0000 7fbbffa7e640 1 --2- 172.21.15.18:0/1918782079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbf8162a40 0x7fbbf80b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.146+0000 7fbbffa7e640 1 --2- 172.21.15.18:0/1918782079 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbbdc078d70 0x7fbbdc07b280 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.146+0000 7fbbffa7e640 1 --2- 172.21.15.18:0/1918782079 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbbf815ef50 0x7fbbf815aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.146+0000 7fbbffa7e640 1 --2- 172.21.15.18:0/1918782079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf80cef70 0x7fbbf80abbd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.146+0000 7fbbffa7e640 1 -- 172.21.15.18:0/1918782079 >> 172.21.15.18:0/1918782079 conn(0x7fbbf8073f30 msgr2=0x7fbbf8160080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:44.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.146+0000 7fbbffa7e640 1 -- 172.21.15.18:0/1918782079 shutdown_connections 2024-09-21T07:11:44.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.146+0000 7fbbffa7e640 1 -- 172.21.15.18:0/1918782079 wait complete. 2024-09-21T07:11:44.304 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2024-09-21T07:11:44.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.426+0000 7f1f30d8b640 1 -- 172.21.15.18:0/2314510511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f2c15ef50 msgr2=0x7f1f2c15c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:44.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.426+0000 7f1f30d8b640 1 --2- 172.21.15.18:0/2314510511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f2c15ef50 0x7f1f2c15c520 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c005fd0 tx=0x7f1f1c02a530 comp rx=0 tx=0).stop 2024-09-21T07:11:44.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.426+0000 7f1f30d8b640 1 -- 172.21.15.18:0/2314510511 shutdown_connections 2024-09-21T07:11:44.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.426+0000 7f1f30d8b640 1 --2- 172.21.15.18:0/2314510511 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1f2c162a40 0x7f1f2c162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.426+0000 7f1f30d8b640 1 --2- 172.21.15.18:0/2314510511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f2c15ef50 0x7f1f2c15c520 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.426+0000 7f1f30d8b640 1 -- 172.21.15.18:0/2314510511 >> 172.21.15.18:0/2314510511 conn(0x7f1f2c073f30 msgr2=0x7f1f2c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:44.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.426+0000 7f1f30d8b640 1 -- 172.21.15.18:0/2314510511 shutdown_connections 2024-09-21T07:11:44.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.426+0000 7f1f30d8b640 1 -- 172.21.15.18:0/2314510511 wait complete. 2024-09-21T07:11:44.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.428+0000 7f1f30d8b640 1 Processor -- start 2024-09-21T07:11:44.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.428+0000 7f1f30d8b640 1 -- start start 2024-09-21T07:11:44.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.429+0000 7f1f30d8b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1f2c0cef70 0x7f1f2c1514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:44.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.429+0000 7f1f30d8b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f2c15ef50 0x7f1f2c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:44.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.429+0000 7f1f30d8b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f2c162a40 0x7f1f2c14b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:44.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.429+0000 7f1f30d8b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c0d11a0 con 0x7f1f2c15ef50 2024-09-21T07:11:44.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.429+0000 7f1f30d8b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c0d1020 con 0x7f1f2c162a40 2024-09-21T07:11:44.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.429+0000 7f1f30d8b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f1f2c0d1320 con 0x7f1f2c0cef70 2024-09-21T07:11:44.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.429+0000 7f1f29d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f2c15ef50 0x7f1f2c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:44.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.429+0000 7f1f29d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f2c15ef50 0x7f1f2c151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43028/0 (socket says 172.21.15.18:43028) 2024-09-21T07:11:44.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.429+0000 7f1f29d9b640 1 -- 172.21.15.18:0/2528720920 learned_addr learned my addr 172.21.15.18:0/2528720920 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:44.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.429+0000 7f1f2a59c640 1 --2- 172.21.15.18:0/2528720920 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1f2c0cef70 0x7f1f2c1514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:44.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.429+0000 7f1f2ad9d640 1 --2- 172.21.15.18:0/2528720920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f2c162a40 0x7f1f2c14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:44.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.430+0000 7f1f29d9b640 1 -- 172.21.15.18:0/2528720920 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1f2c0cef70 msgr2=0x7f1f2c1514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:44.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.430+0000 7f1f29d9b640 1 --2- 172.21.15.18:0/2528720920 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1f2c0cef70 0x7f1f2c1514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.430+0000 7f1f29d9b640 1 -- 172.21.15.18:0/2528720920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f2c162a40 msgr2=0x7f1f2c14b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:44.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.430+0000 7f1f29d9b640 1 --2- 172.21.15.18:0/2528720920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f2c162a40 0x7f1f2c14b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.430+0000 7f1f29d9b640 1 -- 172.21.15.18:0/2528720920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2c0b2710 con 0x7f1f2c15ef50 2024-09-21T07:11:44.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.430+0000 7f1f29d9b640 1 --2- 172.21.15.18:0/2528720920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f2c15ef50 0x7f1f2c151a00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800c410 tx=0x7f1f1800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:44.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.430+0000 7f1f22ffd640 1 -- 172.21.15.18:0/2528720920 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18017070 con 0x7f1f2c15ef50 2024-09-21T07:11:44.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.430+0000 7f1f22ffd640 1 -- 172.21.15.18:0/2528720920 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f18005320 con 0x7f1f2c15ef50 2024-09-21T07:11:44.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.430+0000 7f1f30d8b640 1 -- 172.21.15.18:0/2528720920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2c0b29f0 con 0x7f1f2c15ef50 2024-09-21T07:11:44.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.430+0000 7f1f22ffd640 1 -- 172.21.15.18:0/2528720920 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18004850 con 0x7f1f2c15ef50 2024-09-21T07:11:44.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.430+0000 7f1f30d8b640 1 -- 172.21.15.18:0/2528720920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f2c0b2fb0 con 0x7f1f2c15ef50 2024-09-21T07:11:44.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.431+0000 7f1f30d8b640 1 -- 172.21.15.18:0/2528720920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f2c0b2480 con 0x7f1f2c15ef50 2024-09-21T07:11:44.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.432+0000 7f1f22ffd640 1 -- 172.21.15.18:0/2528720920 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f1f1801a070 con 0x7f1f2c15ef50 2024-09-21T07:11:44.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.432+0000 7f1f22ffd640 1 --2- 172.21.15.18:0/2528720920 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1f14078d40 0x7f1f1407b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:44.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.433+0000 7f1f22ffd640 1 -- 172.21.15.18:0/2528720920 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f1f18099f20 con 0x7f1f2c15ef50 2024-09-21T07:11:44.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.433+0000 7f1f2a59c640 1 --2- 172.21.15.18:0/2528720920 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1f14078d40 0x7f1f1407b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:44.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.433+0000 7f1f2a59c640 1 --2- 172.21.15.18:0/2528720920 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1f14078d40 0x7f1f1407b250 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c033000 tx=0x7f1f1c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:44.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.437+0000 7f1f22ffd640 1 -- 172.21.15.18:0/2528720920 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1f18061dc0 con 0x7f1f2c15ef50 2024-09-21T07:11:44.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.698+0000 7f1f30d8b640 1 -- 172.21.15.18:0/2528720920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) -- 0x7f1f2c0d17d0 con 0x7f1f2c15ef50 2024-09-21T07:11:44.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.799+0000 7f1f22ffd640 1 -- 172.21.15.18:0/2528720920 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v80) ==== 167+0+0 (secure 0 0 0) 0x7f1f180667f0 con 0x7f1f2c15ef50 2024-09-21T07:11:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.802+0000 7f1f30d8b640 1 -- 172.21.15.18:0/2528720920 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1f14078d40 msgr2=0x7f1f1407b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.802+0000 7f1f30d8b640 1 --2- 172.21.15.18:0/2528720920 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1f14078d40 0x7f1f1407b250 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c033000 tx=0x7f1f1c004730 comp rx=0 tx=0).stop 2024-09-21T07:11:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.802+0000 7f1f30d8b640 1 -- 172.21.15.18:0/2528720920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f2c15ef50 msgr2=0x7f1f2c151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.802+0000 7f1f30d8b640 1 --2- 172.21.15.18:0/2528720920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f2c15ef50 0x7f1f2c151a00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800c410 tx=0x7f1f1800c8d0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.802+0000 7f1f30d8b640 1 -- 172.21.15.18:0/2528720920 shutdown_connections 2024-09-21T07:11:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.802+0000 7f1f30d8b640 1 --2- 172.21.15.18:0/2528720920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f2c162a40 0x7f1f2c14b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.802+0000 7f1f30d8b640 1 --2- 172.21.15.18:0/2528720920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f2c15ef50 0x7f1f2c151a00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.802+0000 7f1f30d8b640 1 --2- 172.21.15.18:0/2528720920 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1f14078d40 0x7f1f1407b250 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.802+0000 7f1f30d8b640 1 --2- 172.21.15.18:0/2528720920 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f1f2c0cef70 0x7f1f2c1514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.802+0000 7f1f30d8b640 1 -- 172.21.15.18:0/2528720920 >> 172.21.15.18:0/2528720920 conn(0x7f1f2c073f30 msgr2=0x7f1f2c15bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.802+0000 7f1f30d8b640 1 -- 172.21.15.18:0/2528720920 shutdown_connections 2024-09-21T07:11:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.802+0000 7f1f30d8b640 1 -- 172.21.15.18:0/2528720920 wait complete. 2024-09-21T07:11:44.815 INFO:tasks.cephfs_test_runner:test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) ... ok 2024-09-21T07:11:44.815 INFO:tasks.cephfs_test_runner: 2024-09-21T07:11:44.816 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-21T07:11:44.816 INFO:tasks.cephfs_test_runner:Ran 1 test in 38.562s 2024-09-21T07:11:44.816 INFO:tasks.cephfs_test_runner: 2024-09-21T07:11:44.816 INFO:tasks.cephfs_test_runner:OK 2024-09-21T07:11:44.816 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-21T07:11:44.825 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T07:11:44.834 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:11:44.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.950+0000 7fc61a04d640 1 -- 172.21.15.18:0/53965167 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc6140ce250 msgr2=0x7fc6140ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:44.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.950+0000 7fc61a04d640 1 --2- 172.21.15.18:0/53965167 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc6140ce250 0x7fc6140ce660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc608009830 tx=0x7fc60802a470 comp rx=0 tx=0).stop 2024-09-21T07:11:44.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.950+0000 7fc61a04d640 1 -- 172.21.15.18:0/53965167 shutdown_connections 2024-09-21T07:11:44.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.950+0000 7fc61a04d640 1 --2- 172.21.15.18:0/53965167 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc6140ce250 0x7fc6140ce660 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.950+0000 7fc61a04d640 1 --2- 172.21.15.18:0/53965167 >> v2:172.21.15.49:3300/0 conn(0x7fc6140d0d60 0x7fc61406f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.950+0000 7fc61a04d640 1 -- 172.21.15.18:0/53965167 >> 172.21.15.18:0/53965167 conn(0x7fc6140b1fe0 msgr2=0x7fc6140b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:44.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.950+0000 7fc61a04d640 1 -- 172.21.15.18:0/53965167 shutdown_connections 2024-09-21T07:11:44.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.950+0000 7fc61a04d640 1 -- 172.21.15.18:0/53965167 wait complete. 2024-09-21T07:11:44.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.952+0000 7fc61a04d640 1 Processor -- start 2024-09-21T07:11:44.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.952+0000 7fc61a04d640 1 -- start start 2024-09-21T07:11:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc61a04d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6140ce250 0x7fc6140ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc61a04d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6140d0d60 0x7fc61415a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc61a04d640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc61415bc30 0x7fc61409b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc61a04d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140b3860 con 0x7fc6140ce250 2024-09-21T07:11:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc61a04d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140b36e0 con 0x7fc6140d0d60 2024-09-21T07:11:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc61a04d640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fc6140b39e0 con 0x7fc61415bc30 2024-09-21T07:11:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc6137fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6140ce250 0x7fc6140ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc6137fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6140ce250 0x7fc6140ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43040/0 (socket says 172.21.15.18:43040) 2024-09-21T07:11:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc6137fe640 1 -- 172.21.15.18:0/1856954550 learned_addr learned my addr 172.21.15.18:0/1856954550 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc612ffd640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6140d0d60 0x7fc61415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc613fff640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc61415bc30 0x7fc61409b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc6137fe640 1 -- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc61415bc30 msgr2=0x7fc61409b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:44.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc6137fe640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc61415bc30 0x7fc61409b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc6137fe640 1 -- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6140d0d60 msgr2=0x7fc61415a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:44.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc6137fe640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6140d0d60 0x7fc61415a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:44.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc6137fe640 1 -- 172.21.15.18:0/1856954550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6141f98b0 con 0x7fc6140ce250 2024-09-21T07:11:44.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc613fff640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc61415bc30 0x7fc61409b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:44.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc612ffd640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6140d0d60 0x7fc61415a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:44.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc6137fe640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6140ce250 0x7fc6140ae1a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc60400e9f0 tx=0x7fc60400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:44.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.954+0000 7fc5fbfff640 1 -- 172.21.15.18:0/1856954550 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60400cd80 con 0x7fc6140ce250 2024-09-21T07:11:44.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.955+0000 7fc5fbfff640 1 -- 172.21.15.18:0/1856954550 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc604004020 con 0x7fc6140ce250 2024-09-21T07:11:44.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.955+0000 7fc61a04d640 1 -- 172.21.15.18:0/1856954550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6141f9b90 con 0x7fc6140ce250 2024-09-21T07:11:44.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.955+0000 7fc5fbfff640 1 -- 172.21.15.18:0/1856954550 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604004470 con 0x7fc6140ce250 2024-09-21T07:11:44.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.955+0000 7fc61a04d640 1 -- 172.21.15.18:0/1856954550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6141fa150 con 0x7fc6140ce250 2024-09-21T07:11:44.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.956+0000 7fc61a04d640 1 -- 172.21.15.18:0/1856954550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc61415b800 con 0x7fc6140ce250 2024-09-21T07:11:44.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.956+0000 7fc5fbfff640 1 -- 172.21.15.18:0/1856954550 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fc6040035f0 con 0x7fc6140ce250 2024-09-21T07:11:44.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.957+0000 7fc5fbfff640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc600078d40 0x7fc60007b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:44.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.957+0000 7fc5fbfff640 1 -- 172.21.15.18:0/1856954550 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fc60409ba80 con 0x7fc6140ce250 2024-09-21T07:11:44.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.957+0000 7fc612ffd640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc600078d40 0x7fc60007b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:44.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.958+0000 7fc612ffd640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc600078d40 0x7fc60007b250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc608034000 tx=0x7fc608004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:44.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:44.962+0000 7fc5fbfff640 1 -- 172.21.15.18:0/1856954550 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc61415b800 con 0x7fc6140ce250 2024-09-21T07:11:45.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.151+0000 7fc61a04d640 1 -- 172.21.15.18:0/1856954550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6140b3f00 con 0x7fc6140ce250 2024-09-21T07:11:45.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.152+0000 7fc5fbfff640 1 -- 172.21.15.18:0/1856954550 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13008 (secure 0 0 0) 0x7fc604063db0 con 0x7fc6140ce250 2024-09-21T07:11:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:45.154 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":35,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:11:43.797501+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6837/3575557854":"2024-09-22T07:11:40.792826+0000","172.21.15.49:6835/3575557854":"2024-09-22T07:11:40.792826+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:45.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.154+0000 7fc61a04d640 1 -- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc600078d40 msgr2=0x7fc60007b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:45.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.154+0000 7fc61a04d640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc600078d40 0x7fc60007b250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc608034000 tx=0x7fc608004730 comp rx=0 tx=0).stop 2024-09-21T07:11:45.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.154+0000 7fc61a04d640 1 -- 172.21.15.18:0/1856954550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6140ce250 msgr2=0x7fc6140ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:45.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.154+0000 7fc61a04d640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6140ce250 0x7fc6140ae1a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc60400e9f0 tx=0x7fc60400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.154+0000 7fc61a04d640 1 -- 172.21.15.18:0/1856954550 shutdown_connections 2024-09-21T07:11:45.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.154+0000 7fc61a04d640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fc600078d40 0x7fc60007b250 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.154+0000 7fc61a04d640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fc61415bc30 0x7fc61409b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.154+0000 7fc61a04d640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6140d0d60 0x7fc61415a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.154+0000 7fc61a04d640 1 --2- 172.21.15.18:0/1856954550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc6140ce250 0x7fc6140ae1a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.154+0000 7fc61a04d640 1 -- 172.21.15.18:0/1856954550 >> 172.21.15.18:0/1856954550 conn(0x7fc6140b1fe0 msgr2=0x7fc614075e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:45.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.154+0000 7fc61a04d640 1 -- 172.21.15.18:0/1856954550 shutdown_connections 2024-09-21T07:11:45.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.154+0000 7fc61a04d640 1 -- 172.21.15.18:0/1856954550 wait complete. 2024-09-21T07:11:45.167 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:10:30.329949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:11:45.168 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:11:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.286+0000 7fbcddf69640 1 -- 172.21.15.18:0/237080238 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbcd80b67f0 msgr2=0x7fbcd8167740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.286+0000 7fbcddf69640 1 --2- 172.21.15.18:0/237080238 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbcd80b67f0 0x7fbcd8167740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009be0 tx=0x7fbcd002a920 comp rx=0 tx=0).stop 2024-09-21T07:11:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.286+0000 7fbcddf69640 1 -- 172.21.15.18:0/237080238 shutdown_connections 2024-09-21T07:11:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.286+0000 7fbcddf69640 1 --2- 172.21.15.18:0/237080238 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbcd80b67f0 0x7fbcd8167740 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.286+0000 7fbcddf69640 1 -- 172.21.15.18:0/237080238 >> 172.21.15.18:0/237080238 conn(0x7fbcd80b78b0 msgr2=0x7fbcd80b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.286+0000 7fbcddf69640 1 -- 172.21.15.18:0/237080238 shutdown_connections 2024-09-21T07:11:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.286+0000 7fbcddf69640 1 -- 172.21.15.18:0/237080238 wait complete. 2024-09-21T07:11:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.287+0000 7fbcddf69640 1 Processor -- start 2024-09-21T07:11:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.288+0000 7fbcddf69640 1 -- start start 2024-09-21T07:11:45.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.289+0000 7fbcddf69640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd80b4760 0x7fbcd8147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:45.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.289+0000 7fbcddf69640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbcd80b67f0 0x7fbcd809f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:45.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.289+0000 7fbcddf69640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcd81605e0 0x7fbcd809f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:45.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.289+0000 7fbcddf69640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd8167e90 con 0x7fbcd81605e0 2024-09-21T07:11:45.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.289+0000 7fbcddf69640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd8161460 con 0x7fbcd80b4760 2024-09-21T07:11:45.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.289+0000 7fbcddf69640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd8168010 con 0x7fbcd80b67f0 2024-09-21T07:11:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.289+0000 7fbcd7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcd81605e0 0x7fbcd809f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.289+0000 7fbcd7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcd81605e0 0x7fbcd809f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43054/0 (socket says 172.21.15.18:43054) 2024-09-21T07:11:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.289+0000 7fbcd7fff640 1 -- 172.21.15.18:0/1113052583 learned_addr learned my addr 172.21.15.18:0/1113052583 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.289+0000 7fbcd77fe640 1 --2- 172.21.15.18:0/1113052583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd80b4760 0x7fbcd8147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.289+0000 7fbcd6ffd640 1 --2- 172.21.15.18:0/1113052583 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbcd80b67f0 0x7fbcd809f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.290+0000 7fbcd7fff640 1 -- 172.21.15.18:0/1113052583 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbcd80b67f0 msgr2=0x7fbcd809f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.290+0000 7fbcd7fff640 1 --2- 172.21.15.18:0/1113052583 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbcd80b67f0 0x7fbcd809f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.290+0000 7fbcd7fff640 1 -- 172.21.15.18:0/1113052583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd80b4760 msgr2=0x7fbcd8147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.290+0000 7fbcd7fff640 1 --2- 172.21.15.18:0/1113052583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd80b4760 0x7fbcd8147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.290+0000 7fbcd7fff640 1 -- 172.21.15.18:0/1113052583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd81534f0 con 0x7fbcd81605e0 2024-09-21T07:11:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.290+0000 7fbcd7fff640 1 --2- 172.21.15.18:0/1113052583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcd81605e0 0x7fbcd809f9f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009d00 tx=0x7fbcd0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.290+0000 7fbcbffff640 1 -- 172.21.15.18:0/1113052583 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0030e60 con 0x7fbcd81605e0 2024-09-21T07:11:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.290+0000 7fbcbffff640 1 -- 172.21.15.18:0/1113052583 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcd003e070 con 0x7fbcd81605e0 2024-09-21T07:11:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.290+0000 7fbcddf69640 1 -- 172.21.15.18:0/1113052583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd8152f30 con 0x7fbcd81605e0 2024-09-21T07:11:45.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.290+0000 7fbcbffff640 1 -- 172.21.15.18:0/1113052583 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0032330 con 0x7fbcd81605e0 2024-09-21T07:11:45.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.290+0000 7fbcddf69640 1 -- 172.21.15.18:0/1113052583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd8151f90 con 0x7fbcd81605e0 2024-09-21T07:11:45.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.291+0000 7fbcddf69640 1 -- 172.21.15.18:0/1113052583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd8153900 con 0x7fbcd81605e0 2024-09-21T07:11:45.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.292+0000 7fbcbffff640 1 -- 172.21.15.18:0/1113052583 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fbcd00324d0 con 0x7fbcd81605e0 2024-09-21T07:11:45.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.292+0000 7fbcbffff640 1 --2- 172.21.15.18:0/1113052583 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbcc4078d70 0x7fbcc407b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:45.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.292+0000 7fbcbffff640 1 -- 172.21.15.18:0/1113052583 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fbcd00bc6c0 con 0x7fbcd81605e0 2024-09-21T07:11:45.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.293+0000 7fbcd77fe640 1 --2- 172.21.15.18:0/1113052583 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbcc4078d70 0x7fbcc407b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:45.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.293+0000 7fbcd77fe640 1 --2- 172.21.15.18:0/1113052583 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbcc4078d70 0x7fbcc407b280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8007fd0 tx=0x7fbcc8001390 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:45.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.297+0000 7fbcbffff640 1 -- 172.21.15.18:0/1113052583 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbcd002d070 con 0x7fbcd81605e0 2024-09-21T07:11:45.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.483+0000 7fbcddf69640 1 -- 172.21.15.18:0/1113052583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbcd8148260 con 0x7fbcd81605e0 2024-09-21T07:11:45.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.483+0000 7fbcbffff640 1 -- 172.21.15.18:0/1113052583 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7fbcd00843a0 con 0x7fbcd81605e0 2024-09-21T07:11:45.485 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-21T07:11:45.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.485+0000 7fbcddf69640 1 -- 172.21.15.18:0/1113052583 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbcc4078d70 msgr2=0x7fbcc407b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.486+0000 7fbcddf69640 1 --2- 172.21.15.18:0/1113052583 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbcc4078d70 0x7fbcc407b280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8007fd0 tx=0x7fbcc8001390 comp rx=0 tx=0).stop 2024-09-21T07:11:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.486+0000 7fbcddf69640 1 -- 172.21.15.18:0/1113052583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcd81605e0 msgr2=0x7fbcd809f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.486+0000 7fbcddf69640 1 --2- 172.21.15.18:0/1113052583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcd81605e0 0x7fbcd809f9f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009d00 tx=0x7fbcd0003c20 comp rx=0 tx=0).stop 2024-09-21T07:11:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.486+0000 7fbcddf69640 1 -- 172.21.15.18:0/1113052583 shutdown_connections 2024-09-21T07:11:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.486+0000 7fbcddf69640 1 --2- 172.21.15.18:0/1113052583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbcd81605e0 0x7fbcd809f9f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.486+0000 7fbcddf69640 1 --2- 172.21.15.18:0/1113052583 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fbcc4078d70 0x7fbcc407b280 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.486+0000 7fbcddf69640 1 --2- 172.21.15.18:0/1113052583 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fbcd80b67f0 0x7fbcd809f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.486+0000 7fbcddf69640 1 --2- 172.21.15.18:0/1113052583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd80b4760 0x7fbcd8147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.486+0000 7fbcddf69640 1 -- 172.21.15.18:0/1113052583 >> 172.21.15.18:0/1113052583 conn(0x7fbcd80b78b0 msgr2=0x7fbcd80afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.486+0000 7fbcddf69640 1 -- 172.21.15.18:0/1113052583 shutdown_connections 2024-09-21T07:11:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.486+0000 7fbcddf69640 1 -- 172.21.15.18:0/1113052583 wait complete. 2024-09-21T07:11:45.498 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T07:11:45.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.613+0000 7fac424f9640 1 -- 172.21.15.18:0/4166725969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c15ef50 msgr2=0x7fac3c15c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:45.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.613+0000 7fac424f9640 1 --2- 172.21.15.18:0/4166725969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c15ef50 0x7fac3c15c520 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fac3c0d2570 tx=0x7fac2c02a530 comp rx=0 tx=0).stop 2024-09-21T07:11:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.613+0000 7fac424f9640 1 -- 172.21.15.18:0/4166725969 shutdown_connections 2024-09-21T07:11:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.613+0000 7fac424f9640 1 --2- 172.21.15.18:0/4166725969 >> v2:172.21.15.49:3300/0 conn(0x7fac3c162a40 0x7fac3c162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.613+0000 7fac424f9640 1 --2- 172.21.15.18:0/4166725969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c15ef50 0x7fac3c15c520 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.613+0000 7fac424f9640 1 -- 172.21.15.18:0/4166725969 >> 172.21.15.18:0/4166725969 conn(0x7fac3c073f30 msgr2=0x7fac3c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.613+0000 7fac424f9640 1 -- 172.21.15.18:0/4166725969 shutdown_connections 2024-09-21T07:11:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.613+0000 7fac424f9640 1 -- 172.21.15.18:0/4166725969 wait complete. 2024-09-21T07:11:45.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.615+0000 7fac424f9640 1 Processor -- start 2024-09-21T07:11:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.615+0000 7fac424f9640 1 -- start start 2024-09-21T07:11:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.616+0000 7fac424f9640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac3c0cef70 0x7fac3c1f9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.616+0000 7fac424f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac3c15ef50 0x7fac3c0cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.616+0000 7fac424f9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c162a40 0x7fac3c161650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.616+0000 7fac424f9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c0d11a0 con 0x7fac3c162a40 2024-09-21T07:11:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.616+0000 7fac424f9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c0d1020 con 0x7fac3c15ef50 2024-09-21T07:11:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.616+0000 7fac424f9640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fac3c0d1320 con 0x7fac3c0cef70 2024-09-21T07:11:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.616+0000 7fac40a96640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c162a40 0x7fac3c161650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.616+0000 7fac40a96640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c162a40 0x7fac3c161650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43066/0 (socket says 172.21.15.18:43066) 2024-09-21T07:11:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.616+0000 7fac40a96640 1 -- 172.21.15.18:0/2132448022 learned_addr learned my addr 172.21.15.18:0/2132448022 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.616+0000 7fac3bfff640 1 --2- 172.21.15.18:0/2132448022 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac3c0cef70 0x7fac3c1f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.616+0000 7fac3b7fe640 1 --2- 172.21.15.18:0/2132448022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac3c15ef50 0x7fac3c0cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.617+0000 7fac40a96640 1 -- 172.21.15.18:0/2132448022 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac3c0cef70 msgr2=0x7fac3c1f9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.617+0000 7fac40a96640 1 --2- 172.21.15.18:0/2132448022 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac3c0cef70 0x7fac3c1f9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.617+0000 7fac40a96640 1 -- 172.21.15.18:0/2132448022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac3c15ef50 msgr2=0x7fac3c0cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.617+0000 7fac40a96640 1 --2- 172.21.15.18:0/2132448022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac3c15ef50 0x7fac3c0cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.617+0000 7fac40a96640 1 -- 172.21.15.18:0/2132448022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3c1f99a0 con 0x7fac3c162a40 2024-09-21T07:11:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.617+0000 7fac40a96640 1 --2- 172.21.15.18:0/2132448022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c162a40 0x7fac3c161650 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fac3400e960 tx=0x7fac3400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.617+0000 7fac38ff9640 1 -- 172.21.15.18:0/2132448022 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac34004d20 con 0x7fac3c162a40 2024-09-21T07:11:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.617+0000 7fac38ff9640 1 -- 172.21.15.18:0/2132448022 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac3400cac0 con 0x7fac3c162a40 2024-09-21T07:11:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.617+0000 7fac38ff9640 1 -- 172.21.15.18:0/2132448022 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac34005020 con 0x7fac3c162a40 2024-09-21T07:11:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.617+0000 7fac424f9640 1 -- 172.21.15.18:0/2132448022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3c1f9c80 con 0x7fac3c162a40 2024-09-21T07:11:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.617+0000 7fac424f9640 1 -- 172.21.15.18:0/2132448022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac3c0ab1c0 con 0x7fac3c162a40 2024-09-21T07:11:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.618+0000 7fac424f9640 1 -- 172.21.15.18:0/2132448022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac3c0cfa50 con 0x7fac3c162a40 2024-09-21T07:11:45.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.619+0000 7fac38ff9640 1 -- 172.21.15.18:0/2132448022 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fac340051c0 con 0x7fac3c162a40 2024-09-21T07:11:45.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.619+0000 7fac38ff9640 1 --2- 172.21.15.18:0/2132448022 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fac28078d40 0x7fac2807b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:45.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.620+0000 7fac38ff9640 1 -- 172.21.15.18:0/2132448022 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fac3409b6d0 con 0x7fac3c162a40 2024-09-21T07:11:45.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.620+0000 7fac3bfff640 1 --2- 172.21.15.18:0/2132448022 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fac28078d40 0x7fac2807b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:45.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.620+0000 7fac3bfff640 1 --2- 172.21.15.18:0/2132448022 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fac28078d40 0x7fac2807b250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fac2c034000 tx=0x7fac2c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:45.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.624+0000 7fac38ff9640 1 -- 172.21.15.18:0/2132448022 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fac34016030 con 0x7fac3c162a40 2024-09-21T07:11:45.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.863+0000 7fac424f9640 1 -- 172.21.15.18:0/2132448022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fac3c0ba5a0 con 0x7fac3c162a40 2024-09-21T07:11:45.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.868+0000 7fac38ff9640 1 -- 172.21.15.18:0/2132448022 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v7) ==== 81+0+530208 (secure 0 0 0) 0x7fac340633c0 con 0x7fac3c162a40 2024-09-21T07:11:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:45.876 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T07:11:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 7, 2024-09-21T07:11:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: "active_gid": 4114, 2024-09-21T07:11:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "active_name": "x", 2024-09-21T07:11:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "active_addrs": { 2024-09-21T07:11:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-21T07:11:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-21T07:11:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.49:6800", 2024-09-21T07:11:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1123180713 2024-09-21T07:11:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-21T07:11:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.49:6801", 2024-09-21T07:11:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1123180713 2024-09-21T07:11:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-21T07:11:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "active_addr": "172.21.15.49:6801/1123180713", 2024-09-21T07:11:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "active_change": "2024-09-21T07:10:22.304763+0000", 2024-09-21T07:11:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T07:11:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "available": true, 2024-09-21T07:11:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "standbys": [ 2024-09-21T07:11:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "gid": 4113, 2024-09-21T07:11:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "y", 2024-09-21T07:11:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_features": 4540719139924082687, 2024-09-21T07:11:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-09-21T07:11:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-09-21T07:11:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-09-21T07:11:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T07:11:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-09-21T07:11:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-09-21T07:11:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-09-21T07:11:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-09-21T07:11:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-09-21T07:11:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-09-21T07:11:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-09-21T07:11:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-09-21T07:11:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-09-21T07:11:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-09-21T07:11:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-09-21T07:11:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-09-21T07:11:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-09-21T07:11:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-09-21T07:11:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-09-21T07:11:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-09-21T07:11:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-09-21T07:11:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-09-21T07:11:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-09-21T07:11:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T07:11:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-09-21T07:11:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-09-21T07:11:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-09-21T07:11:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-09-21T07:11:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-09-21T07:11:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-09-21T07:11:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T07:11:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-09-21T07:11:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-09-21T07:11:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-09-21T07:11:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T07:11:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:11:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-09-21T07:11:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-09-21T07:11:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-21T07:11:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-21T07:11:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-21T07:11:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T07:11:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:11:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-09-21T07:11:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-09-21T07:11:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-21T07:11:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-09-21T07:11:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-21T07:11:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-09-21T07:11:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T07:11:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-09-21T07:11:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-09-21T07:11:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T07:11:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T07:11:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T07:11:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-09-21T07:11:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-09-21T07:11:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-21T07:11:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-09-21T07:11:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T07:11:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:11:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-09-21T07:11:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-09-21T07:11:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-21T07:11:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-21T07:11:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-21T07:11:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T07:11:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:11:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-09-21T07:11:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-09-21T07:11:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-21T07:11:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T07:11:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-21T07:11:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-21T07:11:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-09-21T07:11:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-09-21T07:11:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-09-21T07:11:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "read", 2024-09-21T07:11:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap", 2024-09-21T07:11:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap-read" 2024-09-21T07:11:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-09-21T07:11:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-09-21T07:11:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-09-21T07:11:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T07:11:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-21T07:11:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-21T07:11:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-21T07:11:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-09-21T07:11:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-09-21T07:11:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-21T07:11:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-21T07:11:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T07:11:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T07:11:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-09-21T07:11:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-09-21T07:11:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-21T07:11:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-21T07:11:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T07:11:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-21T07:11:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T07:11:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-09-21T07:11:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-09-21T07:11:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-09-21T07:11:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T07:11:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-09-21T07:11:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-09-21T07:11:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-09-21T07:11:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T07:11:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-09-21T07:11:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-09-21T07:11:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T07:11:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T07:11:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-09-21T07:11:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-09-21T07:11:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-21T07:11:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T07:11:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-09-21T07:11:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T07:11:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-21T07:11:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-09-21T07:11:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T07:11:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_log_destination": { 2024-09-21T07:11:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm_log_destination", 2024-09-21T07:11:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "file", 2024-09-21T07:11:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "file,syslog", 2024-09-21T07:11:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "syslog" 2024-09-21T07:11:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T07:11:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-09-21T07:11:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-09-21T07:11:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T07:11:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-09-21T07:11:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-09-21T07:11:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T07:11:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-09-21T07:11:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-09-21T07:11:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T07:11:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-09-21T07:11:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-09-21T07:11:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T07:11:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-21T07:11:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-09-21T07:11:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-09-21T07:11:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T07:11:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-09-21T07:11:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-09-21T07:11:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-09-21T07:11:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T07:11:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-09-21T07:11:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-09-21T07:11:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-09-21T07:11:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T07:11:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-21T07:11:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-09-21T07:11:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-09-21T07:11:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T07:11:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-09-21T07:11:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-09-21T07:11:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-09-21T07:11:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T07:11:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-09-21T07:11:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-09-21T07:11:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-09-21T07:11:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T07:11:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-09-21T07:11:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-09-21T07:11:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-09-21T07:11:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T07:11:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-09-21T07:11:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-09-21T07:11:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-09-21T07:11:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T07:11:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-09-21T07:11:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-09-21T07:11:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-09-21T07:11:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T07:11:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-09-21T07:11:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nginx": { 2024-09-21T07:11:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nginx", 2024-09-21T07:11:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T07:11:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nginx container image", 2024-09-21T07:11:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-09-21T07:11:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-09-21T07:11:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T07:11:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-21T07:11:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-09-21T07:11:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-09-21T07:11:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T07:11:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-09-21T07:11:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_oauth2_proxy": { 2024-09-21T07:11:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T07:11:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T07:11:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "oauth2-proxy container image", 2024-09-21T07:11:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-09-21T07:11:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-09-21T07:11:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T07:11:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-21T07:11:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-09-21T07:11:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-09-21T07:11:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T07:11:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-09-21T07:11:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba": { 2024-09-21T07:11:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba", 2024-09-21T07:11:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T07:11:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB container image", 2024-09-21T07:11:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba_metrics": { 2024-09-21T07:11:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba_metrics", 2024-09-21T07:11:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T07:11:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T07:11:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-09-21T07:11:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-09-21T07:11:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T07:11:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-09-21T07:11:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-09-21T07:11:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-09-21T07:11:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T07:11:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-09-21T07:11:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-09-21T07:11:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-21T07:11:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T07:11:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-09-21T07:11:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T07:11:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-09-21T07:11:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T07:11:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-09-21T07:11:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-09-21T07:11:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-09-21T07:11:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T07:11:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-09-21T07:11:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-09-21T07:11:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-09-21T07:11:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-09-21T07:11:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-09-21T07:11:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-09-21T07:11:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T07:11:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-09-21T07:11:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-09-21T07:11:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-21T07:11:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-09-21T07:11:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "grafana_dashboards_path": { 2024-09-21T07:11:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "grafana_dashboards_path", 2024-09-21T07:11:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T07:11:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T07:11:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-09-21T07:11:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-09-21T07:11:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-21T07:11:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-09-21T07:11:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-09-21T07:11:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-09-21T07:11:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T07:11:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-09-21T07:11:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-09-21T07:11:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T07:11:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-09-21T07:11:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-09-21T07:11:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T07:11:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T07:11:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T07:11:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T07:11:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T07:11:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T07:11:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T07:11:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-09-21T07:11:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T07:11:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-09-21T07:11:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-09-21T07:11:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-21T07:11:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-09-21T07:11:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-09-21T07:11:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-09-21T07:11:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-21T07:11:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T07:11:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-09-21T07:11:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-09-21T07:11:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-09-21T07:11:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-21T07:11:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-21T07:11:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-09-21T07:11:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-09-21T07:11:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-09-21T07:11:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T07:11:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-09-21T07:11:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-09-21T07:11:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-09-21T07:11:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T07:11:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-09-21T07:11:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-09-21T07:11:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T07:11:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T07:11:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-09-21T07:11:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-09-21T07:11:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T07:11:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-09-21T07:11:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-09-21T07:11:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T07:11:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-09-21T07:11:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-09-21T07:11:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T07:11:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-09-21T07:11:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-09-21T07:11:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T07:11:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-09-21T07:11:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-09-21T07:11:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T07:11:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-09-21T07:11:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-09-21T07:11:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-09-21T07:11:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-09-21T07:11:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-09-21T07:11:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-09-21T07:11:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T07:11:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_keepalive_count_max": { 2024-09-21T07:11:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T07:11:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-21T07:11:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T07:11:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_keepalive_interval": { 2024-09-21T07:11:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_keepalive_interval", 2024-09-21T07:11:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-09-21T07:11:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.987 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.987 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T07:11:45.987 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.987 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.987 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.987 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-09-21T07:11:45.987 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-09-21T07:11:45.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.987 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.987 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.987 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.987 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.987 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.987 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T07:11:45.988 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.989 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.989 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.989 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-09-21T07:11:45.989 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-09-21T07:11:45.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.989 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.989 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.989 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:45.989 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.989 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.989 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.989 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T07:11:45.989 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.990 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.990 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.990 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-09-21T07:11:45.990 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-09-21T07:11:45.990 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.990 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.990 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.990 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:45.990 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.990 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.990 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.990 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T07:11:45.990 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.991 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.992 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:45.992 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:45.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:45.992 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-09-21T07:11:45.992 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:45.992 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:45.992 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:45.992 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:45.992 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:45.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.993 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.993 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.993 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:45.993 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.993 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.993 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:45.993 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:45.993 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:45.993 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:45.993 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:45.993 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:45.993 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:45.993 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:45.993 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.994 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.994 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.994 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.994 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:45.994 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:45.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.994 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.994 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.994 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.994 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.994 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.994 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.994 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.995 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.995 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.995 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.995 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:45.995 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:45.995 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:45.995 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.995 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.995 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:45.995 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.995 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.995 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:45.995 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:45.995 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.996 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:45.997 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.997 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.997 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.997 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.997 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.997 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.997 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.997 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-09-21T07:11:45.997 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-09-21T07:11:45.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:45.997 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.997 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.998 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-09-21T07:11:45.998 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.998 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.998 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.998 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T07:11:45.998 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.998 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.998 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.998 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:45.998 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:45.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:45.998 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:45.998 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.998 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:45.999 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:45.999 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:45.999 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:45.999 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:45.999 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:45.999 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:45.999 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:45.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:45.999 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-09-21T07:11:45.999 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-09-21T07:11:45.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:45.999 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:45.999 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:45.999 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-09-21T07:11:45.999 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.000 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.000 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.000 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T07:11:46.000 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.000 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.000 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.000 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-09-21T07:11:46.001 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.001 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.001 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.001 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T07:11:46.001 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T07:11:46.001 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.001 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.001 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.001 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-21T07:11:46.001 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.001 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.001 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.001 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.001 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.002 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.002 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.002 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T07:11:46.002 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T07:11:46.002 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.002 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.002 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.002 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.002 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.002 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.002 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.003 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.003 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.003 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.003 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.003 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T07:11:46.003 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T07:11:46.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.003 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.004 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.004 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.004 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.004 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.004 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.004 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.004 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.004 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.004 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.004 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-09-21T07:11:46.004 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T07:11:46.004 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.004 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.005 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.005 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.005 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.005 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.005 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.005 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.005 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.005 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.005 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.005 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T07:11:46.005 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T07:11:46.005 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T07:11:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T07:11:46.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T07:11:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T07:11:46.007 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T07:11:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T07:11:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.008 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T07:11:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T07:11:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.009 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.010 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.010 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.010 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.010 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.010 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.010 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.010 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.010 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.010 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.010 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T07:11:46.010 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T07:11:46.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.011 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.011 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.011 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.011 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.011 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.011 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.011 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.011 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.011 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.011 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.011 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T07:11:46.012 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T07:11:46.012 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.012 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.012 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.012 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.012 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.012 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.012 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.012 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.012 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.012 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.012 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.012 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T07:11:46.013 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T07:11:46.013 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.013 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.013 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.013 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.013 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.013 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.013 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.013 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.013 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.013 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.013 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.013 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T07:11:46.013 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T07:11:46.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.014 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.014 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.014 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.014 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.014 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.014 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.014 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.014 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.014 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.014 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.015 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T07:11:46.015 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T07:11:46.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.015 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.015 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.015 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.015 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.015 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.015 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.015 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.015 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.015 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.015 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.016 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T07:11:46.016 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T07:11:46.016 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.016 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.016 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.016 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-21T07:11:46.016 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.016 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.016 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.016 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.016 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.016 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.016 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.017 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T07:11:46.017 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T07:11:46.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.017 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.017 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.017 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.017 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.017 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.017 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.017 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.017 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.017 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.018 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.018 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-09-21T07:11:46.018 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-09-21T07:11:46.018 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.018 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.018 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.019 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.019 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.019 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.019 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.019 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.019 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.019 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.019 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.020 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T07:11:46.020 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T07:11:46.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.020 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.020 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.020 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-21T07:11:46.021 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.021 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.021 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.021 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.021 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.021 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.022 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.022 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T07:11:46.022 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T07:11:46.022 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.022 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.022 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.023 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.023 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.023 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.023 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.023 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.023 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.024 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.024 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.024 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T07:11:46.024 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T07:11:46.024 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.025 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.025 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.025 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.025 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.025 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.025 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.026 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.026 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.026 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.026 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.026 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T07:11:46.027 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T07:11:46.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.027 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.027 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.027 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.027 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.027 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.028 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.028 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.028 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.028 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.028 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.028 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T07:11:46.029 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T07:11:46.029 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.029 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.029 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.029 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.029 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.030 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.030 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.030 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.030 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.030 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.030 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.031 INFO:teuthology.orchestra.run.smithi018.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T07:11:46.031 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T07:11:46.031 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.031 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.031 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.031 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "[]", 2024-09-21T07:11:46.031 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.031 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.031 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.032 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.032 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.032 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.033 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.034 INFO:teuthology.orchestra.run.smithi018.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T07:11:46.034 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T07:11:46.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.034 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.034 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.034 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "{}", 2024-09-21T07:11:46.035 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.035 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.035 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.035 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.035 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.035 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.035 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.036 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T07:11:46.036 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T07:11:46.036 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.036 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.036 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.036 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.036 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.037 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.037 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.037 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.037 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.037 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.037 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.037 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T07:11:46.037 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T07:11:46.037 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.038 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.038 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.038 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.038 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.038 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.038 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.038 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.038 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.038 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.038 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.039 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T07:11:46.039 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T07:11:46.039 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.039 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.039 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.039 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.039 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.039 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.039 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.039 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.039 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.039 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.039 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.040 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T07:11:46.040 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T07:11:46.040 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.040 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.040 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.040 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.040 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.040 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.040 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.040 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.040 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.040 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.040 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.040 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T07:11:46.041 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T07:11:46.041 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.041 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.041 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.041 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.041 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.041 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.041 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.041 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.041 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.041 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.041 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.042 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T07:11:46.042 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T07:11:46.042 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.042 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.043 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.043 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.043 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.043 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.043 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.043 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.043 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.043 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.043 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.043 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T07:11:46.043 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T07:11:46.044 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.044 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.044 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.044 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.044 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.044 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.044 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.044 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.044 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.044 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.044 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.044 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T07:11:46.045 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T07:11:46.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.045 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.045 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.045 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.045 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.045 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.045 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.045 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.045 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.045 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.045 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.045 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T07:11:46.045 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T07:11:46.046 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.046 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.046 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.046 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.046 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.046 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.046 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.046 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.046 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.046 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.046 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.047 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T07:11:46.047 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T07:11:46.047 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.047 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.047 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.047 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.047 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.047 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.047 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.047 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.047 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.047 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.047 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.048 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T07:11:46.048 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T07:11:46.048 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.048 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.048 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.048 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T07:11:46.048 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.048 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.048 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.048 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.048 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.048 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.049 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.049 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T07:11:46.049 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T07:11:46.049 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.049 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.049 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.049 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-21T07:11:46.049 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.049 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.049 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.049 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.049 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.050 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.050 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.050 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T07:11:46.050 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T07:11:46.050 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.050 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.050 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.050 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-09-21T07:11:46.050 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.050 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.051 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.051 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.051 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.051 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.051 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.051 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T07:11:46.051 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T07:11:46.051 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.051 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.051 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.051 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-09-21T07:11:46.051 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.052 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.053 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.053 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.053 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.053 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.053 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T07:11:46.053 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T07:11:46.053 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.053 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.053 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.053 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-21T07:11:46.053 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.053 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.053 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.053 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.054 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.054 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.054 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.054 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T07:11:46.054 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T07:11:46.054 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.054 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.054 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.054 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.054 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.054 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.054 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.054 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.054 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.055 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.055 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.055 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T07:11:46.055 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T07:11:46.055 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.055 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.055 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.055 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.055 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.055 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.055 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.055 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.055 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.056 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.056 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.056 INFO:teuthology.orchestra.run.smithi018.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T07:11:46.056 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T07:11:46.056 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.056 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.056 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.056 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.056 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.056 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.056 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.056 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.056 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.056 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.057 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.057 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T07:11:46.057 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T07:11:46.057 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.057 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.057 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.057 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.057 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.057 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.057 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.057 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.057 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.057 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.058 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.058 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T07:11:46.058 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T07:11:46.058 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.058 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.058 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.058 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-21T07:11:46.058 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.058 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.058 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.058 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.058 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.058 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.059 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.059 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T07:11:46.059 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T07:11:46.059 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.059 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.059 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.059 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-21T07:11:46.059 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.059 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.059 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.059 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.059 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.060 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.060 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.060 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-09-21T07:11:46.060 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-09-21T07:11:46.060 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.060 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.060 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.060 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.060 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.061 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.061 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.061 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.061 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.061 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.061 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.061 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-09-21T07:11:46.061 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-09-21T07:11:46.061 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.061 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.061 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.062 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.062 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.062 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.062 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.062 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.062 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.062 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.062 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.062 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-09-21T07:11:46.062 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-09-21T07:11:46.062 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.062 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.063 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.063 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.063 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.063 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.063 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.063 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-09-21T07:11:46.063 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.063 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.063 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.063 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-09-21T07:11:46.063 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-09-21T07:11:46.063 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.064 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.064 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.064 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-09-21T07:11:46.064 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.064 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.064 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.064 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.064 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.064 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.064 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.064 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-21T07:11:46.064 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-21T07:11:46.064 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.064 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.065 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.065 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.065 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.065 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.065 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.065 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.065 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.065 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.065 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.065 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.065 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.065 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.066 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.066 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.066 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.066 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.066 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.066 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.066 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.066 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.066 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.066 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.066 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.067 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.067 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.067 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.067 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.067 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.067 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.067 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.067 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.068 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.068 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.068 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.068 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.068 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.068 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.068 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.068 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.068 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.068 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.068 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.068 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.068 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.069 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.069 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.069 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.069 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.069 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.069 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.069 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.069 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.069 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.069 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.069 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.069 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.069 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.069 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-09-21T07:11:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-09-21T07:11:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.072 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-09-21T07:11:46.072 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.072 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.072 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.072 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-09-21T07:11:46.072 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T07:11:46.072 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.072 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.072 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.072 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.072 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.072 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-21T07:11:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-21T07:11:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-21T07:11:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.074 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.074 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.074 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.074 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.074 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-21T07:11:46.074 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-21T07:11:46.074 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.074 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.074 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.074 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-09-21T07:11:46.074 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.074 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.075 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.075 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.075 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.075 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.075 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.075 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.075 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.075 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.075 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.075 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.075 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.075 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.076 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.076 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.076 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.076 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.076 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.076 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.076 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-21T07:11:46.076 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-21T07:11:46.076 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.076 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.076 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.076 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.076 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.077 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.077 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.077 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.077 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.077 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.077 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.077 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-09-21T07:11:46.077 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-09-21T07:11:46.077 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.077 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.077 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.078 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-09-21T07:11:46.078 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.078 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.078 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.078 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.078 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.078 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.078 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.079 INFO:teuthology.orchestra.run.smithi018.stdout: "sso_oauth2": { 2024-09-21T07:11:46.079 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sso_oauth2", 2024-09-21T07:11:46.079 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.079 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.079 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.079 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.079 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.079 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.079 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.079 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.079 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.079 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.080 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.080 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-21T07:11:46.080 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-21T07:11:46.080 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.080 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.080 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.080 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-09-21T07:11:46.080 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.080 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.080 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.080 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.080 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-09-21T07:11:46.081 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.081 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.081 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.081 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.081 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.081 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-21T07:11:46.081 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-21T07:11:46.081 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.081 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.081 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.081 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-21T07:11:46.081 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-21T07:11:46.082 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-21T07:11:46.082 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.082 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.082 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.082 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.082 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.082 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-09-21T07:11:46.082 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-09-21T07:11:46.082 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.082 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.082 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.082 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.083 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.083 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.083 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.083 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.083 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.083 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.083 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.083 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.083 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.083 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-21T07:11:46.083 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.083 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.083 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-09-21T07:11:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-09-21T07:11:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-09-21T07:11:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.084 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.085 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.085 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.085 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.085 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.085 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.085 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.085 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.085 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.085 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.085 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.085 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.085 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.085 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.085 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.085 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.086 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.086 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.086 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.086 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.086 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.086 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.086 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.086 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.086 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.086 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.086 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.086 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.087 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.087 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.087 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.087 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.087 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.087 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.087 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.087 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.087 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.087 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.087 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.087 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.087 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.087 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.088 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.088 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.088 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.088 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.088 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.088 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.088 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.088 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.088 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.088 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.089 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.089 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.089 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.089 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.089 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.089 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.089 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.089 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.089 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.089 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.089 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.089 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.089 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.089 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-09-21T07:11:46.090 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-09-21T07:11:46.090 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.090 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.090 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.090 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-09-21T07:11:46.090 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.090 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.090 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.090 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T07:11:46.090 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.090 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.091 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.091 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-09-21T07:11:46.091 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-09-21T07:11:46.091 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.091 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.091 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.092 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-09-21T07:11:46.092 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.092 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.092 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.092 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T07:11:46.092 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.092 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.092 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.092 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-09-21T07:11:46.092 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-09-21T07:11:46.092 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.093 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.093 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.093 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-09-21T07:11:46.093 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.093 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.093 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.093 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-09-21T07:11:46.093 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.093 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.093 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.093 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-09-21T07:11:46.093 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-09-21T07:11:46.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.094 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.094 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.094 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-21T07:11:46.094 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.094 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.094 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.094 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T07:11:46.094 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.094 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.094 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.095 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-09-21T07:11:46.095 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-09-21T07:11:46.095 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.095 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.095 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.095 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.095 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.095 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.095 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.095 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T07:11:46.095 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.095 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.095 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.095 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-21T07:11:46.096 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-21T07:11:46.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.096 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.096 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.096 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-21T07:11:46.096 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.096 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.096 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.096 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T07:11:46.096 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.096 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.096 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.096 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.096 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.097 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.097 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.097 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.097 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.097 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.097 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.097 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.097 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.097 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.097 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.097 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.097 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-09-21T07:11:46.098 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-09-21T07:11:46.098 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.098 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.098 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.098 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-09-21T07:11:46.098 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.098 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.098 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.098 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T07:11:46.098 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.098 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.098 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.099 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.099 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.099 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-09-21T07:11:46.099 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.099 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.099 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.099 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.099 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.099 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.100 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.100 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.100 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.100 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.100 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.100 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.100 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.100 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.100 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.100 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.100 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.100 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.100 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.100 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.100 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.101 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.101 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.101 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.101 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.101 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.101 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.101 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.101 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.101 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.101 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.101 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.101 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.101 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.102 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.102 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.102 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.102 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.102 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.102 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.102 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.102 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.102 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.102 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.102 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.102 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.102 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.103 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.103 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.103 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.103 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.103 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.103 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.103 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.103 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.103 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.103 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.103 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.103 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.103 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.103 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.104 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.104 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.104 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.104 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.104 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.104 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.104 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-09-21T07:11:46.104 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-09-21T07:11:46.104 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.104 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.104 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.104 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-21T07:11:46.104 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.105 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.105 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.105 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.105 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.105 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.105 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.105 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-09-21T07:11:46.105 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-09-21T07:11:46.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.105 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.105 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.105 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-09-21T07:11:46.105 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.106 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.106 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.106 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.106 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.106 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.106 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.106 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-21T07:11:46.106 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-21T07:11:46.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.106 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.106 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.106 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-21T07:11:46.106 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.107 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.107 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.107 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.107 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.107 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.107 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.107 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.107 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.107 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.107 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.107 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.107 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.107 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.108 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.108 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.108 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.108 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.108 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.108 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.108 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.108 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.108 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-09-21T07:11:46.108 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-09-21T07:11:46.108 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-09-21T07:11:46.108 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.108 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-09-21T07:11:46.109 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-09-21T07:11:46.109 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.109 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.109 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.109 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-09-21T07:11:46.109 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.109 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.109 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.109 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T07:11:46.109 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.109 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.109 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.110 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-09-21T07:11:46.110 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-09-21T07:11:46.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.110 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.110 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.110 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-09-21T07:11:46.110 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.110 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.110 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.110 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T07:11:46.110 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.110 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.111 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.111 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-09-21T07:11:46.111 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-09-21T07:11:46.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.111 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.111 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.111 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.111 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.111 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.111 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.111 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-09-21T07:11:46.111 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.111 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.112 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.112 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-21T07:11:46.112 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-21T07:11:46.112 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.112 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.112 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.112 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-09-21T07:11:46.112 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-09-21T07:11:46.112 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.112 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.112 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T07:11:46.112 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.112 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.113 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.113 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.113 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.113 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.113 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.113 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.113 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.113 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.113 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.113 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.113 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.113 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.113 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.113 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.114 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.114 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.114 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.114 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.114 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.114 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.114 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.114 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.114 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.114 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.114 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.114 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.115 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.115 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.115 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.115 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.115 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.115 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.115 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.115 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.115 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.115 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.115 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.115 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.115 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.115 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.116 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.116 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.116 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.116 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.116 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.116 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.116 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.116 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.116 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.116 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.116 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.116 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.116 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.116 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.117 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.117 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.117 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.117 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.117 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.117 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.117 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.117 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.117 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.117 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.117 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.117 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-09-21T07:11:46.118 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-09-21T07:11:46.118 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.118 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.118 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.118 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.118 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.118 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.118 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.118 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-09-21T07:11:46.118 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.118 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.118 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.118 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-09-21T07:11:46.119 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-09-21T07:11:46.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.119 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.119 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.119 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-09-21T07:11:46.119 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.119 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.119 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.119 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-09-21T07:11:46.119 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.119 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.119 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.120 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.120 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.120 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.120 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.120 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.120 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.120 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.120 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.121 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.121 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.121 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.121 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.121 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-21T07:11:46.121 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-21T07:11:46.121 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.121 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.121 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.121 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-09-21T07:11:46.121 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.122 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.122 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.122 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:11:46.122 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.122 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.122 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.122 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-09-21T07:11:46.122 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-09-21T07:11:46.122 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.122 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.122 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.122 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-21T07:11:46.122 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-21T07:11:46.123 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-09-21T07:11:46.123 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.123 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T07:11:46.123 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.123 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.123 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.123 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-09-21T07:11:46.123 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-09-21T07:11:46.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.123 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.123 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.123 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.124 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.124 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.124 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.124 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-09-21T07:11:46.124 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.124 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.124 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.124 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-09-21T07:11:46.124 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-09-21T07:11:46.124 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.124 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.124 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.124 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-09-21T07:11:46.125 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.125 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.125 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.125 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:11:46.125 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.125 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.125 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.125 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.125 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.125 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-09-21T07:11:46.125 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.125 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.125 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.126 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.126 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.126 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.126 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.126 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.126 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.126 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.126 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.126 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.126 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.126 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.126 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.126 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.127 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.127 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.127 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.127 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.127 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.127 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.127 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.127 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.127 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.127 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.127 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.127 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.127 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.128 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.128 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.128 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.128 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.128 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.128 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.128 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.128 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.128 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.128 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.128 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.128 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.128 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.128 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.129 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.129 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.129 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.129 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.129 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.129 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.129 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.129 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.129 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.129 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.129 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.129 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.130 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.130 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.130 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.130 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.130 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.130 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.130 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.130 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.130 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.130 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.130 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.130 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.131 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.131 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.131 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.131 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.131 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.131 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.131 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.131 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.131 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.131 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.131 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.131 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.132 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.132 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.132 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.132 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-09-21T07:11:46.132 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.132 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.132 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.132 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.132 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.132 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.132 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.132 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.132 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.133 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.133 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.133 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.133 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.133 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.133 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.133 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.133 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.133 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.133 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.133 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.133 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.133 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.133 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.134 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.134 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.134 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.134 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.134 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.134 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.134 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.134 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.134 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.134 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.134 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.134 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.135 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.135 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.135 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.135 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.135 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.135 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.135 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.135 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.135 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.135 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.135 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.135 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.136 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.136 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.136 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.136 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.136 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.136 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.136 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.136 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.136 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.136 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.136 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.136 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.137 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.137 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.137 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.137 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.137 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.137 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.137 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.137 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.137 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.137 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.137 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.137 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.138 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.138 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.138 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.138 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.138 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.138 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.138 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.138 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.138 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.138 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.138 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-09-21T07:11:46.138 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.139 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.139 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.139 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-09-21T07:11:46.139 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-09-21T07:11:46.139 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.139 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.139 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.139 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-09-21T07:11:46.139 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.139 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.139 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.139 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-09-21T07:11:46.139 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T07:11:46.139 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.140 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.140 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.140 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.140 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.140 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.140 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.140 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.140 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.140 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.140 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.142 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.142 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.142 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.142 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.142 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.142 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.142 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.142 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.142 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.142 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.142 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.142 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.142 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.143 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.143 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.143 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.143 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.143 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.143 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.143 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.143 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.143 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.143 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.143 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.143 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.145 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.145 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.145 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.145 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.145 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.145 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-09-21T07:11:46.145 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-09-21T07:11:46.145 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.145 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.145 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.145 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.145 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.145 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.145 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.146 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-09-21T07:11:46.146 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T07:11:46.146 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.146 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.146 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-09-21T07:11:46.146 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-09-21T07:11:46.146 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.146 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.146 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.146 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-21T07:11:46.146 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.146 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.146 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.147 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-09-21T07:11:46.147 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.147 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.147 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.147 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-09-21T07:11:46.147 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-09-21T07:11:46.147 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.147 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.147 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.147 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-09-21T07:11:46.147 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.147 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.147 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.148 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T07:11:46.148 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.148 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.148 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.148 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-09-21T07:11:46.148 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-09-21T07:11:46.148 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.148 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.148 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.148 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.148 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.148 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.149 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.149 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-09-21T07:11:46.149 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.149 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.149 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.149 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.149 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.149 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.149 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.149 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.149 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.149 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.149 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.149 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.150 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.150 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.150 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.150 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.150 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-09-21T07:11:46.150 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-09-21T07:11:46.150 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.150 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.150 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.150 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-09-21T07:11:46.151 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.151 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.151 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.151 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T07:11:46.151 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T07:11:46.151 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.151 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.151 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.151 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.152 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-09-21T07:11:46.152 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.152 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.152 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.152 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.152 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.152 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.152 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.153 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.153 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.153 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.153 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.153 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.153 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.153 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.153 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.153 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.154 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.154 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.154 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.154 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.154 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.154 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.154 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.154 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.155 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.155 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.155 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.155 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.155 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.155 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.155 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.155 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.155 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.156 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.156 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.156 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.156 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.156 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.156 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.156 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.157 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.157 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.157 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.157 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.157 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.157 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.157 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.157 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.157 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.158 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.158 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.158 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.158 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.158 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.158 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.158 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.158 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.159 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.159 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.159 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.159 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.159 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.159 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.159 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.159 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.159 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.160 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.160 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.160 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.160 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.160 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.160 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.160 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.160 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.161 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.161 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.161 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.161 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.161 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.161 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.161 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.161 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.161 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.162 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-09-21T07:11:46.162 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.162 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.162 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.162 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.162 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.163 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.163 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.163 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.163 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.163 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.163 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.163 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.163 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.163 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.164 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.164 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.164 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.164 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.164 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.164 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.164 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.164 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.165 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.165 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.165 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.165 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.165 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.165 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.165 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.165 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.165 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.165 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.165 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.165 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.165 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.166 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.166 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.166 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.166 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.166 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.166 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.166 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.166 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.166 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.166 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.167 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.167 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.167 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.167 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.167 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.167 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.167 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.167 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.167 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.167 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.168 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.168 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.168 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.168 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.168 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.168 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.168 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.168 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.168 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.168 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.168 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.169 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.169 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.169 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.169 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.169 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.169 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.169 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.169 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.169 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.169 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.169 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.170 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.170 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.170 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.170 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.170 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-09-21T07:11:46.170 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.170 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.170 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.170 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.170 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.170 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.170 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.171 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.171 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.171 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.171 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.171 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.171 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.171 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.171 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.171 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.171 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.172 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.172 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.172 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.172 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.172 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.172 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.172 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.172 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.172 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.172 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.172 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.172 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.172 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.173 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.173 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.173 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.173 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.173 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.173 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.173 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.174 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.174 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.174 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.174 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.174 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.174 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.174 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.174 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.174 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.174 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.174 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.174 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.174 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.175 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.175 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.175 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.175 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.175 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.175 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.175 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.175 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.175 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.175 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.175 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.175 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.176 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.176 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.176 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.176 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.176 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.176 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.176 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.176 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.176 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.176 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.176 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.177 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.177 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.177 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.177 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.177 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.177 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.177 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.177 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.177 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-21T07:11:46.177 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.178 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.178 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.178 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-09-21T07:11:46.178 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-09-21T07:11:46.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.178 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.178 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.178 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.178 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.178 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.178 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.179 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T07:11:46.179 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.179 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.179 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.179 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.179 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.179 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.179 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.179 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.179 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.179 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.179 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.180 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.180 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.180 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.180 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.180 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.180 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.180 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.180 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.180 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.180 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.180 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.180 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.180 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.181 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.181 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.181 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.181 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.181 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.181 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.181 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.181 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.181 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.181 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.181 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.181 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.182 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.182 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.182 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.182 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.182 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.182 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.182 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.182 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.182 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.182 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.182 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.183 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.183 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.183 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.183 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.183 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.183 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.183 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.183 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.183 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.183 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.183 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.183 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.184 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.184 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.184 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.184 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.184 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.184 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.184 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.184 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.184 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-09-21T07:11:46.184 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-21T07:11:46.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.184 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.184 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.184 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.185 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.185 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.185 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.185 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-21T07:11:46.185 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-09-21T07:11:46.185 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-09-21T07:11:46.185 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.185 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-09-21T07:11:46.185 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.185 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.185 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.185 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.185 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.186 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.186 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.186 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.186 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.186 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.186 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.186 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.186 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.186 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.186 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-09-21T07:11:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.188 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.188 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.188 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.188 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.188 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.188 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.188 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.188 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.188 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.188 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.188 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.189 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.189 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.189 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.189 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.189 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.189 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.189 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.189 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.189 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.189 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.189 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.189 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.190 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.190 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.190 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.190 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.190 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.190 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.190 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.190 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.190 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.190 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.190 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.191 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.191 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.191 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.191 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.191 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.191 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.191 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.191 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.191 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.191 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.191 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.191 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.191 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.192 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.192 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.192 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.192 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.192 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.192 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.192 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.192 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.192 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.193 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.193 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.193 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.193 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.193 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.193 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.193 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.193 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.193 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.193 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.193 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.193 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.193 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.194 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-09-21T07:11:46.194 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.194 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.194 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.194 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.194 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.194 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.194 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.195 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.195 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.195 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.195 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.195 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.195 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.195 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.195 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.195 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.195 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.195 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.196 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.196 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.196 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.196 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.196 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.196 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.196 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.196 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.196 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.196 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.196 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.196 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.196 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.196 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.197 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.197 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.197 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.197 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.197 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.197 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.197 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.197 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.197 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.197 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.198 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.198 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.198 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.198 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.198 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.198 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.198 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.198 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.198 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.198 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.198 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.198 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.199 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.199 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.199 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.199 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.199 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.199 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.199 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.200 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.200 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.200 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.200 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.200 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.200 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.200 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.200 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.200 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.200 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.200 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.200 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.201 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.201 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.201 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.201 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.201 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.201 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.201 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.201 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.201 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.201 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-09-21T07:11:46.201 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.201 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.202 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.202 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.202 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.202 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.202 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.202 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.202 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.202 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.202 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.202 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.202 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.202 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.203 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.203 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.203 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.203 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.203 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.203 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.203 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.203 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.203 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.203 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.203 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.203 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.204 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.204 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.204 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.204 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.204 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.204 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.204 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.204 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.204 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.204 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.204 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.204 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.204 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.204 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.205 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.205 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.205 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.205 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.205 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.205 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.205 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.205 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.205 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.205 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.205 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.205 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.205 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.205 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.205 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.206 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.206 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.206 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.206 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.206 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.206 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.206 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.206 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.206 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.206 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.206 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.206 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.206 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.207 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.207 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-21T07:11:46.207 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-21T07:11:46.207 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.207 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.207 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.207 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-21T07:11:46.207 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.207 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.207 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.207 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.207 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.207 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.207 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.208 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.208 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.208 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.208 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.208 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.208 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.208 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.208 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.208 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.208 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.208 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.208 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.208 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.209 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-09-21T07:11:46.209 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-09-21T07:11:46.209 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-21T07:11:46.209 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.209 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.209 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-21T07:11:46.209 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-09-21T07:11:46.209 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.209 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.209 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-09-21T07:11:46.209 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T07:11:46.210 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.210 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.210 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.210 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.210 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-09-21T07:11:46.210 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.210 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.210 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.210 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-09-21T07:11:46.210 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-09-21T07:11:46.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.210 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.211 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.211 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.211 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.211 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.211 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.211 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T07:11:46.211 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.211 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.211 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.211 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-21T07:11:46.211 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-21T07:11:46.211 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.211 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.211 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.212 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.212 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.212 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.212 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.212 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.212 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.212 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.212 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.212 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.212 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.212 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.212 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.212 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.213 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.213 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.213 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.213 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.213 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.213 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.213 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.213 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.213 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.213 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.213 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.214 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.214 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.214 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.214 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.214 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.214 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.214 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.214 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.214 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.214 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.214 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.214 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.214 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.215 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.215 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.215 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.215 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.215 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.215 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.215 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.215 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.215 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.215 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.215 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.215 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.215 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.215 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.216 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.216 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.216 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.216 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.216 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.216 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.216 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.216 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.216 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.216 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.216 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.217 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.218 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-09-21T07:11:46.218 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.218 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.218 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.218 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-09-21T07:11:46.218 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.218 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.218 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.218 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-21T07:11:46.218 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-21T07:11:46.218 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.218 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.218 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.219 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-21T07:11:46.219 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.219 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.219 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.219 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-09-21T07:11:46.219 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.219 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.219 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.219 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.219 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.219 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.219 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.220 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.220 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.220 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.220 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.220 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.220 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.220 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.220 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.220 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.220 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.220 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.221 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-09-21T07:11:46.221 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.221 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.221 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.221 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-09-21T07:11:46.221 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-09-21T07:11:46.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.221 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.221 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.221 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.221 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.221 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.221 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.222 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.222 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.222 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.222 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.222 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-09-21T07:11:46.222 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-09-21T07:11:46.222 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.222 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.222 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.222 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.222 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.222 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.222 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.223 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T07:11:46.223 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T07:11:46.223 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.223 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.223 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.223 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.223 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.223 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.223 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.223 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.223 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.224 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.224 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.224 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.224 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.224 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.224 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.224 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.224 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.224 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.224 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.224 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.224 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.224 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.225 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.225 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.225 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.225 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.225 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.225 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.225 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.225 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.226 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.226 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.226 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.226 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.226 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.226 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.227 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.227 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.227 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.227 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.227 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.227 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.227 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.228 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.228 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.228 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.228 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.228 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.228 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.228 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.228 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.228 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.229 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.229 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.229 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.229 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.229 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.229 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.229 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.230 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.230 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.230 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.230 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.230 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.230 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.230 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.230 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-09-21T07:11:46.231 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-09-21T07:11:46.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.231 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.231 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.231 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.231 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.231 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.231 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.231 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T07:11:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T07:11:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-09-21T07:11:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-09-21T07:11:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-09-21T07:11:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-21T07:11:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-09-21T07:11:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-21T07:11:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-21T07:11:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-21T07:11:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T07:11:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-21T07:11:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-21T07:11:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-09-21T07:11:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T07:11:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-09-21T07:11:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-09-21T07:11:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-09-21T07:11:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-21T07:11:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-21T07:11:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-09-21T07:11:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-09-21T07:11:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-09-21T07:11:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-21T07:11:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-21T07:11:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-21T07:11:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-21T07:11:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-21T07:11:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-21T07:11:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-09-21T07:11:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-09-21T07:11:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-21T07:11:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-09-21T07:11:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T07:11:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-09-21T07:11:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-09-21T07:11:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-09-21T07:11:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-09-21T07:11:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-09-21T07:11:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-21T07:11:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-21T07:11:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "max_requests": { 2024-09-21T07:11:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_requests", 2024-09-21T07:11:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-21T07:11:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T07:11:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-21T07:11:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-21T07:11:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-21T07:11:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-21T07:11:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-09-21T07:11:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-09-21T07:11:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-09-21T07:11:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-09-21T07:11:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-09-21T07:11:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T07:11:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-09-21T07:11:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-09-21T07:11:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-09-21T07:11:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-09-21T07:11:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-09-21T07:11:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-09-21T07:11:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-09-21T07:11:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-09-21T07:11:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-09-21T07:11:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-09-21T07:11:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-09-21T07:11:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-09-21T07:11:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-21T07:11:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-09-21T07:11:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-09-21T07:11:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-09-21T07:11:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-09-21T07:11:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-09-21T07:11:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-09-21T07:11:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-09-21T07:11:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-09-21T07:11:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-21T07:11:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-09-21T07:11:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-09-21T07:11:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-09-21T07:11:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-09-21T07:11:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-09-21T07:11:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-09-21T07:11:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-09-21T07:11:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smb", 2024-09-21T07:11:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "internal_store_backend": { 2024-09-21T07:11:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "internal_store_backend", 2024-09-21T07:11:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T07:11:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "update_orchestration": { 2024-09-21T07:11:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "update_orchestration", 2024-09-21T07:11:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T07:11:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-21T07:11:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-09-21T07:11:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-09-21T07:11:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T07:11:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-09-21T07:11:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-09-21T07:11:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-09-21T07:11:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-09-21T07:11:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-09-21T07:11:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-09-21T07:11:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-09-21T07:11:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-09-21T07:11:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T07:11:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-21T07:11:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-21T07:11:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-09-21T07:11:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-09-21T07:11:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-09-21T07:11:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-09-21T07:11:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T07:11:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-09-21T07:11:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-09-21T07:11:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T07:11:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-09-21T07:11:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-09-21T07:11:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T07:11:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-09-21T07:11:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-09-21T07:11:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T07:11:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-09-21T07:11:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-09-21T07:11:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T07:11:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-09-21T07:11:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-09-21T07:11:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-09-21T07:11:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-09-21T07:11:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-09-21T07:11:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-09-21T07:11:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T07:11:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-21T07:11:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-21T07:11:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-21T07:11:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-21T07:11:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-09-21T07:11:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-09-21T07:11:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-09-21T07:11:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-09-21T07:11:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-09-21T07:11:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-09-21T07:11:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-09-21T07:11:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-09-21T07:11:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-09-21T07:11:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-09-21T07:11:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-09-21T07:11:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-09-21T07:11:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-09-21T07:11:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-09-21T07:11:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-09-21T07:11:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T07:11:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-09-21T07:11:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-21T07:11:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.413 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.414 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.415 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.416 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-09-21T07:11:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-09-21T07:11:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-09-21T07:11:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T07:11:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.417 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.418 INFO:teuthology.orchestra.run.smithi018.stdout: "periodic_async_work": { 2024-09-21T07:11:46.418 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "periodic_async_work", 2024-09-21T07:11:46.418 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.418 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.418 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.418 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.418 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.418 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.418 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.418 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Periodically check for async work", 2024-09-21T07:11:46.418 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.418 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.418 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.419 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-09-21T07:11:46.419 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-09-21T07:11:46.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.419 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.419 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.419 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.419 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.419 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.419 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.419 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T07:11:46.419 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.419 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.419 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-09-21T07:11:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T07:11:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T07:11:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.421 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.421 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.421 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.421 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.421 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.421 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.421 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.421 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.421 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.421 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.421 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.421 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.421 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.422 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-09-21T07:11:46.422 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.422 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.422 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.422 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-09-21T07:11:46.422 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-09-21T07:11:46.422 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-21T07:11:46.422 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.422 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.422 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-09-21T07:11:46.422 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.422 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.422 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.422 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.423 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.423 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.423 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.423 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-09-21T07:11:46.423 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-09-21T07:11:46.423 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.423 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.423 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.423 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.423 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.423 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.423 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.423 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.423 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.424 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.424 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.424 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-21T07:11:46.424 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-21T07:11:46.424 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.424 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.424 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.424 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-21T07:11:46.424 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.424 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.424 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.424 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.424 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.424 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.425 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.425 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.425 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.425 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.425 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.425 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.425 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.425 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.425 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.425 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.425 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.425 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.425 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.426 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.426 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.426 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.426 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.426 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.426 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.426 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.426 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.426 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.426 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.426 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.426 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.427 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.427 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.427 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.427 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.427 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.427 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.427 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.427 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.427 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.427 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.427 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.427 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.427 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.428 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.428 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.428 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.428 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.428 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.428 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.428 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.428 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.428 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.428 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.428 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.428 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.428 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.428 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.429 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.429 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.429 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.429 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.429 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.429 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.429 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.429 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.429 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.429 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.429 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.429 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.430 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.430 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.430 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.430 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.430 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.430 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.430 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.430 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.430 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.430 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.430 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.430 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.430 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.430 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-09-21T07:11:46.431 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-09-21T07:11:46.431 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.431 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.431 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.431 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.431 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.431 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.431 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.431 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.431 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.431 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.431 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.431 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-09-21T07:11:46.432 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-09-21T07:11:46.432 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.432 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.432 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.432 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-09-21T07:11:46.432 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.432 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.432 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.432 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.432 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.432 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.432 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.432 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-09-21T07:11:46.432 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-09-21T07:11:46.433 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.433 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.433 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.433 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T07:11:46.433 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.433 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.433 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.433 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.433 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.433 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.433 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.433 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.433 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.433 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.433 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-21T07:11:46.434 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.434 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.434 INFO:teuthology.orchestra.run.smithi018.stdout: "modules": [ 2024-09-21T07:11:46.434 INFO:teuthology.orchestra.run.smithi018.stdout: "iostat", 2024-09-21T07:11:46.434 INFO:teuthology.orchestra.run.smithi018.stdout: "nfs", 2024-09-21T07:11:46.434 INFO:teuthology.orchestra.run.smithi018.stdout: "restful" 2024-09-21T07:11:46.434 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.434 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-09-21T07:11:46.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.434 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-09-21T07:11:46.434 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.434 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.434 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.434 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-21T07:11:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-21T07:11:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-21T07:11:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T07:11:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.439 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.442 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.442 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.442 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.442 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.442 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.442 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.442 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.442 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.442 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.442 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.442 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.442 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.443 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-09-21T07:11:46.443 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-09-21T07:11:46.443 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.443 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.443 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.443 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.443 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.443 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.443 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.443 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T07:11:46.443 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.443 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.443 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.443 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-09-21T07:11:46.444 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-09-21T07:11:46.444 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.444 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.444 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.444 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-09-21T07:11:46.444 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.444 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.444 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.444 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-09-21T07:11:46.444 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.444 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.444 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.444 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-09-21T07:11:46.444 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-09-21T07:11:46.445 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.445 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.445 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.445 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.445 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.445 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.445 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.445 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-09-21T07:11:46.445 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.445 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.445 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.445 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-09-21T07:11:46.445 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-09-21T07:11:46.446 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.446 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.446 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.446 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.446 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.446 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.446 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.446 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-09-21T07:11:46.446 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.446 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.446 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.446 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-09-21T07:11:46.446 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-09-21T07:11:46.446 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.447 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.447 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.447 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-09-21T07:11:46.447 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.447 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.447 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.447 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-09-21T07:11:46.447 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.447 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.447 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.447 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-09-21T07:11:46.447 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-09-21T07:11:46.447 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.447 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.448 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.448 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.448 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.448 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.448 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.448 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-09-21T07:11:46.448 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.448 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.448 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.448 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-09-21T07:11:46.448 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-09-21T07:11:46.448 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.448 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.448 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.449 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.449 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.449 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.449 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.449 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T07:11:46.449 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.449 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.449 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.449 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-09-21T07:11:46.449 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-09-21T07:11:46.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.449 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.449 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.449 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.450 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.450 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.450 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.450 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-09-21T07:11:46.450 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.450 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.450 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.450 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.450 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.450 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.450 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.450 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.450 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.451 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.451 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.451 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.451 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.451 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.451 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.451 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.451 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.451 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.451 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-09-21T07:11:46.451 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.451 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.452 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.452 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-09-21T07:11:46.452 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-09-21T07:11:46.452 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.452 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.452 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.452 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.452 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.452 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.452 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.452 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T07:11:46.452 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.452 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.452 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.453 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-09-21T07:11:46.453 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-09-21T07:11:46.453 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.453 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.453 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.453 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-09-21T07:11:46.453 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.453 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.453 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.453 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T07:11:46.453 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:11:46.453 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.453 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.453 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-09-21T07:11:46.454 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-21T07:11:46.455 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.455 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.455 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-09-21T07:11:46.455 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-21T07:11:46.455 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-09-21T07:11:46.455 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.455 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T07:11:46.455 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.455 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.455 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.455 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-09-21T07:11:46.455 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-09-21T07:11:46.455 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.456 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.456 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.456 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T07:11:46.456 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.456 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.456 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.456 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T07:11:46.456 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T07:11:46.456 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.456 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.456 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-09-21T07:11:46.456 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-09-21T07:11:46.456 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-21T07:11:46.456 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-09-21T07:11:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-09-21T07:11:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-09-21T07:11:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-09-21T07:11:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T07:11:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-09-21T07:11:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-09-21T07:11:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.457 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.458 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-09-21T07:11:46.458 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.458 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.458 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.458 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T07:11:46.458 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:11:46.458 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.458 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.458 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-09-21T07:11:46.458 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-09-21T07:11:46.458 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-21T07:11:46.458 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.458 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.458 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.459 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-09-21T07:11:46.459 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-09-21T07:11:46.459 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.459 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T07:11:46.459 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:11:46.459 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.459 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.459 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.459 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.459 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.459 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.459 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.459 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.460 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.460 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.460 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.460 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.460 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.460 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.460 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.460 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.460 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.460 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.460 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.460 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.460 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-09-21T07:11:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-09-21T07:11:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-21T07:11:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T07:11:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-21T07:11:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-21T07:11:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-09-21T07:11:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-09-21T07:11:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-09-21T07:11:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "read", 2024-09-21T07:11:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap", 2024-09-21T07:11:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap-read" 2024-09-21T07:11:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-09-21T07:11:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-09-21T07:11:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-09-21T07:11:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T07:11:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-21T07:11:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-21T07:11:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-21T07:11:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T07:11:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-09-21T07:11:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-09-21T07:11:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-21T07:11:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-21T07:11:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T07:11:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T07:11:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-09-21T07:11:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-09-21T07:11:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-21T07:11:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-21T07:11:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T07:11:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-09-21T07:11:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-09-21T07:11:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-09-21T07:11:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-21T07:11:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-21T07:11:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T07:11:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-09-21T07:11:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-09-21T07:11:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-09-21T07:11:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T07:11:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-09-21T07:11:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-09-21T07:11:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-09-21T07:11:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T07:11:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-09-21T07:11:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-09-21T07:11:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T07:11:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T07:11:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-09-21T07:11:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-09-21T07:11:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-21T07:11:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T07:11:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-09-21T07:11:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T07:11:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-21T07:11:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-09-21T07:11:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T07:11:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_log_destination": { 2024-09-21T07:11:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm_log_destination", 2024-09-21T07:11:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "file", 2024-09-21T07:11:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "file,syslog", 2024-09-21T07:11:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "syslog" 2024-09-21T07:11:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T07:11:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-09-21T07:11:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-09-21T07:11:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T07:11:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-09-21T07:11:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-09-21T07:11:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T07:11:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-09-21T07:11:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-09-21T07:11:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T07:11:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-09-21T07:11:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-09-21T07:11:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T07:11:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-21T07:11:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-09-21T07:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-09-21T07:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T07:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-09-21T07:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-09-21T07:11:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-09-21T07:11:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T07:11:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-21T07:11:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-09-21T07:11:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-09-21T07:11:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T07:11:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-09-21T07:11:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-09-21T07:11:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-09-21T07:11:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T07:11:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-09-21T07:11:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-09-21T07:11:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-09-21T07:11:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T07:11:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-09-21T07:11:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-09-21T07:11:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-09-21T07:11:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T07:11:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-09-21T07:11:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-09-21T07:11:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-09-21T07:11:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T07:11:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-09-21T07:11:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-09-21T07:11:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-09-21T07:11:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T07:11:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-09-21T07:11:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nginx": { 2024-09-21T07:11:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nginx", 2024-09-21T07:11:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T07:11:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nginx container image", 2024-09-21T07:11:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-09-21T07:11:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-09-21T07:11:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T07:11:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-21T07:11:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-09-21T07:11:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-09-21T07:11:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T07:11:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-09-21T07:11:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_oauth2_proxy": { 2024-09-21T07:11:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T07:11:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T07:11:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "oauth2-proxy container image", 2024-09-21T07:11:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-09-21T07:11:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-09-21T07:11:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T07:11:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-09-21T07:11:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-09-21T07:11:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-09-21T07:11:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T07:11:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-09-21T07:11:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba": { 2024-09-21T07:11:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba", 2024-09-21T07:11:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T07:11:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB container image", 2024-09-21T07:11:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba_metrics": { 2024-09-21T07:11:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba_metrics", 2024-09-21T07:11:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T07:11:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T07:11:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-09-21T07:11:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-09-21T07:11:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T07:11:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-09-21T07:11:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-09-21T07:11:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-09-21T07:11:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T07:11:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-09-21T07:11:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-09-21T07:11:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-21T07:11:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T07:11:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-09-21T07:11:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T07:11:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-09-21T07:11:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T07:11:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-09-21T07:11:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-09-21T07:11:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-09-21T07:11:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T07:11:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-09-21T07:11:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-09-21T07:11:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-09-21T07:11:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-09-21T07:11:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-09-21T07:11:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-09-21T07:11:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T07:11:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-09-21T07:11:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-09-21T07:11:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-21T07:11:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-09-21T07:11:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "grafana_dashboards_path": { 2024-09-21T07:11:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "grafana_dashboards_path", 2024-09-21T07:11:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T07:11:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T07:11:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-09-21T07:11:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-09-21T07:11:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-21T07:11:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-09-21T07:11:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-09-21T07:11:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-09-21T07:11:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T07:11:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-09-21T07:11:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-09-21T07:11:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T07:11:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-09-21T07:11:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-09-21T07:11:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T07:11:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T07:11:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T07:11:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T07:11:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T07:11:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T07:11:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T07:11:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-09-21T07:11:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T07:11:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-09-21T07:11:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-09-21T07:11:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-21T07:11:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-09-21T07:11:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-09-21T07:11:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-09-21T07:11:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-21T07:11:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T07:11:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-09-21T07:11:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-09-21T07:11:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-09-21T07:11:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T07:11:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-09-21T07:11:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-09-21T07:11:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-09-21T07:11:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T07:11:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-09-21T07:11:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-09-21T07:11:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T07:11:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T07:11:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-09-21T07:11:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-09-21T07:11:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T07:11:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-09-21T07:11:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-09-21T07:11:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T07:11:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-09-21T07:11:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-09-21T07:11:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T07:11:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-09-21T07:11:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-09-21T07:11:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T07:11:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-09-21T07:11:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-09-21T07:11:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-09-21T07:11:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-09-21T07:11:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-09-21T07:11:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-09-21T07:11:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T07:11:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_keepalive_count_max": { 2024-09-21T07:11:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T07:11:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-21T07:11:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T07:11:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_keepalive_interval": { 2024-09-21T07:11:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_keepalive_interval", 2024-09-21T07:11:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-09-21T07:11:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T07:11:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-09-21T07:11:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-09-21T07:11:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T07:11:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-09-21T07:11:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-09-21T07:11:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T07:11:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-09-21T07:11:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-09-21T07:11:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T07:11:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-09-21T07:11:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-09-21T07:11:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T07:11:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-09-21T07:11:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-09-21T07:11:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T07:11:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-09-21T07:11:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-09-21T07:11:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-09-21T07:11:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-09-21T07:11:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-09-21T07:11:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-09-21T07:11:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T07:11:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-09-21T07:11:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T07:11:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T07:11:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-21T07:11:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T07:11:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T07:11:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T07:11:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T07:11:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-09-21T07:11:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T07:11:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T07:11:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T07:11:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T07:11:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T07:11:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T07:11:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T07:11:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T07:11:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T07:11:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T07:11:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T07:11:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T07:11:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T07:11:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T07:11:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T07:11:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T07:11:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T07:11:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T07:11:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T07:11:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T07:11:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T07:11:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T07:11:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T07:11:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-21T07:11:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T07:11:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T07:11:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-09-21T07:11:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-09-21T07:11:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T07:11:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T07:11:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-21T07:11:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T07:11:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T07:11:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.565 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.565 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.565 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.565 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T07:11:46.565 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T07:11:46.565 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.565 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.565 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.565 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.565 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.565 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.565 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.565 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.565 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.566 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.566 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.566 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T07:11:46.566 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T07:11:46.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.566 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.566 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.566 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.566 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.566 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.566 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.566 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.566 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.566 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T07:11:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T07:11:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.568 INFO:teuthology.orchestra.run.smithi018.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T07:11:46.568 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T07:11:46.568 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.568 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.568 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.568 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "[]", 2024-09-21T07:11:46.568 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.568 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.568 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.568 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.568 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.568 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.568 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.569 INFO:teuthology.orchestra.run.smithi018.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T07:11:46.569 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T07:11:46.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.569 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.569 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.569 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "{}", 2024-09-21T07:11:46.569 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.569 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.569 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.569 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.569 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.569 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.569 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.570 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T07:11:46.570 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T07:11:46.570 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.570 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.570 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.570 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.570 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.570 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.570 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.570 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.570 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.570 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.570 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.570 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T07:11:46.571 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T07:11:46.571 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.571 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.571 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.571 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.571 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.571 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.571 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.571 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.571 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.571 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.571 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.571 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T07:11:46.571 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T07:11:46.572 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.572 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.572 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.572 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.572 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.572 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.572 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.572 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.572 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.572 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.572 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.572 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T07:11:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.574 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.574 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.574 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.574 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.574 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.574 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.574 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.574 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.574 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.574 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.574 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T07:11:46.574 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T07:11:46.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.575 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.575 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.575 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.575 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.575 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.575 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.575 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.575 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.575 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.575 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.575 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T07:11:46.575 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T07:11:46.575 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.575 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.576 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.576 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.576 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.576 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.576 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.576 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.576 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.576 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.576 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.576 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T07:11:46.576 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T07:11:46.576 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.576 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.576 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.577 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.577 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.577 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.577 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.577 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.577 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.577 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.577 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.577 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T07:11:46.577 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T07:11:46.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.577 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.577 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.577 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.578 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.578 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.578 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.578 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.578 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.578 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.578 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.578 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T07:11:46.578 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T07:11:46.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.578 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.578 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.578 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.579 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.579 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.579 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.579 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.579 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.579 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.579 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.579 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T07:11:46.579 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T07:11:46.579 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.579 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.579 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.579 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T07:11:46.579 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.580 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.580 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.580 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.580 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.580 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.580 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.580 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T07:11:46.580 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T07:11:46.580 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.580 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.580 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.580 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-21T07:11:46.580 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.580 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.581 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.581 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.581 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.581 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.581 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.581 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T07:11:46.581 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T07:11:46.581 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.581 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.581 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.581 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-09-21T07:11:46.581 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.581 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.582 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.582 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.582 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.582 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.582 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.582 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T07:11:46.582 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T07:11:46.582 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.582 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.582 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.582 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-09-21T07:11:46.582 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.582 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.583 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.583 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.583 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.583 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.583 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.583 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T07:11:46.583 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T07:11:46.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.583 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.583 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.583 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.583 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.583 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.584 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.584 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.584 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.584 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.584 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.584 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T07:11:46.584 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T07:11:46.584 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.584 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.584 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.584 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-09-21T07:11:46.584 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.584 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.584 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.585 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.585 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.585 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.585 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.585 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T07:11:46.585 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T07:11:46.585 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.585 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.585 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.585 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.585 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.585 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.585 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.585 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.586 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.586 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.586 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.586 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T07:11:46.586 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T07:11:46.586 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.586 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.586 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.586 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.586 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.586 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.586 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.586 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.587 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.587 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.587 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.587 INFO:teuthology.orchestra.run.smithi018.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T07:11:46.587 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T07:11:46.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.587 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.587 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.587 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.587 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.587 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.587 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.587 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.588 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.588 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.588 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.588 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T07:11:46.588 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T07:11:46.588 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.588 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.588 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.588 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.588 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.588 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.588 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.588 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.588 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.589 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.589 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T07:11:46.589 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T07:11:46.589 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.589 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.589 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.589 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-21T07:11:46.589 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.589 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.589 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.589 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.589 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.590 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.590 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T07:11:46.590 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T07:11:46.590 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.590 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.590 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.590 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-21T07:11:46.590 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.590 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.590 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.590 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.590 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.590 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.591 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.591 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-09-21T07:11:46.591 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-09-21T07:11:46.591 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.591 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.591 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.591 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.591 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.591 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.591 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.591 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.591 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.591 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.591 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.592 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-09-21T07:11:46.592 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-09-21T07:11:46.592 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.592 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.592 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.592 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.592 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.592 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.592 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.592 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.592 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.592 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.593 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.593 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-09-21T07:11:46.593 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-09-21T07:11:46.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.593 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.593 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.593 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.593 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.593 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.593 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.593 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-09-21T07:11:46.593 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.593 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.594 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.594 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-09-21T07:11:46.594 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-09-21T07:11:46.594 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.594 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.594 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.594 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-09-21T07:11:46.594 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.594 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.594 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.594 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.594 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.594 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.594 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.595 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-21T07:11:46.595 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-21T07:11:46.595 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.595 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.595 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.595 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.595 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.595 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.595 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.595 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.595 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.595 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.595 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.597 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.597 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.597 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.597 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.597 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.597 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.597 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.597 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.597 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.597 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.597 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.597 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.597 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.597 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.598 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.598 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.598 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.598 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.598 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.598 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.598 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.598 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.598 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.598 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.598 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.598 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.598 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.599 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.599 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.599 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.599 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.599 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.599 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.599 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.599 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.599 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.599 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.599 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.599 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.599 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-09-21T07:11:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-09-21T07:11:46.600 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.601 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.601 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.601 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.601 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.601 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.601 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.601 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-09-21T07:11:46.601 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.601 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.601 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.601 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-09-21T07:11:46.601 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T07:11:46.601 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.602 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.602 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.602 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.602 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.602 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.602 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.602 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.602 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.602 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.602 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.602 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-21T07:11:46.602 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-21T07:11:46.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.602 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.603 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-21T07:11:46.603 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.603 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.603 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.603 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.603 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.603 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.603 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.603 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-21T07:11:46.603 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-21T07:11:46.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.603 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.604 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.604 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-09-21T07:11:46.604 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.604 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.604 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.604 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.604 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.604 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.604 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.604 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.604 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.604 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.604 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.605 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.605 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.605 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.605 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.605 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.605 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.605 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.605 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.605 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-21T07:11:46.605 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-21T07:11:46.605 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.605 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.605 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.605 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.606 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.606 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.606 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.606 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.606 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.606 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.606 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.606 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-09-21T07:11:46.606 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-09-21T07:11:46.606 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.606 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.606 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.606 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-09-21T07:11:46.607 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.607 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.607 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.607 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.607 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.607 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.607 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.607 INFO:teuthology.orchestra.run.smithi018.stdout: "sso_oauth2": { 2024-09-21T07:11:46.607 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sso_oauth2", 2024-09-21T07:11:46.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.607 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.607 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.607 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.608 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.608 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.608 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.608 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.608 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.608 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.608 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.608 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-21T07:11:46.608 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-21T07:11:46.608 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.608 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.608 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.608 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-09-21T07:11:46.609 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.609 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.609 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.609 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.609 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-09-21T07:11:46.609 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.609 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.609 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.609 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.609 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.609 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-21T07:11:46.609 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-21T07:11:46.609 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.609 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.610 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.610 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-21T07:11:46.610 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-21T07:11:46.610 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-21T07:11:46.610 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.610 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.610 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.610 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.610 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.610 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-09-21T07:11:46.610 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-09-21T07:11:46.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.610 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.610 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.611 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.611 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.611 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.611 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.611 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.611 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.611 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.611 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.611 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-21T07:11:46.611 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-09-21T07:11:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-09-21T07:11:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-09-21T07:11:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.613 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.613 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.613 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.613 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.613 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.613 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.613 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.613 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.613 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.613 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.613 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.613 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.613 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.613 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.614 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.614 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.614 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.614 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.614 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.614 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.614 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.614 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.614 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.614 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.614 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.614 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.614 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.615 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.615 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.615 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.615 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.615 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.615 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.615 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.615 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.615 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.615 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.615 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.615 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.615 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.615 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.616 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.616 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.616 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.616 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.616 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.616 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.616 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.616 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.616 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.616 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.616 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.616 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.616 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.616 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.617 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.617 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.617 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.617 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.617 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.617 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.617 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.617 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.617 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.617 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.617 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.617 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-09-21T07:11:46.617 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-09-21T07:11:46.618 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.618 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.618 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.618 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-09-21T07:11:46.618 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.618 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.618 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.618 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T07:11:46.618 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.618 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.618 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.618 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-09-21T07:11:46.618 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-09-21T07:11:46.618 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.619 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.619 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.619 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-09-21T07:11:46.619 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.619 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.619 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.619 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T07:11:46.619 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.619 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.619 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.619 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-09-21T07:11:46.619 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-09-21T07:11:46.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.620 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.620 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.620 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-09-21T07:11:46.620 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.620 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.620 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.620 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-09-21T07:11:46.620 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.620 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.620 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.620 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-09-21T07:11:46.620 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-09-21T07:11:46.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.620 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.621 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.621 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-21T07:11:46.621 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.621 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.621 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.621 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T07:11:46.621 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.621 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.621 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.621 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-09-21T07:11:46.621 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-09-21T07:11:46.621 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.621 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.621 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.622 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.622 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.622 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.622 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.622 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T07:11:46.622 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.622 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.622 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.622 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-21T07:11:46.622 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-21T07:11:46.622 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.622 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.622 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.622 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-21T07:11:46.623 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.623 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.623 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.623 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T07:11:46.623 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.623 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.623 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.623 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.623 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.623 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.623 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.623 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.623 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.623 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.624 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.624 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.624 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.624 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.624 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.624 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.624 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-09-21T07:11:46.624 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-09-21T07:11:46.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.624 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.624 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.624 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-09-21T07:11:46.624 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.625 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.625 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.625 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T07:11:46.625 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.625 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.625 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.625 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.625 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.625 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-09-21T07:11:46.625 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.625 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.625 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.626 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.626 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.626 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.626 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.626 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.626 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.626 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.626 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.626 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.626 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.626 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.626 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.626 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.626 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.626 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.627 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.627 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.627 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.627 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.627 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.627 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.627 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.627 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.627 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.627 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.627 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.627 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.627 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.628 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.628 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.628 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.628 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.628 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.628 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.628 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.628 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.628 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.628 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.628 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.628 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.628 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.629 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.629 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.629 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.629 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.629 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.629 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.629 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.629 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.629 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.629 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.629 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.629 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.630 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.630 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.630 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.630 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.630 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.630 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.630 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.630 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.630 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.630 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.630 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-09-21T07:11:46.630 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-09-21T07:11:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-09-21T07:11:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-09-21T07:11:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-09-21T07:11:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.632 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.632 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.632 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-09-21T07:11:46.632 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.632 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.632 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.632 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.632 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.632 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.632 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.632 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-21T07:11:46.632 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-21T07:11:46.632 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.633 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.633 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.633 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-09-21T07:11:46.633 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.633 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.633 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.633 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.633 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.633 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.633 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.633 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.633 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.633 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.634 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.634 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.634 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.634 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.634 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.634 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.634 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.634 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.634 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.634 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-09-21T07:11:46.634 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-09-21T07:11:46.635 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-09-21T07:11:46.635 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.635 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-09-21T07:11:46.635 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-09-21T07:11:46.635 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.635 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.635 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.635 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-09-21T07:11:46.635 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.635 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.635 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.635 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T07:11:46.635 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.635 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.635 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.636 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-09-21T07:11:46.636 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-09-21T07:11:46.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.636 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.636 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.636 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-09-21T07:11:46.636 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.636 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.636 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.636 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T07:11:46.636 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.636 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.636 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.637 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-09-21T07:11:46.637 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-09-21T07:11:46.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.637 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.637 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.637 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.637 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.637 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.637 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.637 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-09-21T07:11:46.637 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.637 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.637 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.637 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-21T07:11:46.638 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-21T07:11:46.638 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.638 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.638 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.638 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-09-21T07:11:46.638 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-09-21T07:11:46.638 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.638 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.638 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T07:11:46.638 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.638 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.638 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.638 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.638 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.640 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.640 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.640 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.640 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.640 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.640 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.640 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.640 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.640 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.640 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.640 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.640 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.640 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.641 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.641 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.641 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.641 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.641 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.641 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.641 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.641 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.641 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.641 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.641 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.641 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.641 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.641 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.643 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.643 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.643 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.643 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.643 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.643 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.643 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.643 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.643 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.643 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-09-21T07:11:46.643 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-09-21T07:11:46.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.643 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.644 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.644 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.644 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.644 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.644 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.644 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-09-21T07:11:46.644 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.644 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.644 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.644 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-09-21T07:11:46.644 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-09-21T07:11:46.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.644 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.644 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-09-21T07:11:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-09-21T07:11:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.645 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-09-21T07:11:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-09-21T07:11:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-09-21T07:11:46.646 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:11:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-09-21T07:11:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-09-21T07:11:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-21T07:11:46.647 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-21T07:11:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-09-21T07:11:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T07:11:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-09-21T07:11:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-09-21T07:11:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.648 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-09-21T07:11:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-09-21T07:11:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-09-21T07:11:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-09-21T07:11:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.649 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:11:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-09-21T07:11:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.651 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.653 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.654 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.655 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-09-21T07:11:46.656 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.657 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.658 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.659 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.659 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.659 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.659 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.659 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.659 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.659 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.659 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.659 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.659 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.659 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.659 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.661 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.661 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.661 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.661 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.661 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.661 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.661 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.661 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.661 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.661 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.661 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.661 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.661 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.662 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.662 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.662 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.662 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.662 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.662 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.662 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.662 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.662 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.662 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.662 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.662 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.662 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.662 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.663 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-09-21T07:11:46.663 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.663 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.663 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.663 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-09-21T07:11:46.663 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-09-21T07:11:46.663 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.663 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.663 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.663 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-09-21T07:11:46.663 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.663 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.664 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.664 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-09-21T07:11:46.664 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T07:11:46.664 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.664 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.664 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.664 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.664 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.664 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.664 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.664 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.664 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.664 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.665 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.666 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.666 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.666 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.666 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.666 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.666 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.666 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.666 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.666 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.666 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.666 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.666 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.666 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.667 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.669 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-09-21T07:11:46.669 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-09-21T07:11:46.669 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.669 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.669 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.669 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.669 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.669 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.669 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.669 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-09-21T07:11:46.669 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T07:11:46.669 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.669 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.670 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-09-21T07:11:46.670 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-09-21T07:11:46.670 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.670 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.670 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.670 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-09-21T07:11:46.670 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.670 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.670 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.670 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-09-21T07:11:46.670 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.670 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.670 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-09-21T07:11:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-09-21T07:11:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-09-21T07:11:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T07:11:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-09-21T07:11:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-09-21T07:11:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-09-21T07:11:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-09-21T07:11:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-09-21T07:11:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-09-21T07:11:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T07:11:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T07:11:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-09-21T07:11:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-09-21T07:11:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-09-21T07:11:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.691 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.691 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.691 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.691 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.691 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.691 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.691 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.691 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.691 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.691 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.691 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.691 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-21T07:11:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-09-21T07:11:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-09-21T07:11:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T07:11:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-09-21T07:11:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-09-21T07:11:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-09-21T07:11:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-09-21T07:11:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-09-21T07:11:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-09-21T07:11:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-09-21T07:11:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-09-21T07:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-09-21T07:11:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-21T07:11:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-21T07:11:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-21T07:11:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-09-21T07:11:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-09-21T07:11:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-21T07:11:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-09-21T07:11:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-09-21T07:11:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-09-21T07:11:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T07:11:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-09-21T07:11:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-09-21T07:11:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-09-21T07:11:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T07:11:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-21T07:11:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-21T07:11:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-09-21T07:11:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-09-21T07:11:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-09-21T07:11:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-09-21T07:11:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-09-21T07:11:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-09-21T07:11:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-21T07:11:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-09-21T07:11:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-09-21T07:11:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-09-21T07:11:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-09-21T07:11:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-09-21T07:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-09-21T07:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T07:11:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T07:11:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-09-21T07:11:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-09-21T07:11:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T07:11:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T07:11:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-09-21T07:11:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-09-21T07:11:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-09-21T07:11:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-21T07:11:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-09-21T07:11:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-21T07:11:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-21T07:11:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-09-21T07:11:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T07:11:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-21T07:11:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-21T07:11:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-09-21T07:11:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T07:11:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-09-21T07:11:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-09-21T07:11:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-09-21T07:11:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-09-21T07:11:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-09-21T07:11:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-09-21T07:11:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-09-21T07:11:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-09-21T07:11:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-09-21T07:11:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-09-21T07:11:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-21T07:11:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-09-21T07:11:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-09-21T07:11:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-21T07:11:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-09-21T07:11:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-09-21T07:11:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-09-21T07:11:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-09-21T07:11:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T07:11:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-09-21T07:11:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-09-21T07:11:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-09-21T07:11:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-09-21T07:11:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-09-21T07:11:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-09-21T07:11:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-09-21T07:11:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "max_requests": { 2024-09-21T07:11:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_requests", 2024-09-21T07:11:46.766 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.766 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.766 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.766 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-09-21T07:11:46.766 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.766 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.766 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.766 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T07:11:46.766 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.766 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.766 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.766 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-09-21T07:11:46.767 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-09-21T07:11:46.767 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.767 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.767 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.767 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.767 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.767 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.767 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.767 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.767 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.767 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.767 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.767 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-09-21T07:11:46.767 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-09-21T07:11:46.768 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.768 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.768 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.768 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.768 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.768 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.768 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.768 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.768 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.768 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.768 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.768 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.768 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.768 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.769 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.769 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.769 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.769 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.769 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.769 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.769 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.769 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.769 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.769 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.769 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.769 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.770 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-09-21T07:11:46.770 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.770 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.770 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.770 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.770 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.770 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.770 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.770 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.770 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.770 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.770 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.770 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.771 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.771 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.771 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.771 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.771 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.771 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.771 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.771 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.771 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.771 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.771 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.771 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.771 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.771 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.772 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.773 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.773 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.773 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.773 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.773 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.773 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.773 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.773 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.773 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.773 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.773 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.773 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.773 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.773 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.773 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.774 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.774 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.774 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.774 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.774 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.774 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.774 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.774 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.774 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.774 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.774 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.774 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.774 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.775 INFO:teuthology.orchestra.run.smithi018.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T07:11:46.775 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T07:11:46.775 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.775 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.775 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.775 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-09-21T07:11:46.775 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.775 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.775 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.775 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T07:11:46.775 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.775 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.775 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.776 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.776 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.776 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.776 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.776 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.776 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.776 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.776 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.776 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.776 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.776 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.776 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.776 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.776 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.777 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.777 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-09-21T07:11:46.777 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.777 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.777 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.777 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.777 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.777 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.777 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.777 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.778 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.778 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.778 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.778 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.778 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.778 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.778 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.778 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.778 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.778 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.778 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.778 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.778 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.778 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.779 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.779 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.779 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.779 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.779 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.779 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.779 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.779 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.779 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.779 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.779 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.779 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.779 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.780 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.780 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.780 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.780 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.780 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.780 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.780 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.780 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.780 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.780 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.780 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.780 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.780 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.780 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.781 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.781 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.781 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.781 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.781 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.781 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.781 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.781 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.781 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.781 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.781 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.781 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.781 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.781 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.782 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.782 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.782 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.782 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.782 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.782 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.782 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.782 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.782 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.782 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.782 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.782 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.782 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.783 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.783 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.783 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.783 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.783 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.783 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-09-21T07:11:46.783 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-09-21T07:11:46.783 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.783 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.783 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.783 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-09-21T07:11:46.783 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.783 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.783 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.784 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T07:11:46.784 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.784 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.784 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.784 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-09-21T07:11:46.784 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.784 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.784 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.784 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.784 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.785 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.785 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.785 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.785 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.785 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.785 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.785 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.785 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.785 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.785 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.785 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.785 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.785 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.785 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.786 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.786 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.786 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.786 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.786 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.786 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.786 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.786 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.786 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.786 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.786 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.786 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.787 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.787 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.787 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.787 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.787 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.787 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.787 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.787 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.787 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.787 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.787 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.787 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.787 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.787 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.788 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.788 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.788 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.788 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.788 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.788 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.788 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.788 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.788 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.788 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.788 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.788 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.788 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.789 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.789 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.789 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.789 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.789 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.789 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.789 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.789 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.789 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.789 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.789 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-09-21T07:11:46.789 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-09-21T07:11:46.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.790 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.790 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.790 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.790 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.790 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.790 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.790 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.790 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.790 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.790 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.790 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-09-21T07:11:46.790 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-09-21T07:11:46.790 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.791 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.792 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.792 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.792 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.792 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.792 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.792 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.792 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.792 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.792 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-09-21T07:11:46.792 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-09-21T07:11:46.792 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.792 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.792 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.792 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-09-21T07:11:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-09-21T07:11:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-09-21T07:11:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.793 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-09-21T07:11:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-09-21T07:11:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.794 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-09-21T07:11:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-09-21T07:11:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.795 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-09-21T07:11:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-09-21T07:11:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.796 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-09-21T07:11:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-09-21T07:11:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-09-21T07:11:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-09-21T07:11:46.797 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.798 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-09-21T07:11:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-09-21T07:11:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.799 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-09-21T07:11:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-09-21T07:11:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.800 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-09-21T07:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-09-21T07:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smb", 2024-09-21T07:11:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "internal_store_backend": { 2024-09-21T07:11:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "internal_store_backend", 2024-09-21T07:11:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.802 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T07:11:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.803 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.805 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.806 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.807 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.808 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "update_orchestration": { 2024-09-21T07:11:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "update_orchestration", 2024-09-21T07:11:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.809 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T07:11:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-09-21T07:11:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-09-21T07:11:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-09-21T07:11:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.811 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.811 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.811 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.811 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.811 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.811 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T07:11:46.811 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.811 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.811 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.811 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-09-21T07:11:46.811 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-09-21T07:11:46.811 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.811 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.811 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.812 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.812 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.812 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.812 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.812 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-09-21T07:11:46.812 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.812 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.812 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.812 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.812 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.812 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.812 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.812 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.812 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.813 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.813 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.813 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.813 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.813 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.813 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.813 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.813 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.813 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.813 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.813 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.813 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.813 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.813 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.814 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.814 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.814 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.814 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.814 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.814 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.814 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.814 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.814 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.814 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.814 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.814 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.814 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.815 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.815 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.815 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.815 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.815 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.815 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.815 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.815 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.815 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.815 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.815 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.815 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.815 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.815 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.817 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.817 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.817 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.817 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.817 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.817 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.817 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.817 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.817 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.817 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.817 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.817 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.817 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.817 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.818 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.818 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.818 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.818 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.818 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.818 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-09-21T07:11:46.818 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.818 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.818 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.818 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.818 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.819 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.819 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.819 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.819 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.819 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.819 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.819 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.819 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.819 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.819 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.819 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.819 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.819 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.819 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.819 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.821 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.821 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.821 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.821 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.821 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.821 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.821 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.821 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.821 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.821 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.821 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.821 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.821 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.822 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.822 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.822 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.822 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.822 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.822 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.822 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.822 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.822 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.822 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.822 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.822 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.822 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.822 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.823 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.823 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.823 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.823 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.823 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.823 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.823 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.823 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.823 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.823 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.823 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.823 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.823 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.823 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.824 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.824 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.824 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.824 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.824 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.824 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.824 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.824 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.824 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.824 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-09-21T07:11:46.824 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.824 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.826 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.826 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.826 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.826 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.826 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.826 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.826 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.826 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.826 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.826 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.826 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.826 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.827 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.827 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.827 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.827 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.827 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.827 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.827 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.827 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.827 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.827 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.827 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.827 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.827 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.827 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.828 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.828 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.828 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.828 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.828 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.828 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.828 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.828 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.828 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.828 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.828 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.828 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.828 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.828 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.829 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.830 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.830 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.830 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.830 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.830 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.830 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.830 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.830 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.830 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.830 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.830 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.831 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-09-21T07:11:46.831 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.831 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.831 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.831 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-09-21T07:11:46.831 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-09-21T07:11:46.831 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.831 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.831 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.831 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T07:11:46.831 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.831 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.831 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.832 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.832 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.832 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.832 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.832 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-21T07:11:46.832 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-21T07:11:46.832 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.832 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.832 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.832 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-09-21T07:11:46.832 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.832 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.832 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.832 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.833 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.833 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.833 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.833 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.833 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.833 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.833 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.833 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.833 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.833 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.833 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.833 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.833 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.834 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.834 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.834 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.834 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.834 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.834 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.834 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.834 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.834 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.834 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.834 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.834 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.834 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.835 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.835 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.835 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.835 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.835 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.835 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.835 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.835 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.835 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.835 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.835 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.835 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.835 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.836 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.836 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.836 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.836 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.836 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.836 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.836 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.836 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.836 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.836 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.836 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.836 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.836 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.837 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.837 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.837 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.837 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.837 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.837 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.837 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.837 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.837 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.837 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.837 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.837 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.837 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.837 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.838 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.838 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.838 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.838 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.838 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.838 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.838 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.838 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.838 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.838 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.838 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.838 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.838 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-09-21T07:11:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-09-21T07:11:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-09-21T07:11:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.839 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.840 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.840 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.840 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.840 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.840 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.840 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T07:11:46.840 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.840 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.840 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.840 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-09-21T07:11:46.840 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-09-21T07:11:46.840 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.840 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.841 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.841 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.841 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.841 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.841 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.841 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T07:11:46.841 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.841 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.841 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.841 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-09-21T07:11:46.841 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-09-21T07:11:46.841 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.841 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.841 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.842 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.842 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.842 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.842 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.842 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T07:11:46.842 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.842 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.842 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.842 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-09-21T07:11:46.842 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-09-21T07:11:46.842 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.842 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.842 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.843 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.843 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.843 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.843 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.843 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T07:11:46.843 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.843 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.843 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.843 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-09-21T07:11:46.843 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-09-21T07:11:46.843 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.843 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.843 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.843 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.844 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.844 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.844 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.844 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T07:11:46.844 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.844 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.844 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.844 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-09-21T07:11:46.844 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-09-21T07:11:46.844 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.844 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.844 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.844 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.844 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.845 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.845 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.845 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.845 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.845 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.845 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.845 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-09-21T07:11:46.845 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-09-21T07:11:46.845 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.845 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.845 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.845 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.845 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.846 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.846 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.846 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.846 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.846 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.846 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.846 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-09-21T07:11:46.846 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-09-21T07:11:46.846 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.846 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.846 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.846 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T07:11:46.846 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.846 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.847 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.847 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.847 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.847 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.847 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.847 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-09-21T07:11:46.847 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-09-21T07:11:46.847 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.847 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.847 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.847 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.847 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.847 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.848 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.848 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.848 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.848 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.848 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.848 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-21T07:11:46.848 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-21T07:11:46.848 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.848 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.848 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.848 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-09-21T07:11:46.848 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-09-21T07:11:46.848 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.848 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-09-21T07:11:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-09-21T07:11:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-09-21T07:11:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.850 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.850 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.850 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.850 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-09-21T07:11:46.850 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-09-21T07:11:46.850 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.850 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.850 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.850 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.850 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.850 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.850 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.850 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.851 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.851 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.851 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.851 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-09-21T07:11:46.851 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-09-21T07:11:46.851 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.851 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.851 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.851 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.851 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.851 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.851 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.853 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.853 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.853 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.853 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.854 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.854 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.854 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.854 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.854 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.854 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.854 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.854 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.854 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.854 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.854 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.854 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.854 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.855 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.855 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.855 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.855 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.855 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.855 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.855 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.855 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.855 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.855 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.855 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.855 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.855 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.856 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.856 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.856 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.856 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.856 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.856 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.856 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.856 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.856 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.856 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.856 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.856 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.856 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.857 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.857 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.857 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.857 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.857 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.857 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.857 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.857 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.857 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.857 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.857 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.857 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.857 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.857 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.858 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.858 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.858 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.858 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.858 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.858 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.858 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.858 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.858 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.858 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.858 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.858 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.858 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.859 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-09-21T07:11:46.859 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-09-21T07:11:46.859 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.859 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.859 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.859 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.859 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.859 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.859 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.859 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.859 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.859 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.859 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.860 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-09-21T07:11:46.860 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-09-21T07:11:46.860 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.860 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.860 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.860 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.860 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.860 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.860 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.860 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.860 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.860 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.860 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.861 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.861 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.861 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.861 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.861 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.861 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.861 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.861 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.861 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.861 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.861 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.861 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.861 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.862 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-09-21T07:11:46.862 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-09-21T07:11:46.862 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.862 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.862 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.862 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T07:11:46.862 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.862 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.862 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.862 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.862 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.862 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.862 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.862 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.862 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.863 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-09-21T07:11:46.863 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.863 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.863 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.863 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.863 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.863 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.863 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.863 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.863 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.863 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.863 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.863 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.864 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.864 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.864 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.864 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.864 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.864 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.864 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.864 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.864 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.864 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.864 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.864 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.864 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.864 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.865 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.865 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.865 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.865 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.865 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.865 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.865 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.865 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.865 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.865 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.865 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.865 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.865 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.866 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.866 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.866 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.866 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.866 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.866 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.866 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.866 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.866 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.866 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.866 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.866 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.866 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.866 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.866 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.867 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.867 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.867 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.867 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.867 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.867 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.867 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.867 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.867 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.867 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.867 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.867 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.867 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.868 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.869 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.869 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-21T07:11:46.869 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.869 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.869 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.869 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.869 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.869 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.869 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.869 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.869 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.869 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.869 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.870 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.870 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.870 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.870 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.870 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.870 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.870 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.870 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.870 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.870 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.870 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.870 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.870 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.871 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.871 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.871 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.871 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.871 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.871 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.871 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.871 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.871 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.871 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.871 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.871 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.871 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.872 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.872 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.872 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.872 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.872 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.872 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.872 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.872 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.872 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.872 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.872 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.872 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.872 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.872 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.873 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.873 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.873 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.873 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.873 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.873 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.873 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.873 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.873 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.873 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.873 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.873 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.873 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.873 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.874 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.874 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.874 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.874 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.874 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-09-21T07:11:46.874 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-09-21T07:11:46.874 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.874 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.874 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.874 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-09-21T07:11:46.874 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.874 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.874 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.875 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T07:11:46.875 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.875 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.875 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.875 INFO:teuthology.orchestra.run.smithi018.stdout: "periodic_async_work": { 2024-09-21T07:11:46.875 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "periodic_async_work", 2024-09-21T07:11:46.875 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.875 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.875 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.875 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.875 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.875 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.875 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.875 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Periodically check for async work", 2024-09-21T07:11:46.876 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.876 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.876 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.876 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-09-21T07:11:46.876 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-09-21T07:11:46.876 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.876 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.876 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.876 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.876 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.876 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.876 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.876 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T07:11:46.877 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.877 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.877 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.877 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-09-21T07:11:46.877 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T07:11:46.877 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.877 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.877 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.877 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-09-21T07:11:46.877 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.877 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.877 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.877 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T07:11:46.877 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.878 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.878 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.878 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.878 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.878 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.878 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.878 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.878 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.878 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.878 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.878 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.878 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.878 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.879 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.879 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.879 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.879 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.879 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-09-21T07:11:46.879 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-09-21T07:11:46.879 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-09-21T07:11:46.879 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-09-21T07:11:46.879 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-09-21T07:11:46.879 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-09-21T07:11:46.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-09-21T07:11:46.879 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.879 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.880 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-09-21T07:11:46.880 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.880 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.880 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.880 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.880 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.880 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.880 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.880 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-09-21T07:11:46.880 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-09-21T07:11:46.880 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.880 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.880 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.880 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.881 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.881 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.881 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.881 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.881 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.881 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.881 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.881 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-09-21T07:11:46.881 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-09-21T07:11:46.881 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-09-21T07:11:46.881 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.881 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.881 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-09-21T07:11:46.881 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.882 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.882 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.882 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.882 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.882 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.882 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.882 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-09-21T07:11:46.882 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-09-21T07:11:46.882 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.882 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.882 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.882 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.882 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.882 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.883 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.883 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.883 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.883 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.883 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.883 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.883 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.883 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.883 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.883 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.883 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.883 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.883 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-09-21T07:11:46.883 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-09-21T07:11:46.884 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.884 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.884 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.884 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.884 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.884 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.884 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.884 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.884 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.884 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.884 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.884 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-09-21T07:11:46.884 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-09-21T07:11:46.884 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.885 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.885 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.885 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-09-21T07:11:46.885 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.885 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.885 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-09-21T07:11:46.885 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-09-21T07:11:46.885 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-09-21T07:11:46.885 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-09-21T07:11:46.885 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-09-21T07:11:46.885 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-09-21T07:11:46.885 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-09-21T07:11:46.885 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.885 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.886 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.886 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.886 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.886 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-09-21T07:11:46.886 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-09-21T07:11:46.886 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-09-21T07:11:46.886 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.886 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.886 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-09-21T07:11:46.886 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.886 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.886 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.886 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.886 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.887 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.887 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.887 INFO:teuthology.orchestra.run.smithi018.stdout: "sqlite3_killpoint": { 2024-09-21T07:11:46.887 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:11:46.887 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.887 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "dev", 2024-09-21T07:11:46.887 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-21T07:11:46.887 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-09-21T07:11:46.887 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.887 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.887 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.887 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.887 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.887 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.888 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.888 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-09-21T07:11:46.888 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-09-21T07:11:46.888 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.888 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.888 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.888 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-09-21T07:11:46.888 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.888 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.888 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.888 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.888 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.888 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.888 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.889 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-09-21T07:11:46.889 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-09-21T07:11:46.889 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-09-21T07:11:46.889 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.889 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.889 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-09-21T07:11:46.889 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.889 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.889 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.889 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.889 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.889 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.889 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.890 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-09-21T07:11:46.890 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-09-21T07:11:46.890 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-09-21T07:11:46.890 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-09-21T07:11:46.890 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-09-21T07:11:46.890 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T07:11:46.890 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-09-21T07:11:46.890 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-09-21T07:11:46.890 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-09-21T07:11:46.890 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-09-21T07:11:46.890 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-09-21T07:11:46.890 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-09-21T07:11:46.890 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-09-21T07:11:46.890 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.891 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.891 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.891 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.891 INFO:teuthology.orchestra.run.smithi018.stdout: "services": {}, 2024-09-21T07:11:46.891 INFO:teuthology.orchestra.run.smithi018.stdout: "always_on_modules": { 2024-09-21T07:11:46.891 INFO:teuthology.orchestra.run.smithi018.stdout: "octopus": [ 2024-09-21T07:11:46.891 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-21T07:11:46.891 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-21T07:11:46.891 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-21T07:11:46.891 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-21T07:11:46.891 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-21T07:11:46.891 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-21T07:11:46.891 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-21T07:11:46.891 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-21T07:11:46.891 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-21T07:11:46.892 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-21T07:11:46.892 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.892 INFO:teuthology.orchestra.run.smithi018.stdout: "pacific": [ 2024-09-21T07:11:46.892 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-21T07:11:46.892 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-21T07:11:46.892 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-21T07:11:46.892 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-21T07:11:46.892 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-21T07:11:46.892 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-21T07:11:46.892 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-21T07:11:46.892 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-21T07:11:46.892 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-21T07:11:46.892 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-21T07:11:46.892 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.892 INFO:teuthology.orchestra.run.smithi018.stdout: "quincy": [ 2024-09-21T07:11:46.893 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-21T07:11:46.893 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-21T07:11:46.893 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-21T07:11:46.893 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-21T07:11:46.893 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-21T07:11:46.893 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-21T07:11:46.893 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-21T07:11:46.893 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-21T07:11:46.893 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-21T07:11:46.893 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-21T07:11:46.893 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.893 INFO:teuthology.orchestra.run.smithi018.stdout: "reef": [ 2024-09-21T07:11:46.893 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-21T07:11:46.893 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-21T07:11:46.894 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-21T07:11:46.894 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-21T07:11:46.894 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-21T07:11:46.894 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-21T07:11:46.894 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-21T07:11:46.894 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-21T07:11:46.894 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-21T07:11:46.894 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-21T07:11:46.894 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-21T07:11:46.894 INFO:teuthology.orchestra.run.smithi018.stdout: "squid": [ 2024-09-21T07:11:46.894 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-09-21T07:11:46.894 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-09-21T07:11:46.894 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-09-21T07:11:46.894 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-09-21T07:11:46.894 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-09-21T07:11:46.895 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-09-21T07:11:46.895 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-09-21T07:11:46.895 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-09-21T07:11:46.895 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-09-21T07:11:46.895 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-09-21T07:11:46.895 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-21T07:11:46.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.895 INFO:teuthology.orchestra.run.smithi018.stdout: "last_failure_osd_epoch": 0, 2024-09-21T07:11:46.895 INFO:teuthology.orchestra.run.smithi018.stdout: "active_clients": [ 2024-09-21T07:11:46.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.895 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-09-21T07:11:46.895 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-21T07:11:46.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.895 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-21T07:11:46.896 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.49:0", 2024-09-21T07:11:46.896 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1103718347 2024-09-21T07:11:46.896 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.896 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-21T07:11:46.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.896 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "libcephsqlite", 2024-09-21T07:11:46.896 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-21T07:11:46.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.896 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-21T07:11:46.896 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.49:0", 2024-09-21T07:11:46.896 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4192866826 2024-09-21T07:11:46.896 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.896 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-21T07:11:46.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.897 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-09-21T07:11:46.897 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-21T07:11:46.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.897 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-21T07:11:46.897 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.49:0", 2024-09-21T07:11:46.897 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1828215717 2024-09-21T07:11:46.897 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.897 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-21T07:11:46.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.897 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-21T07:11:46.897 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-21T07:11:46.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.898 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-21T07:11:46.898 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.49:0", 2024-09-21T07:11:46.898 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2511844487 2024-09-21T07:11:46.898 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.898 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-21T07:11:46.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.898 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-21T07:11:46.898 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-21T07:11:46.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.898 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-21T07:11:46.898 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.49:0", 2024-09-21T07:11:46.898 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3647237751 2024-09-21T07:11:46.898 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.898 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-21T07:11:46.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.899 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-21T07:11:46.899 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-21T07:11:46.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.899 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-21T07:11:46.899 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.49:0", 2024-09-21T07:11:46.899 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1251312540 2024-09-21T07:11:46.899 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.899 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-21T07:11:46.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T07:11:46.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.899 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-09-21T07:11:46.900 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-21T07:11:46.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-21T07:11:46.900 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-21T07:11:46.900 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.49:0", 2024-09-21T07:11:46.900 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3320956798 2024-09-21T07:11:46.900 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.900 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-21T07:11:46.900 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T07:11:46.900 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-21T07:11:46.900 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T07:11:46.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.872+0000 7fac424f9640 1 -- 172.21.15.18:0/2132448022 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fac28078d40 msgr2=0x7fac2807b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:46.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.872+0000 7fac424f9640 1 --2- 172.21.15.18:0/2132448022 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fac28078d40 0x7fac2807b250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fac2c034000 tx=0x7fac2c004730 comp rx=0 tx=0).stop 2024-09-21T07:11:46.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.872+0000 7fac424f9640 1 -- 172.21.15.18:0/2132448022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c162a40 msgr2=0x7fac3c161650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:46.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.872+0000 7fac424f9640 1 --2- 172.21.15.18:0/2132448022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c162a40 0x7fac3c161650 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fac3400e960 tx=0x7fac3400ee20 comp rx=0 tx=0).stop 2024-09-21T07:11:46.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.872+0000 7fac424f9640 1 -- 172.21.15.18:0/2132448022 shutdown_connections 2024-09-21T07:11:46.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.872+0000 7fac424f9640 1 --2- 172.21.15.18:0/2132448022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3c162a40 0x7fac3c161650 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:46.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.872+0000 7fac424f9640 1 --2- 172.21.15.18:0/2132448022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fac3c15ef50 0x7fac3c0cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:46.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.872+0000 7fac424f9640 1 --2- 172.21.15.18:0/2132448022 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fac28078d40 0x7fac2807b250 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:46.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.872+0000 7fac424f9640 1 --2- 172.21.15.18:0/2132448022 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fac3c0cef70 0x7fac3c1f9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:46.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.872+0000 7fac424f9640 1 -- 172.21.15.18:0/2132448022 >> 172.21.15.18:0/2132448022 conn(0x7fac3c073f30 msgr2=0x7fac3c160c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:46.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.873+0000 7fac424f9640 1 -- 172.21.15.18:0/2132448022 shutdown_connections 2024-09-21T07:11:46.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:45.873+0000 7fac424f9640 1 -- 172.21.15.18:0/2132448022 wait complete. 2024-09-21T07:11:46.907 DEBUG:tasks.check_counter:Getting stats from x 2024-09-21T07:11:46.907 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mgr.x.asok perf dump 2024-09-21T07:11:47.033 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T07:11:47.033 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:11:47.033 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 241, 2024-09-21T07:11:47.033 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 111, 2024-09-21T07:11:47.033 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3023067, 2024-09-21T07:11:47.033 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 111347, 2024-09-21T07:11:47.034 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 59, 2024-09-21T07:11:47.034 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 15, 2024-09-21T07:11:47.034 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.057790494, 2024-09-21T07:11:47.034 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.003877221, 2024-09-21T07:11:47.034 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.059287247, 2024-09-21T07:11:47.034 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:11:47.034 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:11:47.034 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 95, 2024-09-21T07:11:47.034 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.212265596, 2024-09-21T07:11:47.034 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002234374 2024-09-21T07:11:47.034 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.034 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:11:47.034 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 61, 2024-09-21T07:11:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000011254, 2024-09-21T07:11:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000184 2024-09-21T07:11:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3022960, 2024-09-21T07:11:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 111216 2024-09-21T07:11:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:11:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 402, 2024-09-21T07:11:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 210, 2024-09-21T07:11:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3405760, 2024-09-21T07:11:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 422272, 2024-09-21T07:11:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 104, 2024-09-21T07:11:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 21, 2024-09-21T07:11:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.097352857, 2024-09-21T07:11:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.010427293, 2024-09-21T07:11:47.036 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.111156912, 2024-09-21T07:11:47.036 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000076523, 2024-09-21T07:11:47.036 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:11:47.036 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 198, 2024-09-21T07:11:47.036 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.221041173, 2024-09-21T07:11:47.036 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001116369 2024-09-21T07:11:47.036 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.036 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:11:47.036 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 292, 2024-09-21T07:11:47.036 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000046073, 2024-09-21T07:11:47.036 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000157 2024-09-21T07:11:47.036 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.036 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3405760, 2024-09-21T07:11:47.036 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 422272 2024-09-21T07:11:47.037 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.037 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:11:47.037 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 652, 2024-09-21T07:11:47.037 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 470, 2024-09-21T07:11:47.037 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 2373856, 2024-09-21T07:11:47.037 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 5021296, 2024-09-21T07:11:47.037 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 104, 2024-09-21T07:11:47.037 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 23, 2024-09-21T07:11:47.037 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.123538956, 2024-09-21T07:11:47.037 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.030228368, 2024-09-21T07:11:47.037 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.111620629, 2024-09-21T07:11:47.037 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.002222758, 2024-09-21T07:11:47.037 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:11:47.038 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 453, 2024-09-21T07:11:47.038 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.040476461, 2024-09-21T07:11:47.038 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000089352 2024-09-21T07:11:47.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.038 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:11:47.038 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 140, 2024-09-21T07:11:47.038 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000023997, 2024-09-21T07:11:47.038 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000171 2024-09-21T07:11:47.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.038 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 2373856, 2024-09-21T07:11:47.038 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 5021296 2024-09-21T07:11:47.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.038 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-09-21T07:11:47.038 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-09-21T07:11:47.039 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-09-21T07:11:47.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.039 INFO:teuthology.orchestra.run.smithi049.stdout: "client": { 2024-09-21T07:11:47.039 INFO:teuthology.orchestra.run.smithi049.stdout: "reply": { 2024-09-21T07:11:47.039 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.039 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.039 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.039 INFO:teuthology.orchestra.run.smithi049.stdout: "lat": { 2024-09-21T07:11:47.039 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.039 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.039 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.039 INFO:teuthology.orchestra.run.smithi049.stdout: "wrlat": { 2024-09-21T07:11:47.040 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.040 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.040 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.040 INFO:teuthology.orchestra.run.smithi049.stdout: "rdlat": { 2024-09-21T07:11:47.040 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.040 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.040 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.040 INFO:teuthology.orchestra.run.smithi049.stdout: "fsync": { 2024-09-21T07:11:47.040 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.040 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.040 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.040 INFO:teuthology.orchestra.run.smithi049.stdout: "mdavg": 0.000000000, 2024-09-21T07:11:47.041 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsqsum": 0, 2024-09-21T07:11:47.041 INFO:teuthology.orchestra.run.smithi049.stdout: "mdops": 0, 2024-09-21T07:11:47.041 INFO:teuthology.orchestra.run.smithi049.stdout: "readavg": 0.000000000, 2024-09-21T07:11:47.041 INFO:teuthology.orchestra.run.smithi049.stdout: "readsqsum": 0, 2024-09-21T07:11:47.041 INFO:teuthology.orchestra.run.smithi049.stdout: "rdops": 0, 2024-09-21T07:11:47.041 INFO:teuthology.orchestra.run.smithi049.stdout: "writeavg": 0.000000000, 2024-09-21T07:11:47.041 INFO:teuthology.orchestra.run.smithi049.stdout: "writesqsum": 0, 2024-09-21T07:11:47.041 INFO:teuthology.orchestra.run.smithi049.stdout: "rdops": 0 2024-09-21T07:11:47.041 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.041 INFO:teuthology.orchestra.run.smithi049.stdout: "client-0x55e18e944340": { 2024-09-21T07:11:47.041 INFO:teuthology.orchestra.run.smithi049.stdout: "reply": { 2024-09-21T07:11:47.041 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 20, 2024-09-21T07:11:47.041 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.357343250, 2024-09-21T07:11:47.041 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.017867162 2024-09-21T07:11:47.042 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.042 INFO:teuthology.orchestra.run.smithi049.stdout: "lat": { 2024-09-21T07:11:47.042 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 20, 2024-09-21T07:11:47.042 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.357343250, 2024-09-21T07:11:47.042 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.017867162 2024-09-21T07:11:47.042 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.042 INFO:teuthology.orchestra.run.smithi049.stdout: "wrlat": { 2024-09-21T07:11:47.042 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.042 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.042 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.042 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.042 INFO:teuthology.orchestra.run.smithi049.stdout: "rdlat": { 2024-09-21T07:11:47.042 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.042 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.043 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.043 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.043 INFO:teuthology.orchestra.run.smithi049.stdout: "fsync": { 2024-09-21T07:11:47.043 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.043 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.043 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.043 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.043 INFO:teuthology.orchestra.run.smithi049.stdout: "mdavg": 0.017867159, 2024-09-21T07:11:47.043 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsqsum": 106855727118521344, 2024-09-21T07:11:47.043 INFO:teuthology.orchestra.run.smithi049.stdout: "mdops": 20, 2024-09-21T07:11:47.043 INFO:teuthology.orchestra.run.smithi049.stdout: "readavg": 0.000000000, 2024-09-21T07:11:47.043 INFO:teuthology.orchestra.run.smithi049.stdout: "readsqsum": 0, 2024-09-21T07:11:47.043 INFO:teuthology.orchestra.run.smithi049.stdout: "rdops": 0, 2024-09-21T07:11:47.043 INFO:teuthology.orchestra.run.smithi049.stdout: "writeavg": 0.000000000, 2024-09-21T07:11:47.043 INFO:teuthology.orchestra.run.smithi049.stdout: "writesqsum": 0, 2024-09-21T07:11:47.044 INFO:teuthology.orchestra.run.smithi049.stdout: "rdops": 0 2024-09-21T07:11:47.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.044 INFO:teuthology.orchestra.run.smithi049.stdout: "client-0x55e18e968270": { 2024-09-21T07:11:47.044 INFO:teuthology.orchestra.run.smithi049.stdout: "reply": { 2024-09-21T07:11:47.044 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 71, 2024-09-21T07:11:47.044 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.099445972, 2024-09-21T07:11:47.044 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001400647 2024-09-21T07:11:47.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.044 INFO:teuthology.orchestra.run.smithi049.stdout: "lat": { 2024-09-21T07:11:47.044 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 71, 2024-09-21T07:11:47.044 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.099445972, 2024-09-21T07:11:47.044 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001400647 2024-09-21T07:11:47.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.044 INFO:teuthology.orchestra.run.smithi049.stdout: "wrlat": { 2024-09-21T07:11:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 18, 2024-09-21T07:11:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000482517, 2024-09-21T07:11:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000026806 2024-09-21T07:11:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: "rdlat": { 2024-09-21T07:11:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 18, 2024-09-21T07:11:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000616142, 2024-09-21T07:11:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000034230 2024-09-21T07:11:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: "fsync": { 2024-09-21T07:11:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-09-21T07:11:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.009684516, 2024-09-21T07:11:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.003228172 2024-09-21T07:11:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.045 INFO:teuthology.orchestra.run.smithi049.stdout: "mdavg": 0.001400630, 2024-09-21T07:11:47.046 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsqsum": 130544187942276, 2024-09-21T07:11:47.046 INFO:teuthology.orchestra.run.smithi049.stdout: "mdops": 71, 2024-09-21T07:11:47.046 INFO:teuthology.orchestra.run.smithi049.stdout: "readavg": 0.000034226, 2024-09-21T07:11:47.046 INFO:teuthology.orchestra.run.smithi049.stdout: "readsqsum": 1587761015, 2024-09-21T07:11:47.046 INFO:teuthology.orchestra.run.smithi049.stdout: "rdops": 18, 2024-09-21T07:11:47.046 INFO:teuthology.orchestra.run.smithi049.stdout: "writeavg": 0.000026802, 2024-09-21T07:11:47.046 INFO:teuthology.orchestra.run.smithi049.stdout: "writesqsum": 1954191655, 2024-09-21T07:11:47.046 INFO:teuthology.orchestra.run.smithi049.stdout: "rdops": 18 2024-09-21T07:11:47.046 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.046 INFO:teuthology.orchestra.run.smithi049.stdout: "client-0x55e18e9689c0": { 2024-09-21T07:11:47.046 INFO:teuthology.orchestra.run.smithi049.stdout: "reply": { 2024-09-21T07:11:47.046 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 55, 2024-09-21T07:11:47.046 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.086983717, 2024-09-21T07:11:47.046 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001581522 2024-09-21T07:11:47.047 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.047 INFO:teuthology.orchestra.run.smithi049.stdout: "lat": { 2024-09-21T07:11:47.047 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 55, 2024-09-21T07:11:47.047 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.086983717, 2024-09-21T07:11:47.047 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001581522 2024-09-21T07:11:47.047 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.047 INFO:teuthology.orchestra.run.smithi049.stdout: "wrlat": { 2024-09-21T07:11:47.047 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.047 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.047 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.047 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.047 INFO:teuthology.orchestra.run.smithi049.stdout: "rdlat": { 2024-09-21T07:11:47.047 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.047 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.047 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.048 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.048 INFO:teuthology.orchestra.run.smithi049.stdout: "fsync": { 2024-09-21T07:11:47.048 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.048 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.048 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.048 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.048 INFO:teuthology.orchestra.run.smithi049.stdout: "mdavg": 0.001581508, 2024-09-21T07:11:47.048 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsqsum": 175618867809767, 2024-09-21T07:11:47.048 INFO:teuthology.orchestra.run.smithi049.stdout: "mdops": 55, 2024-09-21T07:11:47.048 INFO:teuthology.orchestra.run.smithi049.stdout: "readavg": 0.000000000, 2024-09-21T07:11:47.048 INFO:teuthology.orchestra.run.smithi049.stdout: "readsqsum": 0, 2024-09-21T07:11:47.048 INFO:teuthology.orchestra.run.smithi049.stdout: "rdops": 0, 2024-09-21T07:11:47.048 INFO:teuthology.orchestra.run.smithi049.stdout: "writeavg": 0.000000000, 2024-09-21T07:11:47.048 INFO:teuthology.orchestra.run.smithi049.stdout: "writesqsum": 0, 2024-09-21T07:11:47.048 INFO:teuthology.orchestra.run.smithi049.stdout: "rdops": 0 2024-09-21T07:11:47.049 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.049 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-Mgr": { 2024-09-21T07:11:47.049 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.049 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.049 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2, 2024-09-21T07:11:47.049 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.035860611, 2024-09-21T07:11:47.049 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.017930305 2024-09-21T07:11:47.049 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.049 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.049 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-MgrStandby": { 2024-09-21T07:11:47.049 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.049 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.049 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.049 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.049 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.050 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.050 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.050 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-balancer": { 2024-09-21T07:11:47.050 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.050 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.050 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.050 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.050 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.050 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.050 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.050 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-cmd_finisher": { 2024-09-21T07:11:47.050 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.050 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.050 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 13, 2024-09-21T07:11:47.051 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000754571, 2024-09-21T07:11:47.051 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000058043 2024-09-21T07:11:47.051 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.051 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.051 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-crash": { 2024-09-21T07:11:47.051 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.051 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.051 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.051 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.051 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.051 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.051 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.051 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-devicehealth": { 2024-09-21T07:11:47.051 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.052 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.052 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.052 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.052 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.052 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.052 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.052 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-iostat": { 2024-09-21T07:11:47.052 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.052 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.052 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.052 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.052 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.052 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.052 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.052 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-nfs": { 2024-09-21T07:11:47.053 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.053 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.053 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.053 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.053 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.053 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.053 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-orchestrator": { 2024-09-21T07:11:47.053 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.053 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.053 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.053 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.053 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.053 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.054 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-pg_autoscaler": { 2024-09-21T07:11:47.054 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.054 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.054 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.054 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.054 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.054 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.054 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.054 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-progress": { 2024-09-21T07:11:47.054 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.054 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.054 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.054 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.054 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.055 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.055 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.055 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-rbd_support": { 2024-09-21T07:11:47.055 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.055 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.055 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.055 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.055 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.055 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.055 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.055 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-restful": { 2024-09-21T07:11:47.055 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.055 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.055 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 13, 2024-09-21T07:11:47.056 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.002760842, 2024-09-21T07:11:47.056 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000212372 2024-09-21T07:11:47.056 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.056 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.056 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-status": { 2024-09-21T07:11:47.056 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.056 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.056 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.056 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.056 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.056 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.056 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.056 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-telemetry": { 2024-09-21T07:11:47.056 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.056 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.057 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.057 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.057 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.057 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.057 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.057 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-volumes": { 2024-09-21T07:11:47.057 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-09-21T07:11:47.057 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-09-21T07:11:47.057 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-09-21T07:11:47.057 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.160382202, 2024-09-21T07:11:47.057 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.017820244 2024-09-21T07:11:47.057 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.057 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.057 INFO:teuthology.orchestra.run.smithi049.stdout: "libcephsqlite_striper": { 2024-09-21T07:11:47.058 INFO:teuthology.orchestra.run.smithi049.stdout: "update_metadata": 5, 2024-09-21T07:11:47.058 INFO:teuthology.orchestra.run.smithi049.stdout: "update_allocated": 2, 2024-09-21T07:11:47.058 INFO:teuthology.orchestra.run.smithi049.stdout: "update_size": 3, 2024-09-21T07:11:47.058 INFO:teuthology.orchestra.run.smithi049.stdout: "update_version": 5, 2024-09-21T07:11:47.058 INFO:teuthology.orchestra.run.smithi049.stdout: "shrink": 0, 2024-09-21T07:11:47.058 INFO:teuthology.orchestra.run.smithi049.stdout: "shrink_bytes": 0, 2024-09-21T07:11:47.058 INFO:teuthology.orchestra.run.smithi049.stdout: "lock": 6, 2024-09-21T07:11:47.058 INFO:teuthology.orchestra.run.smithi049.stdout: "unlock": 6 2024-09-21T07:11:47.058 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.058 INFO:teuthology.orchestra.run.smithi049.stdout: "libcephsqlite_vfs": { 2024-09-21T07:11:47.058 INFO:teuthology.orchestra.run.smithi049.stdout: "op_open": { 2024-09-21T07:11:47.058 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2, 2024-09-21T07:11:47.058 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.017999508, 2024-09-21T07:11:47.058 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.008999754 2024-09-21T07:11:47.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.059 INFO:teuthology.orchestra.run.smithi049.stdout: "op_delete": { 2024-09-21T07:11:47.059 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.059 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.059 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.059 INFO:teuthology.orchestra.run.smithi049.stdout: "op_access": { 2024-09-21T07:11:47.059 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.059 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.059 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.059 INFO:teuthology.orchestra.run.smithi049.stdout: "op_fullpathname": { 2024-09-21T07:11:47.059 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-09-21T07:11:47.059 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000999972, 2024-09-21T07:11:47.059 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000999972 2024-09-21T07:11:47.060 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.060 INFO:teuthology.orchestra.run.smithi049.stdout: "op_currenttime": { 2024-09-21T07:11:47.060 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 4, 2024-09-21T07:11:47.060 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.060 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.060 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.060 INFO:teuthology.orchestra.run.smithi049.stdout: "opf_close": { 2024-09-21T07:11:47.060 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.060 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.060 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.060 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.060 INFO:teuthology.orchestra.run.smithi049.stdout: "opf_read": { 2024-09-21T07:11:47.060 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 10, 2024-09-21T07:11:47.060 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.002999917, 2024-09-21T07:11:47.061 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000299991 2024-09-21T07:11:47.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.061 INFO:teuthology.orchestra.run.smithi049.stdout: "opf_write": { 2024-09-21T07:11:47.061 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 53, 2024-09-21T07:11:47.061 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.005999836, 2024-09-21T07:11:47.061 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000113204 2024-09-21T07:11:47.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.061 INFO:teuthology.orchestra.run.smithi049.stdout: "opf_truncate": { 2024-09-21T07:11:47.061 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.061 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.061 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.061 INFO:teuthology.orchestra.run.smithi049.stdout: "opf_sync": { 2024-09-21T07:11:47.061 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-09-21T07:11:47.061 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.042998820, 2024-09-21T07:11:47.062 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.003583235 2024-09-21T07:11:47.062 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.062 INFO:teuthology.orchestra.run.smithi049.stdout: "opf_filesize": { 2024-09-21T07:11:47.062 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 10, 2024-09-21T07:11:47.062 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.062 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.062 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.062 INFO:teuthology.orchestra.run.smithi049.stdout: "opf_lock": { 2024-09-21T07:11:47.062 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 14, 2024-09-21T07:11:47.062 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.015999561, 2024-09-21T07:11:47.062 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001142825 2024-09-21T07:11:47.062 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.062 INFO:teuthology.orchestra.run.smithi049.stdout: "opf_unlock": { 2024-09-21T07:11:47.062 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 10, 2024-09-21T07:11:47.063 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.007999781, 2024-09-21T07:11:47.063 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000799978 2024-09-21T07:11:47.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.063 INFO:teuthology.orchestra.run.smithi049.stdout: "opf_checkreservedlock": { 2024-09-21T07:11:47.063 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 4, 2024-09-21T07:11:47.063 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.063 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.063 INFO:teuthology.orchestra.run.smithi049.stdout: "opf_filecontrol": { 2024-09-21T07:11:47.063 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 16, 2024-09-21T07:11:47.063 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.063 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.063 INFO:teuthology.orchestra.run.smithi049.stdout: "opf_sectorsize": { 2024-09-21T07:11:47.063 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: "opf_devicecharacteristics": { 2024-09-21T07:11:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 17, 2024-09-21T07:11:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-09-21T07:11:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:11:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-09-21T07:11:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:11:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:11:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:11:47.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:11:47.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:11:47.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:11:47.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:11:47.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:11:47.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:11:47.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:11:47.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:11:47.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:11:47.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:11:47.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-09-21T07:11:47.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:11:47.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-09-21T07:11:47.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:11:47.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:11:47.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:11:47.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:11:47.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:11:47.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:11:47.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:11:47.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-09-21T07:11:47.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:11:47.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:11:47.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:11:47.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-09-21T07:11:47.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-09-21T07:11:47.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-09-21T07:11:47.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:11:47.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:11:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:11:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:11:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 1696246, 2024-09-21T07:11:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 325, 2024-09-21T07:11:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 1496, 2024-09-21T07:11:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 17, 2024-09-21T07:11:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-09-21T07:11:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-09-21T07:11:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:11:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-09-21T07:11:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:11:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-09-21T07:11:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 48184, 2024-09-21T07:11:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 822, 2024-09-21T07:11:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:11:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:11:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 107584, 2024-09-21T07:11:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 478, 2024-09-21T07:11:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-09-21T07:11:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-09-21T07:11:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-09-21T07:11:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-09-21T07:11:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-09-21T07:11:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-09-21T07:11:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-21T07:11:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_hit": 0, 2024-09-21T07:11:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_miss": 0 2024-09-21T07:11:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "objectcacher-libcephfs": { 2024-09-21T07:11:47.069 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_ops_hit": 0, 2024-09-21T07:11:47.069 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_ops_miss": 0, 2024-09-21T07:11:47.069 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_bytes_hit": 0, 2024-09-21T07:11:47.069 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_bytes_miss": 0, 2024-09-21T07:11:47.069 INFO:teuthology.orchestra.run.smithi049.stdout: "data_read": 0, 2024-09-21T07:11:47.069 INFO:teuthology.orchestra.run.smithi049.stdout: "data_written": 0, 2024-09-21T07:11:47.069 INFO:teuthology.orchestra.run.smithi049.stdout: "data_flushed": 0, 2024-09-21T07:11:47.069 INFO:teuthology.orchestra.run.smithi049.stdout: "data_overwritten_while_flushing": 0, 2024-09-21T07:11:47.069 INFO:teuthology.orchestra.run.smithi049.stdout: "write_ops_blocked": 0, 2024-09-21T07:11:47.069 INFO:teuthology.orchestra.run.smithi049.stdout: "write_bytes_blocked": 0, 2024-09-21T07:11:47.069 INFO:teuthology.orchestra.run.smithi049.stdout: "write_time_blocked": 0.000000000 2024-09-21T07:11:47.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.069 INFO:teuthology.orchestra.run.smithi049.stdout: "objectcacher-libcephfs-0x55e18e6ac820": { 2024-09-21T07:11:47.069 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_ops_hit": 0, 2024-09-21T07:11:47.069 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_ops_miss": 0, 2024-09-21T07:11:47.070 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_bytes_hit": 0, 2024-09-21T07:11:47.070 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_bytes_miss": 0, 2024-09-21T07:11:47.070 INFO:teuthology.orchestra.run.smithi049.stdout: "data_read": 0, 2024-09-21T07:11:47.070 INFO:teuthology.orchestra.run.smithi049.stdout: "data_written": 0, 2024-09-21T07:11:47.070 INFO:teuthology.orchestra.run.smithi049.stdout: "data_flushed": 0, 2024-09-21T07:11:47.070 INFO:teuthology.orchestra.run.smithi049.stdout: "data_overwritten_while_flushing": 0, 2024-09-21T07:11:47.070 INFO:teuthology.orchestra.run.smithi049.stdout: "write_ops_blocked": 0, 2024-09-21T07:11:47.070 INFO:teuthology.orchestra.run.smithi049.stdout: "write_bytes_blocked": 0, 2024-09-21T07:11:47.070 INFO:teuthology.orchestra.run.smithi049.stdout: "write_time_blocked": 0.000000000 2024-09-21T07:11:47.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.070 INFO:teuthology.orchestra.run.smithi049.stdout: "objectcacher-libcephfs-0x55e18e9441a0": { 2024-09-21T07:11:47.070 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_ops_hit": 0, 2024-09-21T07:11:47.070 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_ops_miss": 0, 2024-09-21T07:11:47.070 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_bytes_hit": 0, 2024-09-21T07:11:47.071 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_bytes_miss": 0, 2024-09-21T07:11:47.071 INFO:teuthology.orchestra.run.smithi049.stdout: "data_read": 0, 2024-09-21T07:11:47.071 INFO:teuthology.orchestra.run.smithi049.stdout: "data_written": 0, 2024-09-21T07:11:47.071 INFO:teuthology.orchestra.run.smithi049.stdout: "data_flushed": 0, 2024-09-21T07:11:47.071 INFO:teuthology.orchestra.run.smithi049.stdout: "data_overwritten_while_flushing": 0, 2024-09-21T07:11:47.071 INFO:teuthology.orchestra.run.smithi049.stdout: "write_ops_blocked": 0, 2024-09-21T07:11:47.071 INFO:teuthology.orchestra.run.smithi049.stdout: "write_bytes_blocked": 0, 2024-09-21T07:11:47.071 INFO:teuthology.orchestra.run.smithi049.stdout: "write_time_blocked": 0.000000000 2024-09-21T07:11:47.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.071 INFO:teuthology.orchestra.run.smithi049.stdout: "objectcacher-libcephfs-0x55e18e9680d0": { 2024-09-21T07:11:47.071 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_ops_hit": 9, 2024-09-21T07:11:47.071 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_ops_miss": 0, 2024-09-21T07:11:47.071 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_bytes_hit": 1233, 2024-09-21T07:11:47.071 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_bytes_miss": 0, 2024-09-21T07:11:47.071 INFO:teuthology.orchestra.run.smithi049.stdout: "data_read": 1233, 2024-09-21T07:11:47.072 INFO:teuthology.orchestra.run.smithi049.stdout: "data_written": 411, 2024-09-21T07:11:47.072 INFO:teuthology.orchestra.run.smithi049.stdout: "data_flushed": 411, 2024-09-21T07:11:47.072 INFO:teuthology.orchestra.run.smithi049.stdout: "data_overwritten_while_flushing": 0, 2024-09-21T07:11:47.072 INFO:teuthology.orchestra.run.smithi049.stdout: "write_ops_blocked": 0, 2024-09-21T07:11:47.072 INFO:teuthology.orchestra.run.smithi049.stdout: "write_bytes_blocked": 0, 2024-09-21T07:11:47.072 INFO:teuthology.orchestra.run.smithi049.stdout: "write_time_blocked": 0.000000000 2024-09-21T07:11:47.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.072 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": { 2024-09-21T07:11:47.072 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-09-21T07:11:47.072 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-09-21T07:11:47.072 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-09-21T07:11:47.072 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-09-21T07:11:47.072 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-09-21T07:11:47.072 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-09-21T07:11:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-09-21T07:11:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-09-21T07:11:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-09-21T07:11:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-09-21T07:11:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-09-21T07:11:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-09-21T07:11:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-09-21T07:11:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-09-21T07:11:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-09-21T07:11:47.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-09-21T07:11:47.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-09-21T07:11:47.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-09-21T07:11:47.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-09-21T07:11:47.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-09-21T07:11:47.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-09-21T07:11:47.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-09-21T07:11:47.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-09-21T07:11:47.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-09-21T07:11:47.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-09-21T07:11:47.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-09-21T07:11:47.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-09-21T07:11:47.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-09-21T07:11:47.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-09-21T07:11:47.075 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-09-21T07:11:47.075 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:11:47.075 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-09-21T07:11:47.075 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:11:47.075 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-09-21T07:11:47.075 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-09-21T07:11:47.075 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-09-21T07:11:47.075 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:11:47.075 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-09-21T07:11:47.075 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:11:47.075 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-09-21T07:11:47.075 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-09-21T07:11:47.075 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-09-21T07:11:47.075 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-09-21T07:11:47.075 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-09-21T07:11:47.076 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-09-21T07:11:47.076 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-09-21T07:11:47.076 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-09-21T07:11:47.076 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-09-21T07:11:47.076 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-09-21T07:11:47.076 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-09-21T07:11:47.076 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-09-21T07:11:47.076 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-09-21T07:11:47.076 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-09-21T07:11:47.076 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-09-21T07:11:47.076 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 8, 2024-09-21T07:11:47.076 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-09-21T07:11:47.076 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 35, 2024-09-21T07:11:47.076 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-09-21T07:11:47.077 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 34, 2024-09-21T07:11:47.077 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 8, 2024-09-21T07:11:47.077 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 8, 2024-09-21T07:11:47.077 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-09-21T07:11:47.077 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-09-21T07:11:47.077 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-09-21T07:11:47.077 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-09-21T07:11:47.077 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-09-21T07:11:47.077 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.077 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter-0x55e18da08d00": { 2024-09-21T07:11:47.077 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-09-21T07:11:47.077 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-09-21T07:11:47.077 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 98, 2024-09-21T07:11:47.077 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 1643959, 2024-09-21T07:11:47.077 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-09-21T07:11:47.078 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 98, 2024-09-21T07:11:47.078 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-09-21T07:11:47.078 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 98, 2024-09-21T07:11:47.078 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.299991770, 2024-09-21T07:11:47.078 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.003061140 2024-09-21T07:11:47.078 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.078 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-09-21T07:11:47.078 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-09-21T07:11:47.078 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 98, 2024-09-21T07:11:47.078 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 189 2024-09-21T07:11:47.078 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.078 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 98, 2024-09-21T07:11:47.078 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 26, 2024-09-21T07:11:47.078 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 72, 2024-09-21T07:11:47.079 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-09-21T07:11:47.079 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-09-21T07:11:47.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-09-21T07:11:47.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 2, 2024-09-21T07:11:47.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 10, 2024-09-21T07:11:47.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 53, 2024-09-21T07:11:47.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-09-21T07:11:47.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-09-21T07:11:47.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-09-21T07:11:47.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-09-21T07:11:47.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-09-21T07:11:47.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-09-21T07:11:47.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-09-21T07:11:47.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-09-21T07:11:47.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-09-21T07:11:47.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 64, 2024-09-21T07:11:47.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 36, 2024-09-21T07:11:47.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 12, 2024-09-21T07:11:47.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-09-21T07:11:47.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:11:47.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 12, 2024-09-21T07:11:47.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-09-21T07:11:47.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-09-21T07:11:47.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:11:47.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-09-21T07:11:47.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:11:47.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-09-21T07:11:47.080 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-09-21T07:11:47.080 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-09-21T07:11:47.081 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-09-21T07:11:47.081 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-09-21T07:11:47.081 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-09-21T07:11:47.081 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-09-21T07:11:47.081 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-09-21T07:11:47.081 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-09-21T07:11:47.081 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-09-21T07:11:47.081 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-09-21T07:11:47.081 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-09-21T07:11:47.081 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-09-21T07:11:47.081 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-09-21T07:11:47.081 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-09-21T07:11:47.081 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-09-21T07:11:47.081 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-09-21T07:11:47.081 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 16, 2024-09-21T07:11:47.082 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-09-21T07:11:47.082 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 6, 2024-09-21T07:11:47.082 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 1, 2024-09-21T07:11:47.082 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 1, 2024-09-21T07:11:47.082 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-09-21T07:11:47.082 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-09-21T07:11:47.082 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-09-21T07:11:47.082 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-09-21T07:11:47.082 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-09-21T07:11:47.082 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.082 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter-0x55e18da08ea0": { 2024-09-21T07:11:47.082 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-09-21T07:11:47.082 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-09-21T07:11:47.082 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-09-21T07:11:47.083 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-09-21T07:11:47.083 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-09-21T07:11:47.083 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-09-21T07:11:47.083 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-09-21T07:11:47.083 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.083 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.083 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.083 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.083 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-09-21T07:11:47.083 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-09-21T07:11:47.083 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.083 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-09-21T07:11:47.083 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.083 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-09-21T07:11:47.083 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-09-21T07:11:47.084 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-09-21T07:11:47.084 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-09-21T07:11:47.084 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-09-21T07:11:47.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-09-21T07:11:47.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-09-21T07:11:47.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-09-21T07:11:47.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-09-21T07:11:47.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-09-21T07:11:47.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-09-21T07:11:47.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-09-21T07:11:47.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-09-21T07:11:47.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-09-21T07:11:47.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-09-21T07:11:47.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-09-21T07:11:47.084 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-09-21T07:11:47.085 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-09-21T07:11:47.085 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-09-21T07:11:47.085 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-09-21T07:11:47.085 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:11:47.085 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-09-21T07:11:47.085 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:11:47.085 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-09-21T07:11:47.085 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-09-21T07:11:47.085 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-09-21T07:11:47.085 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:11:47.085 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-09-21T07:11:47.085 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:11:47.085 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-09-21T07:11:47.085 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-09-21T07:11:47.085 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-09-21T07:11:47.086 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-09-21T07:11:47.086 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-09-21T07:11:47.086 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-09-21T07:11:47.086 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-09-21T07:11:47.086 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-09-21T07:11:47.086 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-09-21T07:11:47.086 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-09-21T07:11:47.086 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-09-21T07:11:47.086 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-09-21T07:11:47.086 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-09-21T07:11:47.086 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-09-21T07:11:47.086 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-09-21T07:11:47.086 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-09-21T07:11:47.086 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-09-21T07:11:47.086 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-09-21T07:11:47.087 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-09-21T07:11:47.087 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-09-21T07:11:47.087 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-09-21T07:11:47.087 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-09-21T07:11:47.087 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-09-21T07:11:47.087 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-09-21T07:11:47.087 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-09-21T07:11:47.087 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-09-21T07:11:47.087 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-09-21T07:11:47.087 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.087 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter-0x55e18db965b0": { 2024-09-21T07:11:47.087 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-09-21T07:11:47.087 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-09-21T07:11:47.087 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-09-21T07:11:47.088 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-09-21T07:11:47.088 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-09-21T07:11:47.088 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-09-21T07:11:47.088 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-09-21T07:11:47.088 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.088 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.088 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.088 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.088 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-09-21T07:11:47.088 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-09-21T07:11:47.088 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.088 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-09-21T07:11:47.088 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.088 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-09-21T07:11:47.088 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-09-21T07:11:47.089 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-09-21T07:11:47.089 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-09-21T07:11:47.089 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-09-21T07:11:47.089 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-09-21T07:11:47.089 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-09-21T07:11:47.089 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-09-21T07:11:47.089 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-09-21T07:11:47.089 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-09-21T07:11:47.089 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-09-21T07:11:47.089 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-09-21T07:11:47.089 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-09-21T07:11:47.089 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-09-21T07:11:47.089 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-09-21T07:11:47.089 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-09-21T07:11:47.089 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-09-21T07:11:47.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-09-21T07:11:47.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-09-21T07:11:47.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-09-21T07:11:47.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:11:47.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-09-21T07:11:47.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:11:47.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-09-21T07:11:47.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-09-21T07:11:47.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-09-21T07:11:47.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:11:47.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-09-21T07:11:47.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:11:47.090 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-09-21T07:11:47.090 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-09-21T07:11:47.090 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-09-21T07:11:47.091 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-09-21T07:11:47.091 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-09-21T07:11:47.091 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-09-21T07:11:47.091 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-09-21T07:11:47.091 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-09-21T07:11:47.091 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-09-21T07:11:47.091 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-09-21T07:11:47.091 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-09-21T07:11:47.091 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-09-21T07:11:47.091 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-09-21T07:11:47.091 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-09-21T07:11:47.091 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-09-21T07:11:47.091 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-09-21T07:11:47.091 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-09-21T07:11:47.092 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-09-21T07:11:47.092 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-09-21T07:11:47.092 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-09-21T07:11:47.092 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-09-21T07:11:47.092 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-09-21T07:11:47.092 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-09-21T07:11:47.092 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-09-21T07:11:47.092 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-09-21T07:11:47.092 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-09-21T07:11:47.092 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-09-21T07:11:47.092 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.092 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter-0x55e18db96f70": { 2024-09-21T07:11:47.092 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-09-21T07:11:47.092 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-09-21T07:11:47.092 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 1, 2024-09-21T07:11:47.093 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 39, 2024-09-21T07:11:47.093 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-09-21T07:11:47.093 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 1, 2024-09-21T07:11:47.093 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-09-21T07:11:47.093 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-09-21T07:11:47.093 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000999973, 2024-09-21T07:11:47.093 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000999973 2024-09-21T07:11:47.093 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.093 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-09-21T07:11:47.093 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-09-21T07:11:47.093 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1, 2024-09-21T07:11:47.093 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 1 2024-09-21T07:11:47.093 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.093 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 1, 2024-09-21T07:11:47.093 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 1, 2024-09-21T07:11:47.094 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-09-21T07:11:47.094 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-09-21T07:11:47.094 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-09-21T07:11:47.094 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-09-21T07:11:47.094 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-09-21T07:11:47.094 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-09-21T07:11:47.094 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-09-21T07:11:47.094 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-09-21T07:11:47.094 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-09-21T07:11:47.094 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-09-21T07:11:47.094 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-09-21T07:11:47.094 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-09-21T07:11:47.094 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-09-21T07:11:47.094 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-09-21T07:11:47.094 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-09-21T07:11:47.095 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-09-21T07:11:47.095 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-09-21T07:11:47.095 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-09-21T07:11:47.095 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:11:47.095 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-09-21T07:11:47.095 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:11:47.095 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-09-21T07:11:47.095 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-09-21T07:11:47.095 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-09-21T07:11:47.095 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:11:47.095 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-09-21T07:11:47.095 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:11:47.095 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 1, 2024-09-21T07:11:47.095 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-09-21T07:11:47.096 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-09-21T07:11:47.096 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-09-21T07:11:47.096 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-09-21T07:11:47.096 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-09-21T07:11:47.096 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-09-21T07:11:47.096 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-09-21T07:11:47.096 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-09-21T07:11:47.096 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-09-21T07:11:47.096 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-09-21T07:11:47.096 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-09-21T07:11:47.096 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-09-21T07:11:47.096 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-09-21T07:11:47.096 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-09-21T07:11:47.096 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-09-21T07:11:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-09-21T07:11:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-09-21T07:11:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-09-21T07:11:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-09-21T07:11:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 1, 2024-09-21T07:11:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 1, 2024-09-21T07:11:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-09-21T07:11:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-09-21T07:11:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-09-21T07:11:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-09-21T07:11:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-09-21T07:11:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter-0x55e18e944270": { 2024-09-21T07:11:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-09-21T07:11:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-09-21T07:11:47.098 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-09-21T07:11:47.098 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-09-21T07:11:47.098 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-09-21T07:11:47.098 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-09-21T07:11:47.098 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-09-21T07:11:47.098 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.098 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.098 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.098 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.098 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-09-21T07:11:47.098 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-09-21T07:11:47.098 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.098 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-09-21T07:11:47.098 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-09-21T07:11:47.099 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-09-21T07:11:47.100 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-09-21T07:11:47.101 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-09-21T07:11:47.101 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-09-21T07:11:47.101 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-09-21T07:11:47.101 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-09-21T07:11:47.101 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-09-21T07:11:47.101 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-09-21T07:11:47.101 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-09-21T07:11:47.101 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-09-21T07:11:47.101 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-09-21T07:11:47.101 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-09-21T07:11:47.101 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-09-21T07:11:47.101 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-09-21T07:11:47.101 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-09-21T07:11:47.101 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-09-21T07:11:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-09-21T07:11:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-09-21T07:11:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-09-21T07:11:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-09-21T07:11:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-09-21T07:11:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-09-21T07:11:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-09-21T07:11:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-09-21T07:11:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-09-21T07:11:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-09-21T07:11:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter-0x55e18e9681a0": { 2024-09-21T07:11:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-09-21T07:11:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-09-21T07:11:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 3, 2024-09-21T07:11:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 411, 2024-09-21T07:11:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-09-21T07:11:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 3, 2024-09-21T07:11:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-09-21T07:11:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-09-21T07:11:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.006999809, 2024-09-21T07:11:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002333269 2024-09-21T07:11:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-09-21T07:11:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-09-21T07:11:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-09-21T07:11:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 3 2024-09-21T07:11:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 3, 2024-09-21T07:11:47.104 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-09-21T07:11:47.104 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 3, 2024-09-21T07:11:47.104 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-09-21T07:11:47.104 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-09-21T07:11:47.104 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-09-21T07:11:47.104 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-09-21T07:11:47.104 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-09-21T07:11:47.104 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 3, 2024-09-21T07:11:47.104 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-09-21T07:11:47.104 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-09-21T07:11:47.104 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-09-21T07:11:47.104 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-09-21T07:11:47.104 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-09-21T07:11:47.104 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-09-21T07:11:47.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-09-21T07:11:47.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-09-21T07:11:47.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-09-21T07:11:47.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-09-21T07:11:47.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-09-21T07:11:47.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:11:47.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-09-21T07:11:47.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:11:47.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-09-21T07:11:47.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-09-21T07:11:47.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-09-21T07:11:47.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:11:47.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-09-21T07:11:47.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:11:47.105 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-09-21T07:11:47.106 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-09-21T07:11:47.106 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-09-21T07:11:47.106 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-09-21T07:11:47.106 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-09-21T07:11:47.106 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-09-21T07:11:47.106 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-09-21T07:11:47.106 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-09-21T07:11:47.106 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-09-21T07:11:47.106 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-09-21T07:11:47.106 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-09-21T07:11:47.106 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-09-21T07:11:47.106 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-09-21T07:11:47.106 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-09-21T07:11:47.106 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-09-21T07:11:47.106 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-09-21T07:11:47.107 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-09-21T07:11:47.107 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-09-21T07:11:47.107 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-09-21T07:11:47.107 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-09-21T07:11:47.107 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 2, 2024-09-21T07:11:47.107 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 2, 2024-09-21T07:11:47.107 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-09-21T07:11:47.107 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-09-21T07:11:47.107 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-09-21T07:11:47.107 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-09-21T07:11:47.107 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-09-21T07:11:47.107 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.107 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter-0x55e18e9695f0": { 2024-09-21T07:11:47.107 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-09-21T07:11:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-09-21T07:11:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-09-21T07:11:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-09-21T07:11:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-09-21T07:11:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-09-21T07:11:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-09-21T07:11:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-09-21T07:11:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-09-21T07:11:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-09-21T07:11:47.108 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.109 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-09-21T07:11:47.109 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-09-21T07:11:47.109 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-09-21T07:11:47.109 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-09-21T07:11:47.109 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-09-21T07:11:47.109 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-09-21T07:11:47.109 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-09-21T07:11:47.109 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-09-21T07:11:47.109 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-09-21T07:11:47.109 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-09-21T07:11:47.109 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-09-21T07:11:47.109 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-09-21T07:11:47.109 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-09-21T07:11:47.109 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-09-21T07:11:47.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-09-21T07:11:47.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-09-21T07:11:47.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-09-21T07:11:47.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-09-21T07:11:47.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-09-21T07:11:47.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-09-21T07:11:47.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:11:47.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-09-21T07:11:47.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:11:47.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-09-21T07:11:47.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-09-21T07:11:47.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-09-21T07:11:47.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:11:47.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-09-21T07:11:47.110 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:11:47.111 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-09-21T07:11:47.111 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-09-21T07:11:47.111 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-09-21T07:11:47.111 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-09-21T07:11:47.111 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-09-21T07:11:47.111 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-09-21T07:11:47.111 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-09-21T07:11:47.111 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-09-21T07:11:47.111 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-09-21T07:11:47.111 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-09-21T07:11:47.111 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-09-21T07:11:47.111 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-09-21T07:11:47.111 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-09-21T07:11:47.111 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-09-21T07:11:47.111 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-09-21T07:11:47.112 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-09-21T07:11:47.112 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-09-21T07:11:47.112 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-09-21T07:11:47.112 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-09-21T07:11:47.112 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-09-21T07:11:47.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-09-21T07:11:47.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-09-21T07:11:47.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-09-21T07:11:47.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-09-21T07:11:47.112 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-09-21T07:11:47.112 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-09-21T07:11:47.112 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-09-21T07:11:47.112 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.112 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-mgr_client_bytes": { 2024-09-21T07:11:47.112 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 134217728, 2024-09-21T07:11:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 55, 2024-09-21T07:11:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 255442, 2024-09-21T07:11:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 55, 2024-09-21T07:11:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 73, 2024-09-21T07:11:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 255442, 2024-09-21T07:11:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.114 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.114 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-mgr_client_messages": { 2024-09-21T07:11:47.114 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.114 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 512, 2024-09-21T07:11:47.114 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.114 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 55, 2024-09-21T07:11:47.114 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 55, 2024-09-21T07:11:47.114 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.114 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 55, 2024-09-21T07:11:47.114 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.114 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.114 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 55, 2024-09-21T07:11:47.114 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 55, 2024-09-21T07:11:47.114 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-mgr_mds_bytes": { 2024-09-21T07:11:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 134217728, 2024-09-21T07:11:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 68, 2024-09-21T07:11:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 840198, 2024-09-21T07:11:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 68, 2024-09-21T07:11:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.116 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 68, 2024-09-21T07:11:47.116 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 840198, 2024-09-21T07:11:47.116 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.116 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.116 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.116 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.116 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.116 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.116 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-mgr_mds_messsages": { 2024-09-21T07:11:47.116 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.116 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 128, 2024-09-21T07:11:47.116 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.116 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 68, 2024-09-21T07:11:47.116 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 68, 2024-09-21T07:11:47.117 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.117 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 68, 2024-09-21T07:11:47.117 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.117 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.117 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 68, 2024-09-21T07:11:47.117 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 68, 2024-09-21T07:11:47.117 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.117 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.117 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.117 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.117 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.117 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.117 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-mgr_mon_bytes": { 2024-09-21T07:11:47.117 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.117 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 134217728, 2024-09-21T07:11:47.118 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.118 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 54, 2024-09-21T07:11:47.118 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 432401, 2024-09-21T07:11:47.118 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.118 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 54, 2024-09-21T07:11:47.118 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.118 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.118 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 54, 2024-09-21T07:11:47.118 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 432401, 2024-09-21T07:11:47.118 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.118 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.118 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.118 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.118 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.119 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.119 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-mgr_mon_messsages": { 2024-09-21T07:11:47.119 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.119 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 128, 2024-09-21T07:11:47.119 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.119 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 54, 2024-09-21T07:11:47.119 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 54, 2024-09-21T07:11:47.119 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.119 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 54, 2024-09-21T07:11:47.119 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.119 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.119 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 54, 2024-09-21T07:11:47.119 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 54, 2024-09-21T07:11:47.119 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.120 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.120 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.120 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.120 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.120 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.120 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-mgr_osd_bytes": { 2024-09-21T07:11:47.120 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.120 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 536870912, 2024-09-21T07:11:47.120 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.120 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 294, 2024-09-21T07:11:47.120 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3909380, 2024-09-21T07:11:47.120 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.120 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 294, 2024-09-21T07:11:47.120 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.120 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.121 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 294, 2024-09-21T07:11:47.121 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3909380, 2024-09-21T07:11:47.121 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.121 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.121 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.121 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.121 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.121 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.121 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-mgr_osd_messsages": { 2024-09-21T07:11:47.121 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.121 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 8192, 2024-09-21T07:11:47.121 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.121 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 294, 2024-09-21T07:11:47.121 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 294, 2024-09-21T07:11:47.122 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.122 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 294, 2024-09-21T07:11:47.122 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.122 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.122 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 294, 2024-09-21T07:11:47.122 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 294, 2024-09-21T07:11:47.122 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.122 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.122 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.122 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.122 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.122 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.122 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": { 2024-09-21T07:11:47.122 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.122 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.123 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.123 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 181, 2024-09-21T07:11:47.123 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 69602, 2024-09-21T07:11:47.123 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.123 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 181, 2024-09-21T07:11:47.123 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.123 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.123 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 181, 2024-09-21T07:11:47.123 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 69602, 2024-09-21T07:11:47.123 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.123 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.123 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.123 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.123 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.123 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.124 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client-0x55e18db97c70": { 2024-09-21T07:11:47.124 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.124 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.124 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.124 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 86, 2024-09-21T07:11:47.124 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 45814, 2024-09-21T07:11:47.124 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.124 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 86, 2024-09-21T07:11:47.124 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.124 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.124 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 86, 2024-09-21T07:11:47.124 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 45814, 2024-09-21T07:11:47.124 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.124 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.124 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.125 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.125 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.125 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.125 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client-0x55e18e944000": { 2024-09-21T07:11:47.125 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.125 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.125 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.125 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 38, 2024-09-21T07:11:47.125 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 21468, 2024-09-21T07:11:47.125 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.125 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 38, 2024-09-21T07:11:47.125 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.125 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.125 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 38, 2024-09-21T07:11:47.126 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 21468, 2024-09-21T07:11:47.126 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.126 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.126 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.126 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.126 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.126 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.126 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mgr": { 2024-09-21T07:11:47.126 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.126 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.126 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.126 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 342, 2024-09-21T07:11:47.126 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 919716, 2024-09-21T07:11:47.126 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.126 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 342, 2024-09-21T07:11:47.127 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.127 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.127 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 342, 2024-09-21T07:11:47.127 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 919716, 2024-09-21T07:11:47.127 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.127 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.127 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.127 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.127 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.127 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.127 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mgr-0x55e18da080d0": { 2024-09-21T07:11:47.127 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.127 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.127 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.128 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 471, 2024-09-21T07:11:47.128 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 5437421, 2024-09-21T07:11:47.128 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.128 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 471, 2024-09-21T07:11:47.128 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.128 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.128 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 471, 2024-09-21T07:11:47.128 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 5437421, 2024-09-21T07:11:47.128 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.128 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.128 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.128 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.128 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.128 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.128 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": { 2024-09-21T07:11:47.129 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.129 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.129 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.129 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 111, 2024-09-21T07:11:47.129 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 590822, 2024-09-21T07:11:47.129 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.129 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 111, 2024-09-21T07:11:47.129 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.129 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.129 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 111, 2024-09-21T07:11:47.129 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 590822, 2024-09-21T07:11:47.129 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.129 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.129 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.129 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.130 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.130 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.130 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55e18da08dd0": { 2024-09-21T07:11:47.130 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.130 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.130 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.130 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 11, 2024-09-21T07:11:47.130 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 560734, 2024-09-21T07:11:47.130 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.130 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 11, 2024-09-21T07:11:47.130 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.130 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.130 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 11, 2024-09-21T07:11:47.130 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 560734, 2024-09-21T07:11:47.131 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.131 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.131 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.131 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.131 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.131 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.131 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55e18da09040": { 2024-09-21T07:11:47.131 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.131 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.131 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.131 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 12, 2024-09-21T07:11:47.131 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 560758, 2024-09-21T07:11:47.131 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.131 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 12, 2024-09-21T07:11:47.131 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.132 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.132 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 12, 2024-09-21T07:11:47.132 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 560758, 2024-09-21T07:11:47.132 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.132 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.132 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.132 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.132 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.132 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55e18db97040": { 2024-09-21T07:11:47.132 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.132 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.132 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.132 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 10, 2024-09-21T07:11:47.132 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 412118, 2024-09-21T07:11:47.133 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.133 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 10, 2024-09-21T07:11:47.133 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.133 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.133 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 10, 2024-09-21T07:11:47.133 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 412118, 2024-09-21T07:11:47.133 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.133 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.133 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.133 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.133 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.133 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": { 2024-09-21T07:11:47.133 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.133 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.134 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.134 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-21T07:11:47.134 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-21T07:11:47.134 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.134 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-21T07:11:47.134 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.134 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.134 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-09-21T07:11:47.134 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-09-21T07:11:47.134 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.134 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.134 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.134 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.134 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.134 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.135 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes-0x55e18da09110": { 2024-09-21T07:11:47.135 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.135 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.135 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.135 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 98, 2024-09-21T07:11:47.135 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 1643075, 2024-09-21T07:11:47.135 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.135 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 98, 2024-09-21T07:11:47.135 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.135 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.135 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 98, 2024-09-21T07:11:47.135 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 1643075, 2024-09-21T07:11:47.135 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.135 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.136 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.136 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.136 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.136 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.136 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes-0x55e18da092b0": { 2024-09-21T07:11:47.136 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.136 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.136 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.136 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-21T07:11:47.136 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-21T07:11:47.136 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.136 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-21T07:11:47.136 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.136 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.136 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-09-21T07:11:47.137 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-09-21T07:11:47.137 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.137 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.137 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.137 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.137 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.137 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.137 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes-0x55e18da096c0": { 2024-09-21T07:11:47.137 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.137 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.137 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.137 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-21T07:11:47.137 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-21T07:11:47.137 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.137 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-21T07:11:47.138 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.138 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.138 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-09-21T07:11:47.138 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-09-21T07:11:47.138 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.138 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.138 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.138 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.138 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.138 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.138 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes-0x55e18db97a00": { 2024-09-21T07:11:47.138 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.138 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.138 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.138 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 1, 2024-09-21T07:11:47.139 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-21T07:11:47.139 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.139 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 1, 2024-09-21T07:11:47.139 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.139 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.139 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 1, 2024-09-21T07:11:47.139 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-09-21T07:11:47.139 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.139 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.139 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.139 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.139 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.139 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes-0x55e18e6ad1e0": { 2024-09-21T07:11:47.139 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.140 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.140 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.140 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-21T07:11:47.140 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-21T07:11:47.140 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.140 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-21T07:11:47.140 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 3, 2024-09-21T07:11:47.140 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 411, 2024-09-21T07:11:47.140 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 3, 2024-09-21T07:11:47.140 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 411, 2024-09-21T07:11:47.140 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.140 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.140 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.140 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.140 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.141 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.141 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes-0x55e18e9685b0": { 2024-09-21T07:11:47.141 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.141 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.141 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.141 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-21T07:11:47.141 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-21T07:11:47.141 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.141 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-21T07:11:47.141 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.141 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.141 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-09-21T07:11:47.141 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-09-21T07:11:47.141 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.141 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.142 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.142 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.142 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.142 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.142 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes-0x55e18e969520": { 2024-09-21T07:11:47.142 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.142 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T07:11:47.142 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.142 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-21T07:11:47.142 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-21T07:11:47.142 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.142 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-21T07:11:47.142 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.142 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.143 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-09-21T07:11:47.143 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-09-21T07:11:47.143 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.143 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.143 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.143 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.143 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.143 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.143 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": { 2024-09-21T07:11:47.143 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.143 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-09-21T07:11:47.143 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.143 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-21T07:11:47.143 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-21T07:11:47.143 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops-0x55e18da08c30": { 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.144 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 98, 2024-09-21T07:11:47.145 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 98, 2024-09-21T07:11:47.145 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.145 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 98, 2024-09-21T07:11:47.145 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.145 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.145 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 98, 2024-09-21T07:11:47.145 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 98, 2024-09-21T07:11:47.145 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.145 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.145 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.145 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.145 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.145 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.145 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops-0x55e18da08f70": { 2024-09-21T07:11:47.145 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-09-21T07:11:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-21T07:11:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-21T07:11:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-21T07:11:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-09-21T07:11:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-09-21T07:11:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.146 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops-0x55e18db964e0": { 2024-09-21T07:11:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-09-21T07:11:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-21T07:11:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-21T07:11:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-21T07:11:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-09-21T07:11:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-09-21T07:11:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.147 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops-0x55e18db97ba0": { 2024-09-21T07:11:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-09-21T07:11:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 1, 2024-09-21T07:11:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 1, 2024-09-21T07:11:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 1, 2024-09-21T07:11:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.148 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 1, 2024-09-21T07:11:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 1, 2024-09-21T07:11:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops-0x55e18e9440d0": { 2024-09-21T07:11:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-09-21T07:11:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-21T07:11:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-21T07:11:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.149 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-21T07:11:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-09-21T07:11:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-09-21T07:11:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops-0x55e18e968000": { 2024-09-21T07:11:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-09-21T07:11:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.150 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-21T07:11:47.151 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-21T07:11:47.151 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.151 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-21T07:11:47.151 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 3, 2024-09-21T07:11:47.151 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 3, 2024-09-21T07:11:47.151 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 3, 2024-09-21T07:11:47.151 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3, 2024-09-21T07:11:47.151 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.151 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.151 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.151 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.151 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.151 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.151 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops-0x55e18e968340": { 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T07:11:47.152 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.153 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T07:11:47.153 INFO:teuthology.orchestra.run.smithi049.stdout: "trackedop": { 2024-09-21T07:11:47.153 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_ops_count": 0 2024-09-21T07:11:47.153 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T07:11:47.153 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T07:11:47.154 INFO:tasks.check_counter:Daemon mgr.x finisher-volumes.complete_latency.avgcount=9 2024-09-21T07:11:47.155 INFO:tasks.check_counter:Daemon mgr.x finisher-volumes.queue_len=0 2024-09-21T07:11:47.155 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T07:11:47.164 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T07:11:47.164 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:11:47.164 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:47.184 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056793,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17771 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249344k,nr_inodes=812336,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:11:47.184 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T07:11:47.185 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:47.244 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056793,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17771 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249344k,nr_inodes=812336,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:11:47.244 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:11:47.244 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:47.261 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056005,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19803 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:11:47.262 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T07:11:47.262 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:11:47.319 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056005,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19803 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:11:47.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:47.319 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-21T07:11:47.338 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:11:47.338 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:11:47.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:47.338 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:11:47.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:47.409 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:11:47.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:47.479 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-21T07:11:47.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:47.579 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-21T07:11:47.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:47.596 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-21T07:11:47.670 INFO:teuthology.orchestra.run.smithi018.stderr:Cannot find device "ceph-brx" 2024-09-21T07:11:47.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:11:47.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:47.672 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-09-21T07:11:47.690 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T07:11:47.690 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T07:11:47.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:47.690 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T07:11:47.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:47.759 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T07:11:47.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:47.828 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-09-21T07:11:47.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:47.927 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-09-21T07:11:47.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:11:47.943 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-09-21T07:11:48.012 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2024-09-21T07:11:48.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:11:48.014 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T07:11:48.023 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:11:48.023 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:11:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.148+0000 7fb63a2cc640 1 -- 172.21.15.18:0/741717056 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb63406f850 msgr2=0x7fb63406e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.148+0000 7fb63a2cc640 1 --2- 172.21.15.18:0/741717056 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb63406f850 0x7fb63406e220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb62c005fd0 tx=0x7fb62c02a840 comp rx=0 tx=0).stop 2024-09-21T07:11:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.148+0000 7fb63a2cc640 1 -- 172.21.15.18:0/741717056 shutdown_connections 2024-09-21T07:11:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.148+0000 7fb63a2cc640 1 --2- 172.21.15.18:0/741717056 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb63406f850 0x7fb63406e220 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.148+0000 7fb63a2cc640 1 --2- 172.21.15.18:0/741717056 >> v2:172.21.15.49:3300/0 conn(0x7fb6340ce0b0 0x7fb63415f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.148+0000 7fb63a2cc640 1 -- 172.21.15.18:0/741717056 >> 172.21.15.18:0/741717056 conn(0x7fb6340b1fe0 msgr2=0x7fb6340b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.148+0000 7fb63a2cc640 1 -- 172.21.15.18:0/741717056 shutdown_connections 2024-09-21T07:11:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.148+0000 7fb63a2cc640 1 -- 172.21.15.18:0/741717056 wait complete. 2024-09-21T07:11:48.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.150+0000 7fb63a2cc640 1 Processor -- start 2024-09-21T07:11:48.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.150+0000 7fb63a2cc640 1 -- start start 2024-09-21T07:11:48.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.151+0000 7fb63a2cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb63406f850 0x7fb634156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.151+0000 7fb63a2cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6340ce0b0 0x7fb6341f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.151+0000 7fb63a2cc640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb6340d0b20 0x7fb6341574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.151+0000 7fb63a2cc640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6340d0410 con 0x7fb63406f850 2024-09-21T07:11:48.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.151+0000 7fb63a2cc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb6340d0290 con 0x7fb6340ce0b0 2024-09-21T07:11:48.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.151+0000 7fb63a2cc640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fb6340d0590 con 0x7fb6340d0b20 2024-09-21T07:11:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.151+0000 7fb633fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb63406f850 0x7fb634156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.151+0000 7fb633fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb63406f850 0x7fb634156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38514/0 (socket says 172.21.15.18:38514) 2024-09-21T07:11:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.151+0000 7fb633fff640 1 -- 172.21.15.18:0/1165653202 learned_addr learned my addr 172.21.15.18:0/1165653202 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.152+0000 7fb6337fe640 1 --2- 172.21.15.18:0/1165653202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6340ce0b0 0x7fb6341f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.152+0000 7fb638869640 1 --2- 172.21.15.18:0/1165653202 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb6340d0b20 0x7fb6341574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.152+0000 7fb633fff640 1 -- 172.21.15.18:0/1165653202 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb6340d0b20 msgr2=0x7fb6341574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.152+0000 7fb633fff640 1 --2- 172.21.15.18:0/1165653202 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb6340d0b20 0x7fb6341574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.152+0000 7fb633fff640 1 -- 172.21.15.18:0/1165653202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6340ce0b0 msgr2=0x7fb6341f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.152+0000 7fb633fff640 1 --2- 172.21.15.18:0/1165653202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6340ce0b0 0x7fb6341f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.152+0000 7fb633fff640 1 -- 172.21.15.18:0/1165653202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb634157070 con 0x7fb63406f850 2024-09-21T07:11:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.152+0000 7fb6337fe640 1 --2- 172.21.15.18:0/1165653202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6340ce0b0 0x7fb6341f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.152+0000 7fb633fff640 1 --2- 172.21.15.18:0/1165653202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb63406f850 0x7fb634156b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb62400c530 tx=0x7fb62400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.152+0000 7fb630ff9640 1 -- 172.21.15.18:0/1165653202 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624016020 con 0x7fb63406f850 2024-09-21T07:11:48.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.152+0000 7fb630ff9640 1 -- 172.21.15.18:0/1165653202 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb624012920 con 0x7fb63406f850 2024-09-21T07:11:48.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.152+0000 7fb63a2cc640 1 -- 172.21.15.18:0/1165653202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb634072c90 con 0x7fb63406f850 2024-09-21T07:11:48.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.152+0000 7fb630ff9640 1 -- 172.21.15.18:0/1165653202 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624012d70 con 0x7fb63406f850 2024-09-21T07:11:48.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.152+0000 7fb63a2cc640 1 -- 172.21.15.18:0/1165653202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb634156330 con 0x7fb63406f850 2024-09-21T07:11:48.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.153+0000 7fb63a2cc640 1 -- 172.21.15.18:0/1165653202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb634156120 con 0x7fb63406f850 2024-09-21T07:11:48.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.154+0000 7fb630ff9640 1 -- 172.21.15.18:0/1165653202 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fb624019020 con 0x7fb63406f850 2024-09-21T07:11:48.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.155+0000 7fb630ff9640 1 --2- 172.21.15.18:0/1165653202 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb620078d40 0x7fb62007b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.155+0000 7fb630ff9640 1 -- 172.21.15.18:0/1165653202 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fb62409aea0 con 0x7fb63406f850 2024-09-21T07:11:48.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.155+0000 7fb6337fe640 1 --2- 172.21.15.18:0/1165653202 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb620078d40 0x7fb62007b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.155+0000 7fb6337fe640 1 --2- 172.21.15.18:0/1165653202 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb620078d40 0x7fb62007b250 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb634159650 tx=0x7fb628005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:48.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.160+0000 7fb630ff9640 1 -- 172.21.15.18:0/1165653202 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb624020020 con 0x7fb63406f850 2024-09-21T07:11:48.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.348+0000 7fb63a2cc640 1 -- 172.21.15.18:0/1165653202 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb63406b490 con 0x7fb620078d40 2024-09-21T07:11:48.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.349+0000 7fb630ff9640 1 -- 172.21.15.18:0/1165653202 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13464 (secure 0 0 0) 0x7fb628011bb0 con 0x7fb620078d40 2024-09-21T07:11:48.351 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:48.351 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-21T07:11:48.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.351+0000 7fb63a2cc640 1 -- 172.21.15.18:0/1165653202 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb620078d40 msgr2=0x7fb62007b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.351+0000 7fb63a2cc640 1 --2- 172.21.15.18:0/1165653202 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb620078d40 0x7fb62007b250 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb634159650 tx=0x7fb628005f90 comp rx=0 tx=0).stop 2024-09-21T07:11:48.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.351+0000 7fb63a2cc640 1 -- 172.21.15.18:0/1165653202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb63406f850 msgr2=0x7fb634156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.351+0000 7fb63a2cc640 1 --2- 172.21.15.18:0/1165653202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb63406f850 0x7fb634156b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb62400c530 tx=0x7fb62400c9f0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.351+0000 7fb63a2cc640 1 -- 172.21.15.18:0/1165653202 shutdown_connections 2024-09-21T07:11:48.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.351+0000 7fb63a2cc640 1 --2- 172.21.15.18:0/1165653202 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb620078d40 0x7fb62007b250 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.351+0000 7fb63a2cc640 1 --2- 172.21.15.18:0/1165653202 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb6340d0b20 0x7fb6341574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.351+0000 7fb63a2cc640 1 --2- 172.21.15.18:0/1165653202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6340ce0b0 0x7fb6341f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.351+0000 7fb63a2cc640 1 --2- 172.21.15.18:0/1165653202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb63406f850 0x7fb634156b30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.351+0000 7fb63a2cc640 1 -- 172.21.15.18:0/1165653202 >> 172.21.15.18:0/1165653202 conn(0x7fb6340b1fe0 msgr2=0x7fb6340b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:48.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.352+0000 7fb63a2cc640 1 -- 172.21.15.18:0/1165653202 shutdown_connections 2024-09-21T07:11:48.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.352+0000 7fb63a2cc640 1 -- 172.21.15.18:0/1165653202 wait complete. 2024-09-21T07:11:48.364 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-21T07:11:48.329626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":270444,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754704276,"statfs":{"total":773094113280,"available":772817178624,"internally_reserved":0,"allocated":4366336,"data_stored":2412416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-131792,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-94,"num_write_kb":-164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.533891"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":135,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T07:11:43.804157+0000","last_change":"2024-09-21T07:10:32.034091+0000","last_active":"2024-09-21T07:11:43.804157+0000","last_peered":"2024-09-21T07:11:43.804157+0000","last_clean":"2024-09-21T07:11:43.804157+0000","last_became_active":"2024-09-21T07:10:32.033005+0000","last_became_peered":"2024-09-21T07:10:32.033005+0000","last_unstale":"2024-09-21T07:11:43.804157+0000","last_undegraded":"2024-09-21T07:11:43.804157+0000","last_fullsized":"2024-09-21T07:11:43.804157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_clean_scrub_stamp":"2024-09-21T07:10:31.011167+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:10.064019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":991232,"data_stored":744328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35744,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336096,"statfs":{"total":96636764160,"available":96600162304,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35740,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336100,"statfs":{"total":96636764160,"available":96600166400,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35744,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336096,"statfs":{"total":96636764160,"available":96600162304,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":991232,"data_stored":744328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:11:48.365 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:11:48.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.480+0000 7f460a40e640 1 -- 172.21.15.18:0/3681854325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f460415d060 msgr2=0x7f460415d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.480+0000 7f460a40e640 1 --2- 172.21.15.18:0/3681854325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f460415d060 0x7f460415d470 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f46040751d0 tx=0x7f45f802a560 comp rx=0 tx=0).stop 2024-09-21T07:11:48.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.480+0000 7f460a40e640 1 -- 172.21.15.18:0/3681854325 shutdown_connections 2024-09-21T07:11:48.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.480+0000 7f460a40e640 1 --2- 172.21.15.18:0/3681854325 >> v2:172.21.15.49:3300/0 conn(0x7f460415d9b0 0x7f46041605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.480+0000 7f460a40e640 1 --2- 172.21.15.18:0/3681854325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f460415d060 0x7f460415d470 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.480+0000 7f460a40e640 1 --2- 172.21.15.18:0/3681854325 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f46040b4760 0x7f4604153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.480+0000 7f460a40e640 1 -- 172.21.15.18:0/3681854325 >> 172.21.15.18:0/3681854325 conn(0x7f46040b78b0 msgr2=0x7f46040b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:48.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.480+0000 7f460a40e640 1 -- 172.21.15.18:0/3681854325 shutdown_connections 2024-09-21T07:11:48.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.480+0000 7f460a40e640 1 -- 172.21.15.18:0/3681854325 wait complete. 2024-09-21T07:11:48.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.481+0000 7f460a40e640 1 Processor -- start 2024-09-21T07:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.482+0000 7f460a40e640 1 -- start start 2024-09-21T07:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f460a40e640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f46040b4760 0x7f46041f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f460a40e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f460415d060 0x7f460415b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f460a40e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f460415d9b0 0x7f4604070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f460a40e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4604160eb0 con 0x7f460415d9b0 2024-09-21T07:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f460a40e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4604160d30 con 0x7f460415d060 2024-09-21T07:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f460a40e640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f4604161030 con 0x7f46040b4760 2024-09-21T07:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f46089ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f460415d9b0 0x7f4604070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f46089ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f460415d9b0 0x7f4604070470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38530/0 (socket says 172.21.15.18:38530) 2024-09-21T07:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f46089ab640 1 -- 172.21.15.18:0/1607598883 learned_addr learned my addr 172.21.15.18:0/1607598883 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f4603fff640 1 --2- 172.21.15.18:0/1607598883 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f46040b4760 0x7f46041f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f46037fe640 1 --2- 172.21.15.18:0/1607598883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f460415d060 0x7f460415b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f46089ab640 1 -- 172.21.15.18:0/1607598883 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f46040b4760 msgr2=0x7f46041f5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f46089ab640 1 --2- 172.21.15.18:0/1607598883 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f46040b4760 0x7f46041f5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f46089ab640 1 -- 172.21.15.18:0/1607598883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f460415d060 msgr2=0x7f460415b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f46089ab640 1 --2- 172.21.15.18:0/1607598883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f460415d060 0x7f460415b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.483+0000 7f46089ab640 1 -- 172.21.15.18:0/1607598883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460409ea30 con 0x7f460415d9b0 2024-09-21T07:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.484+0000 7f46089ab640 1 --2- 172.21.15.18:0/1607598883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f460415d9b0 0x7f4604070470 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00e960 tx=0x7f45fc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:48.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.484+0000 7f4600ff9640 1 -- 172.21.15.18:0/1607598883 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc004d20 con 0x7f460415d9b0 2024-09-21T07:11:48.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.484+0000 7f4600ff9640 1 -- 172.21.15.18:0/1607598883 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45fc00cb20 con 0x7f460415d9b0 2024-09-21T07:11:48.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.484+0000 7f460a40e640 1 -- 172.21.15.18:0/1607598883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460409ed10 con 0x7f460415d9b0 2024-09-21T07:11:48.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.484+0000 7f4600ff9640 1 -- 172.21.15.18:0/1607598883 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc005020 con 0x7f460415d9b0 2024-09-21T07:11:48.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.484+0000 7f460a40e640 1 -- 172.21.15.18:0/1607598883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f460409f2d0 con 0x7f460415d9b0 2024-09-21T07:11:48.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.485+0000 7f460a40e640 1 -- 172.21.15.18:0/1607598883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f460409e7a0 con 0x7f460415d9b0 2024-09-21T07:11:48.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.486+0000 7f4600ff9640 1 -- 172.21.15.18:0/1607598883 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f45fc0051c0 con 0x7f460415d9b0 2024-09-21T07:11:48.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.486+0000 7f4600ff9640 1 --2- 172.21.15.18:0/1607598883 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f45f0078d40 0x7f45f007b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.486+0000 7f4600ff9640 1 -- 172.21.15.18:0/1607598883 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f45fc09b5a0 con 0x7f460415d9b0 2024-09-21T07:11:48.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.487+0000 7f4603fff640 1 --2- 172.21.15.18:0/1607598883 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f45f0078d40 0x7f45f007b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.487+0000 7f4603fff640 1 --2- 172.21.15.18:0/1607598883 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f45f0078d40 0x7f45f007b250 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f45f4005fd0 tx=0x7f45f400b260 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:48.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.491+0000 7f4600ff9640 1 -- 172.21.15.18:0/1607598883 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f45fc016030 con 0x7f460415d9b0 2024-09-21T07:11:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.674+0000 7f460a40e640 1 -- 172.21.15.18:0/1607598883 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f460406b490 con 0x7f45f0078d40 2024-09-21T07:11:48.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.675+0000 7f4600ff9640 1 -- 172.21.15.18:0/1607598883 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13464 (secure 0 0 0) 0x7f45f400b760 con 0x7f45f0078d40 2024-09-21T07:11:48.677 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:48.677 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-21T07:11:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.677+0000 7f460a40e640 1 -- 172.21.15.18:0/1607598883 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f45f0078d40 msgr2=0x7f45f007b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.677+0000 7f460a40e640 1 --2- 172.21.15.18:0/1607598883 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f45f0078d40 0x7f45f007b250 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f45f4005fd0 tx=0x7f45f400b260 comp rx=0 tx=0).stop 2024-09-21T07:11:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.677+0000 7f460a40e640 1 -- 172.21.15.18:0/1607598883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f460415d9b0 msgr2=0x7f4604070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.677+0000 7f460a40e640 1 --2- 172.21.15.18:0/1607598883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f460415d9b0 0x7f4604070470 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00e960 tx=0x7f45fc00ee20 comp rx=0 tx=0).stop 2024-09-21T07:11:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.677+0000 7f460a40e640 1 -- 172.21.15.18:0/1607598883 shutdown_connections 2024-09-21T07:11:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.677+0000 7f460a40e640 1 --2- 172.21.15.18:0/1607598883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f460415d9b0 0x7f4604070470 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.677+0000 7f460a40e640 1 --2- 172.21.15.18:0/1607598883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f460415d060 0x7f460415b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.677+0000 7f460a40e640 1 --2- 172.21.15.18:0/1607598883 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f45f0078d40 0x7f45f007b250 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.677+0000 7f460a40e640 1 --2- 172.21.15.18:0/1607598883 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f46040b4760 0x7f46041f5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.677+0000 7f460a40e640 1 -- 172.21.15.18:0/1607598883 >> 172.21.15.18:0/1607598883 conn(0x7f46040b78b0 msgr2=0x7f460415e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:48.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.677+0000 7f460a40e640 1 -- 172.21.15.18:0/1607598883 shutdown_connections 2024-09-21T07:11:48.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.677+0000 7f460a40e640 1 -- 172.21.15.18:0/1607598883 wait complete. 2024-09-21T07:11:48.690 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-21T07:11:48.329626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":270444,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754704276,"statfs":{"total":773094113280,"available":772817178624,"internally_reserved":0,"allocated":4366336,"data_stored":2412416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-131792,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-94,"num_write_kb":-164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.533891"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":135,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T07:11:43.804157+0000","last_change":"2024-09-21T07:10:32.034091+0000","last_active":"2024-09-21T07:11:43.804157+0000","last_peered":"2024-09-21T07:11:43.804157+0000","last_clean":"2024-09-21T07:11:43.804157+0000","last_became_active":"2024-09-21T07:10:32.033005+0000","last_became_peered":"2024-09-21T07:10:32.033005+0000","last_unstale":"2024-09-21T07:11:43.804157+0000","last_undegraded":"2024-09-21T07:11:43.804157+0000","last_fullsized":"2024-09-21T07:11:43.804157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_clean_scrub_stamp":"2024-09-21T07:10:31.011167+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:10.064019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":991232,"data_stored":744328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35744,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336096,"statfs":{"total":96636764160,"available":96600162304,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35740,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336100,"statfs":{"total":96636764160,"available":96600166400,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35744,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336096,"statfs":{"total":96636764160,"available":96600162304,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":991232,"data_stored":744328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:11:48.691 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:11:48.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:11:48.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.808+0000 7f0513694640 1 -- 172.21.15.18:0/516542332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04f8004d40 msgr2=0x7f04f8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.808+0000 7f0513694640 1 --2- 172.21.15.18:0/516542332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04f8004d40 0x7f04f8005150 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f050c0b7300 tx=0x7f04f8005830 comp rx=0 tx=0).stop 2024-09-21T07:11:48.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.808+0000 7f0511c31640 1 -- 172.21.15.18:0/516542332 reap_dead start 2024-09-21T07:11:48.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.808+0000 7f0513694640 1 -- 172.21.15.18:0/516542332 shutdown_connections 2024-09-21T07:11:48.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.809+0000 7f0513694640 1 -- 172.21.15.18:0/516542332 >> 172.21.15.18:0/516542332 conn(0x7f050c073f30 msgr2=0x7f050c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:48.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.809+0000 7f0513694640 1 -- 172.21.15.18:0/516542332 shutdown_connections 2024-09-21T07:11:48.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.809+0000 7f0513694640 1 -- 172.21.15.18:0/516542332 wait complete. 2024-09-21T07:11:48.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.810+0000 7f0513694640 1 Processor -- start 2024-09-21T07:11:48.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.810+0000 7f0513694640 1 -- start start 2024-09-21T07:11:48.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0513694640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04f8004d40 0x7f050c1608a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0513694640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f050c151310 0x7f050c1f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0513694640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f050c0cdfd0 0x7f050c0ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0513694640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f050c162fd0 con 0x7f04f8004d40 2024-09-21T07:11:48.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0513694640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f050c162e50 con 0x7f050c151310 2024-09-21T07:11:48.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0513694640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f050c163150 con 0x7f050c0cdfd0 2024-09-21T07:11:48.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0511430640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04f8004d40 0x7f050c1608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0511430640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04f8004d40 0x7f050c1608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38542/0 (socket says 172.21.15.18:38542) 2024-09-21T07:11:48.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0511430640 1 -- 172.21.15.18:0/3526555988 learned_addr learned my addr 172.21.15.18:0/3526555988 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:48.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0510c2f640 1 --2- 172.21.15.18:0/3526555988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f050c151310 0x7f050c1f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0511c31640 1 --2- 172.21.15.18:0/3526555988 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f050c0cdfd0 0x7f050c0ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0511430640 1 -- 172.21.15.18:0/3526555988 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f050c0cdfd0 msgr2=0x7f050c0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0511430640 1 --2- 172.21.15.18:0/3526555988 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f050c0cdfd0 0x7f050c0ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0511430640 1 -- 172.21.15.18:0/3526555988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f050c151310 msgr2=0x7f050c1f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:48.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0511430640 1 --2- 172.21.15.18:0/3526555988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f050c151310 0x7f050c1f4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:48.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0511430640 1 -- 172.21.15.18:0/3526555988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050c0ce920 con 0x7f04f8004d40 2024-09-21T07:11:48.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0510c2f640 1 --2- 172.21.15.18:0/3526555988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f050c151310 0x7f050c1f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:48.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0511430640 1 --2- 172.21.15.18:0/3526555988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04f8004d40 0x7f050c1608a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0508011d60 tx=0x7f050800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:48.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.812+0000 7f0501ffb640 1 -- 172.21.15.18:0/3526555988 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508003d80 con 0x7f04f8004d40 2024-09-21T07:11:48.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.813+0000 7f0501ffb640 1 -- 172.21.15.18:0/3526555988 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0508004b20 con 0x7f04f8004d40 2024-09-21T07:11:48.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.813+0000 7f0513694640 1 -- 172.21.15.18:0/3526555988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050c0cbaa0 con 0x7f04f8004d40 2024-09-21T07:11:48.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.813+0000 7f0501ffb640 1 -- 172.21.15.18:0/3526555988 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508004050 con 0x7f04f8004d40 2024-09-21T07:11:48.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.813+0000 7f0513694640 1 -- 172.21.15.18:0/3526555988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f050c0cc1d0 con 0x7f04f8004d40 2024-09-21T07:11:48.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.814+0000 7f0513694640 1 -- 172.21.15.18:0/3526555988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f050c15c520 con 0x7f04f8004d40 2024-09-21T07:11:48.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.815+0000 7f0501ffb640 1 -- 172.21.15.18:0/3526555988 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f05080041f0 con 0x7f04f8004d40 2024-09-21T07:11:48.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.815+0000 7f0501ffb640 1 --2- 172.21.15.18:0/3526555988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f04f0078d40 0x7f04f007b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:48.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.815+0000 7f0501ffb640 1 -- 172.21.15.18:0/3526555988 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f050809bf20 con 0x7f04f8004d40 2024-09-21T07:11:48.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.815+0000 7f0510c2f640 1 --2- 172.21.15.18:0/3526555988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f04f0078d40 0x7f04f007b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:48.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.816+0000 7f0510c2f640 1 --2- 172.21.15.18:0/3526555988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f04f0078d40 0x7f04f007b250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f04fc001e10 tx=0x7f04fc001030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:48.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:48.820+0000 7f0501ffb640 1 -- 172.21.15.18:0/3526555988 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f050c0ce920 con 0x7f04f8004d40 2024-09-21T07:11:49.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.004+0000 7f0513694640 1 -- 172.21.15.18:0/3526555988 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f050c0cb850 con 0x7f04f0078d40 2024-09-21T07:11:49.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.005+0000 7f0501ffb640 1 -- 172.21.15.18:0/3526555988 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13464 (secure 0 0 0) 0x7f050c0cb850 con 0x7f04f0078d40 2024-09-21T07:11:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:49.007 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-21T07:11:49.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.007+0000 7f0513694640 1 -- 172.21.15.18:0/3526555988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f04f0078d40 msgr2=0x7f04f007b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:49.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.007+0000 7f0513694640 1 --2- 172.21.15.18:0/3526555988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f04f0078d40 0x7f04f007b250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f04fc001e10 tx=0x7f04fc001030 comp rx=0 tx=0).stop 2024-09-21T07:11:49.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.007+0000 7f0513694640 1 -- 172.21.15.18:0/3526555988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04f8004d40 msgr2=0x7f050c1608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:49.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.007+0000 7f0513694640 1 --2- 172.21.15.18:0/3526555988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04f8004d40 0x7f050c1608a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0508011d60 tx=0x7f050800f790 comp rx=0 tx=0).stop 2024-09-21T07:11:49.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.007+0000 7f0513694640 1 -- 172.21.15.18:0/3526555988 shutdown_connections 2024-09-21T07:11:49.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.007+0000 7f0513694640 1 --2- 172.21.15.18:0/3526555988 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f04f0078d40 0x7f04f007b250 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.007+0000 7f0513694640 1 --2- 172.21.15.18:0/3526555988 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f050c0cdfd0 0x7f050c0ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.007+0000 7f0513694640 1 --2- 172.21.15.18:0/3526555988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f050c151310 0x7f050c1f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.007+0000 7f0513694640 1 --2- 172.21.15.18:0/3526555988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04f8004d40 0x7f050c1608a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.007+0000 7f0513694640 1 -- 172.21.15.18:0/3526555988 >> 172.21.15.18:0/3526555988 conn(0x7f050c073f30 msgr2=0x7f050c15cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:49.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.007+0000 7f0513694640 1 -- 172.21.15.18:0/3526555988 shutdown_connections 2024-09-21T07:11:49.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.007+0000 7f0513694640 1 -- 172.21.15.18:0/3526555988 wait complete. 2024-09-21T07:11:49.019 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-21T07:11:48.329626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":270444,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754704276,"statfs":{"total":773094113280,"available":772817178624,"internally_reserved":0,"allocated":4366336,"data_stored":2412416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-131792,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-94,"num_write_kb":-164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.533891"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":135,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T07:11:43.804157+0000","last_change":"2024-09-21T07:10:32.034091+0000","last_active":"2024-09-21T07:11:43.804157+0000","last_peered":"2024-09-21T07:11:43.804157+0000","last_clean":"2024-09-21T07:11:43.804157+0000","last_became_active":"2024-09-21T07:10:32.033005+0000","last_became_peered":"2024-09-21T07:10:32.033005+0000","last_unstale":"2024-09-21T07:11:43.804157+0000","last_undegraded":"2024-09-21T07:11:43.804157+0000","last_fullsized":"2024-09-21T07:11:43.804157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_clean_scrub_stamp":"2024-09-21T07:10:31.011167+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:10.064019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":991232,"data_stored":744328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35744,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336096,"statfs":{"total":96636764160,"available":96600162304,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35740,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336100,"statfs":{"total":96636764160,"available":96600166400,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35744,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336096,"statfs":{"total":96636764160,"available":96600162304,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":991232,"data_stored":744328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:11:49.020 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:11:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.134+0000 7f52f658a640 1 -- 172.21.15.18:0/3539633979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f015ef50 msgr2=0x7f52f015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.134+0000 7f52f658a640 1 --2- 172.21.15.18:0/3539633979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f015ef50 0x7f52f015c520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f52f00d1fb0 tx=0x7f52e002a530 comp rx=0 tx=0).stop 2024-09-21T07:11:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.134+0000 7f52f658a640 1 -- 172.21.15.18:0/3539633979 shutdown_connections 2024-09-21T07:11:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.134+0000 7f52f658a640 1 --2- 172.21.15.18:0/3539633979 >> v2:172.21.15.49:3300/0 conn(0x7f52f00cef70 0x7f52f00d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.134+0000 7f52f658a640 1 --2- 172.21.15.18:0/3539633979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f015ef50 0x7f52f015c520 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.134+0000 7f52f658a640 1 -- 172.21.15.18:0/3539633979 >> 172.21.15.18:0/3539633979 conn(0x7f52f0073f30 msgr2=0x7f52f00b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.134+0000 7f52f658a640 1 -- 172.21.15.18:0/3539633979 shutdown_connections 2024-09-21T07:11:49.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.134+0000 7f52f658a640 1 -- 172.21.15.18:0/3539633979 wait complete. 2024-09-21T07:11:49.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.136+0000 7f52f658a640 1 Processor -- start 2024-09-21T07:11:49.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.136+0000 7f52f658a640 1 -- start start 2024-09-21T07:11:49.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.137+0000 7f52f658a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f00cef70 0x7f52f01f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:49.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.137+0000 7f52f658a640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f52f00d3580 0x7f52f01f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:49.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.137+0000 7f52f658a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52f015ef50 0x7f52f00b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:49.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.137+0000 7f52f658a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f52f00d1020 con 0x7f52f00cef70 2024-09-21T07:11:49.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.137+0000 7f52f658a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f52f0163360 con 0x7f52f015ef50 2024-09-21T07:11:49.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.137+0000 7f52f658a640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f52f00d11a0 con 0x7f52f00d3580 2024-09-21T07:11:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.137+0000 7f52effff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f00cef70 0x7f52f01f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.137+0000 7f52effff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f00cef70 0x7f52f01f95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38560/0 (socket says 172.21.15.18:38560) 2024-09-21T07:11:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.137+0000 7f52effff640 1 -- 172.21.15.18:0/2383577792 learned_addr learned my addr 172.21.15.18:0/2383577792 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.137+0000 7f52f4b27640 1 --2- 172.21.15.18:0/2383577792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52f015ef50 0x7f52f00b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.137+0000 7f52ef7fe640 1 --2- 172.21.15.18:0/2383577792 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f52f00d3580 0x7f52f01f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.138+0000 7f52effff640 1 -- 172.21.15.18:0/2383577792 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f52f00d3580 msgr2=0x7f52f01f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.138+0000 7f52effff640 1 --2- 172.21.15.18:0/2383577792 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f52f00d3580 0x7f52f01f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.138+0000 7f52effff640 1 -- 172.21.15.18:0/2383577792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52f015ef50 msgr2=0x7f52f00b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:49.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.138+0000 7f52effff640 1 --2- 172.21.15.18:0/2383577792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52f015ef50 0x7f52f00b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.138+0000 7f52effff640 1 -- 172.21.15.18:0/2383577792 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f01f6270 con 0x7f52f00cef70 2024-09-21T07:11:49.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.138+0000 7f52ef7fe640 1 --2- 172.21.15.18:0/2383577792 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f52f00d3580 0x7f52f01f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:49.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.138+0000 7f52effff640 1 --2- 172.21.15.18:0/2383577792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f00cef70 0x7f52f01f95a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f52e0009780 tx=0x7f52e0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:49.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.138+0000 7f52ecff9640 1 -- 172.21.15.18:0/2383577792 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e0031d60 con 0x7f52f00cef70 2024-09-21T07:11:49.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.138+0000 7f52ecff9640 1 -- 172.21.15.18:0/2383577792 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52e0033e10 con 0x7f52f00cef70 2024-09-21T07:11:49.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.138+0000 7f52ecff9640 1 -- 172.21.15.18:0/2383577792 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e0005260 con 0x7f52f00cef70 2024-09-21T07:11:49.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.138+0000 7f52f658a640 1 -- 172.21.15.18:0/2383577792 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f01f6550 con 0x7f52f00cef70 2024-09-21T07:11:49.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.138+0000 7f52f658a640 1 -- 172.21.15.18:0/2383577792 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f00cd6f0 con 0x7f52f00cef70 2024-09-21T07:11:49.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.139+0000 7f52f658a640 1 -- 172.21.15.18:0/2383577792 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f015bf90 con 0x7f52f00cef70 2024-09-21T07:11:49.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.140+0000 7f52ecff9640 1 -- 172.21.15.18:0/2383577792 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f52e0005400 con 0x7f52f00cef70 2024-09-21T07:11:49.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.141+0000 7f52ecff9640 1 --2- 172.21.15.18:0/2383577792 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f52dc078d40 0x7f52dc07b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:49.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.141+0000 7f52ecff9640 1 -- 172.21.15.18:0/2383577792 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f52e00bbf30 con 0x7f52f00cef70 2024-09-21T07:11:49.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.141+0000 7f52ef7fe640 1 --2- 172.21.15.18:0/2383577792 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f52dc078d40 0x7f52dc07b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:49.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.142+0000 7f52ef7fe640 1 --2- 172.21.15.18:0/2383577792 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f52dc078d40 0x7f52dc07b250 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f52e4005fd0 tx=0x7f52e4005ee0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:49.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.146+0000 7f52ecff9640 1 -- 172.21.15.18:0/2383577792 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f52e003f030 con 0x7f52f00cef70 2024-09-21T07:11:49.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.333+0000 7f52f658a640 1 -- 172.21.15.18:0/2383577792 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52f015bcb0 con 0x7f52f00cef70 2024-09-21T07:11:49.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.334+0000 7f52ecff9640 1 -- 172.21.15.18:0/2383577792 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13008 (secure 0 0 0) 0x7f52e0099e20 con 0x7f52f00cef70 2024-09-21T07:11:49.336 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:49.336 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":35,"fsid":"ed917ec8-3fd9-4777-97f4-b5e2f57d6f41","created":"2024-09-21T07:10:17.744851+0000","modified":"2024-09-21T07:11:43.797501+0000","last_up_change":"2024-09-21T07:10:31.011167+0000","last_in_change":"2024-09-21T07:10:21.443447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:10:30.329949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"740113d7-37ab-4a8b-a4bb-ed2e72765a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6809","nonce":3354774634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6811","nonce":3354774634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6815","nonce":3354774634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3354774634},{"type":"v1","addr":"172.21.15.18:6813","nonce":3354774634}]},"public_addr":"172.21.15.18:6809/3354774634","cluster_addr":"172.21.15.18:6811/3354774634","heartbeat_back_addr":"172.21.15.18:6815/3354774634","heartbeat_front_addr":"172.21.15.18:6813/3354774634","state":["exists","up"]},{"osd":1,"uuid":"2ef92c25-ee40-4bdc-9903-7c5fab9bc76c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6801","nonce":1388965833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6803","nonce":1388965833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6807","nonce":1388965833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1388965833},{"type":"v1","addr":"172.21.15.18:6805","nonce":1388965833}]},"public_addr":"172.21.15.18:6801/1388965833","cluster_addr":"172.21.15.18:6803/1388965833","heartbeat_back_addr":"172.21.15.18:6807/1388965833","heartbeat_front_addr":"172.21.15.18:6805/1388965833","state":["exists","up"]},{"osd":2,"uuid":"01334c6d-8f7c-46bd-9d29-2077a1919c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6817","nonce":2742438714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6819","nonce":2742438714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6823","nonce":2742438714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":2742438714},{"type":"v1","addr":"172.21.15.18:6821","nonce":2742438714}]},"public_addr":"172.21.15.18:6817/2742438714","cluster_addr":"172.21.15.18:6819/2742438714","heartbeat_back_addr":"172.21.15.18:6823/2742438714","heartbeat_front_addr":"172.21.15.18:6821/2742438714","state":["exists","up"]},{"osd":3,"uuid":"4a9fd998-c17c-470b-bfd7-5fa5afdbef54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6825","nonce":2776683579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6827","nonce":2776683579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6831","nonce":2776683579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2776683579},{"type":"v1","addr":"172.21.15.18:6829","nonce":2776683579}]},"public_addr":"172.21.15.18:6825/2776683579","cluster_addr":"172.21.15.18:6827/2776683579","heartbeat_back_addr":"172.21.15.18:6831/2776683579","heartbeat_front_addr":"172.21.15.18:6829/2776683579","state":["exists","up"]},{"osd":4,"uuid":"97f7cc69-c331-487c-b458-95a6bf18d474","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6819","nonce":1945709510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6821","nonce":1945709510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6825","nonce":1945709510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1945709510},{"type":"v1","addr":"172.21.15.49:6823","nonce":1945709510}]},"public_addr":"172.21.15.49:6819/1945709510","cluster_addr":"172.21.15.49:6821/1945709510","heartbeat_back_addr":"172.21.15.49:6825/1945709510","heartbeat_front_addr":"172.21.15.49:6823/1945709510","state":["exists","up"]},{"osd":5,"uuid":"225d9626-3dbe-4db5-8f17-92f7b7b7b315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3861333879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3861333879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3861333879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3861333879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3861333879}]},"public_addr":"172.21.15.49:6811/3861333879","cluster_addr":"172.21.15.49:6813/3861333879","heartbeat_back_addr":"172.21.15.49:6817/3861333879","heartbeat_front_addr":"172.21.15.49:6815/3861333879","state":["exists","up"]},{"osd":6,"uuid":"d8cb64cb-22da-4a12-a567-0d7cc022b638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6803","nonce":3256581088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6805","nonce":3256581088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6809","nonce":3256581088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3256581088},{"type":"v1","addr":"172.21.15.49:6807","nonce":3256581088}]},"public_addr":"172.21.15.49:6803/3256581088","cluster_addr":"172.21.15.49:6805/3256581088","heartbeat_back_addr":"172.21.15.49:6809/3256581088","heartbeat_front_addr":"172.21.15.49:6807/3256581088","state":["exists","up"]},{"osd":7,"uuid":"daad8f96-b2d9-4d12-ac59-07e9d7fa876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6827","nonce":3277556905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6829","nonce":3277556905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6833","nonce":3277556905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3277556905},{"type":"v1","addr":"172.21.15.49:6831","nonce":3277556905}]},"public_addr":"172.21.15.49:6827/3277556905","cluster_addr":"172.21.15.49:6829/3277556905","heartbeat_back_addr":"172.21.15.49:6833/3277556905","heartbeat_front_addr":"172.21.15.49:6831/3277556905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.197088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:26.968337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.482605+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.247107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.260019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:27.727497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.025382+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:10:28.222234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6837/3575557854":"2024-09-22T07:11:40.792826+0000","172.21.15.49:6835/3575557854":"2024-09-22T07:11:40.792826+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:11:49.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.336+0000 7f52f658a640 1 -- 172.21.15.18:0/2383577792 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f52dc078d40 msgr2=0x7f52dc07b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:49.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.336+0000 7f52f658a640 1 --2- 172.21.15.18:0/2383577792 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f52dc078d40 0x7f52dc07b250 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f52e4005fd0 tx=0x7f52e4005ee0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.336+0000 7f52f658a640 1 -- 172.21.15.18:0/2383577792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f00cef70 msgr2=0x7f52f01f95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:49.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.336+0000 7f52f658a640 1 --2- 172.21.15.18:0/2383577792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f00cef70 0x7f52f01f95a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f52e0009780 tx=0x7f52e0033c20 comp rx=0 tx=0).stop 2024-09-21T07:11:49.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.336+0000 7f52f658a640 1 -- 172.21.15.18:0/2383577792 shutdown_connections 2024-09-21T07:11:49.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.336+0000 7f52f658a640 1 --2- 172.21.15.18:0/2383577792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52f015ef50 0x7f52f00b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.336+0000 7f52f658a640 1 --2- 172.21.15.18:0/2383577792 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f52dc078d40 0x7f52dc07b250 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.336+0000 7f52f658a640 1 --2- 172.21.15.18:0/2383577792 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f52f00d3580 0x7f52f01f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.336+0000 7f52f658a640 1 --2- 172.21.15.18:0/2383577792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f00cef70 0x7f52f01f95a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:49.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.336+0000 7f52f658a640 1 -- 172.21.15.18:0/2383577792 >> 172.21.15.18:0/2383577792 conn(0x7f52f0073f30 msgr2=0x7f52f015cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:49.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.336+0000 7f52f658a640 1 -- 172.21.15.18:0/2383577792 shutdown_connections 2024-09-21T07:11:49.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:49.336+0000 7f52f658a640 1 -- 172.21.15.18:0/2383577792 wait complete. 2024-09-21T07:11:50.350 INFO:tasks.ceph:Scrubbing osd.0 2024-09-21T07:11:50.350 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:11:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.486+0000 7f99ae271640 1 -- 172.21.15.18:0/3147934461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a815ef50 msgr2=0x7f99a815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.486+0000 7f99ae271640 1 --2- 172.21.15.18:0/3147934461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a815ef50 0x7f99a815c520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f99a80d1fb0 tx=0x7f999802a530 comp rx=0 tx=0).stop 2024-09-21T07:11:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.486+0000 7f99ae271640 1 -- 172.21.15.18:0/3147934461 shutdown_connections 2024-09-21T07:11:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.486+0000 7f99ae271640 1 --2- 172.21.15.18:0/3147934461 >> v2:172.21.15.49:3300/0 conn(0x7f99a80cef70 0x7f99a80d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.486+0000 7f99ae271640 1 --2- 172.21.15.18:0/3147934461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a815ef50 0x7f99a815c520 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.486+0000 7f99ae271640 1 -- 172.21.15.18:0/3147934461 >> 172.21.15.18:0/3147934461 conn(0x7f99a8073f30 msgr2=0x7f99a80b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.486+0000 7f99ae271640 1 -- 172.21.15.18:0/3147934461 shutdown_connections 2024-09-21T07:11:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.486+0000 7f99ae271640 1 -- 172.21.15.18:0/3147934461 wait complete. 2024-09-21T07:11:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.487+0000 7f99ae271640 1 Processor -- start 2024-09-21T07:11:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.488+0000 7f99ae271640 1 -- start start 2024-09-21T07:11:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.489+0000 7f99ae271640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99a80cef70 0x7f99a80ab650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.489+0000 7f99ae271640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f99a80d3580 0x7f99a80b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.489+0000 7f99ae271640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a815ef50 0x7f99a80cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.489+0000 7f99ae271640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f99a80d1020 con 0x7f99a815ef50 2024-09-21T07:11:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.489+0000 7f99ae271640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f99a8163360 con 0x7f99a80cef70 2024-09-21T07:11:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.489+0000 7f99ae271640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f99a80d11a0 con 0x7f99a80d3580 2024-09-21T07:11:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.489+0000 7f99ac80e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a815ef50 0x7f99a80cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.489+0000 7f99a7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99a80cef70 0x7f99a80ab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.489+0000 7f99ac80e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a815ef50 0x7f99a80cce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38580/0 (socket says 172.21.15.18:38580) 2024-09-21T07:11:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.489+0000 7f99ac80e640 1 -- 172.21.15.18:0/2928128323 learned_addr learned my addr 172.21.15.18:0/2928128323 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.489+0000 7f99a77fe640 1 --2- 172.21.15.18:0/2928128323 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f99a80d3580 0x7f99a80b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.489+0000 7f99ac80e640 1 -- 172.21.15.18:0/2928128323 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f99a80d3580 msgr2=0x7f99a80b8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.489+0000 7f99ac80e640 1 --2- 172.21.15.18:0/2928128323 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f99a80d3580 0x7f99a80b8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.490+0000 7f99ac80e640 1 -- 172.21.15.18:0/2928128323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99a80cef70 msgr2=0x7f99a80ab650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.490+0000 7f99ac80e640 1 --2- 172.21.15.18:0/2928128323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99a80cef70 0x7f99a80ab650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.490+0000 7f99ac80e640 1 -- 172.21.15.18:0/2928128323 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a80cb960 con 0x7f99a815ef50 2024-09-21T07:11:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.490+0000 7f99ac80e640 1 --2- 172.21.15.18:0/2928128323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a815ef50 0x7f99a80cce40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f99a000c730 tx=0x7f99a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.490+0000 7f99a4ff9640 1 -- 172.21.15.18:0/2928128323 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a0017070 con 0x7f99a815ef50 2024-09-21T07:11:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.490+0000 7f99a4ff9640 1 -- 172.21.15.18:0/2928128323 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99a0003c60 con 0x7f99a815ef50 2024-09-21T07:11:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.490+0000 7f99a4ff9640 1 -- 172.21.15.18:0/2928128323 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a00052d0 con 0x7f99a815ef50 2024-09-21T07:11:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.490+0000 7f99ae271640 1 -- 172.21.15.18:0/2928128323 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a80cbc40 con 0x7f99a815ef50 2024-09-21T07:11:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.490+0000 7f99ae271640 1 -- 172.21.15.18:0/2928128323 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a80cc200 con 0x7f99a815ef50 2024-09-21T07:11:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.491+0000 7f99ae271640 1 -- 172.21.15.18:0/2928128323 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f99a806b490 con 0x7f99a815ef50 2024-09-21T07:11:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.492+0000 7f99a4ff9640 1 -- 172.21.15.18:0/2928128323 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f99a001a070 con 0x7f99a815ef50 2024-09-21T07:11:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.492+0000 7f99a4ff9640 1 --2- 172.21.15.18:0/2928128323 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9994078d70 0x7f999407b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.492+0000 7f99a4ff9640 1 -- 172.21.15.18:0/2928128323 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f99a009ac00 con 0x7f99a815ef50 2024-09-21T07:11:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.493+0000 7f99a4ff9640 1 --2- 172.21.15.18:0/2928128323 >> [v2:172.21.15.18:6808/3354774634,v1:172.21.15.18:6809/3354774634] conn(0x7f999407ec80 0x7f99940810d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.493+0000 7f99a4ff9640 1 -- 172.21.15.18:0/2928128323 --> [v2:172.21.15.18:6808/3354774634,v1:172.21.15.18:6809/3354774634] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99940817a0 con 0x7f999407ec80 2024-09-21T07:11:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.493+0000 7f99a4ff9640 1 -- 172.21.15.18:0/2928128323 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f99a009b070 con 0x7f99a815ef50 2024-09-21T07:11:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.493+0000 7f99a7fff640 1 --2- 172.21.15.18:0/2928128323 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9994078d70 0x7f999407b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.493+0000 7f99a77fe640 1 --2- 172.21.15.18:0/2928128323 >> [v2:172.21.15.18:6808/3354774634,v1:172.21.15.18:6809/3354774634] conn(0x7f999407ec80 0x7f99940810d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.493+0000 7f99a77fe640 1 --2- 172.21.15.18:0/2928128323 >> [v2:172.21.15.18:6808/3354774634,v1:172.21.15.18:6809/3354774634] conn(0x7f999407ec80 0x7f99940810d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.493+0000 7f99a7fff640 1 --2- 172.21.15.18:0/2928128323 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9994078d70 0x7f999407b280 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9998034000 tx=0x7f9998004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:50.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.494+0000 7f99a4ff9640 1 -- 172.21.15.18:0/2928128323 <== osd.0 v2:172.21.15.18:6808/3354774634 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f99940817a0 con 0x7f999407ec80 2024-09-21T07:11:50.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.507+0000 7f99ae271640 1 -- 172.21.15.18:0/2928128323 --> [v2:172.21.15.18:6808/3354774634,v1:172.21.15.18:6809/3354774634] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f99a80d3040 con 0x7f999407ec80 2024-09-21T07:11:50.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.507+0000 7f99a4ff9640 1 -- 172.21.15.18:0/2928128323 <== osd.0 v2:172.21.15.18:6808/3354774634 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f99a80d3040 con 0x7f999407ec80 2024-09-21T07:11:50.509 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T07:11:50.509 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:11:50.509 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T07:11:50.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.507+0000 7f99ae271640 1 -- 172.21.15.18:0/2928128323 >> [v2:172.21.15.18:6808/3354774634,v1:172.21.15.18:6809/3354774634] conn(0x7f999407ec80 msgr2=0x7f99940810d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.507+0000 7f99ae271640 1 --2- 172.21.15.18:0/2928128323 >> [v2:172.21.15.18:6808/3354774634,v1:172.21.15.18:6809/3354774634] conn(0x7f999407ec80 0x7f99940810d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.507+0000 7f99ae271640 1 -- 172.21.15.18:0/2928128323 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9994078d70 msgr2=0x7f999407b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.507+0000 7f99ae271640 1 --2- 172.21.15.18:0/2928128323 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f9994078d70 0x7f999407b280 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9998034000 tx=0x7f9998004730 comp rx=0 tx=0).stop 2024-09-21T07:11:50.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.507+0000 7f99ae271640 1 -- 172.21.15.18:0/2928128323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a815ef50 msgr2=0x7f99a80cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.507+0000 7f99ae271640 1 --2- 172.21.15.18:0/2928128323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a815ef50 0x7f99a80cce40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f99a000c730 tx=0x7f99a000cbf0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.507+0000 7f99ac80e640 1 -- 172.21.15.18:0/2928128323 reap_dead start 2024-09-21T07:11:50.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.507+0000 7f99ae271640 1 -- 172.21.15.18:0/2928128323 shutdown_connections 2024-09-21T07:11:50.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.507+0000 7f99ae271640 1 -- 172.21.15.18:0/2928128323 >> 172.21.15.18:0/2928128323 conn(0x7f99a8073f30 msgr2=0x7f99a815ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:50.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.507+0000 7f99ae271640 1 -- 172.21.15.18:0/2928128323 shutdown_connections 2024-09-21T07:11:50.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.507+0000 7f99ae271640 1 -- 172.21.15.18:0/2928128323 wait complete. 2024-09-21T07:11:50.520 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-21T07:11:50.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.636+0000 7f08d04b4640 1 -- 172.21.15.18:0/1529633512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c815c520 msgr2=0x7f08c80d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.636+0000 7f08d04b4640 1 --2- 172.21.15.18:0/1529633512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c815c520 0x7f08c80d3040 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f08c80d2570 tx=0x7f08b802a530 comp rx=0 tx=0).stop 2024-09-21T07:11:50.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.636+0000 7f08d04b4640 1 -- 172.21.15.18:0/1529633512 shutdown_connections 2024-09-21T07:11:50.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.636+0000 7f08d04b4640 1 --2- 172.21.15.18:0/1529633512 >> v2:172.21.15.49:3300/0 conn(0x7f08c80d3580 0x7f08c8162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.636+0000 7f08d04b4640 1 --2- 172.21.15.18:0/1529633512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c815c520 0x7f08c80d3040 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.636+0000 7f08d04b4640 1 -- 172.21.15.18:0/1529633512 >> 172.21.15.18:0/1529633512 conn(0x7f08c8073f30 msgr2=0x7f08c80b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:50.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.636+0000 7f08d04b4640 1 -- 172.21.15.18:0/1529633512 shutdown_connections 2024-09-21T07:11:50.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.636+0000 7f08d04b4640 1 -- 172.21.15.18:0/1529633512 wait complete. 2024-09-21T07:11:50.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.638+0000 7f08d04b4640 1 Processor -- start 2024-09-21T07:11:50.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.638+0000 7f08d04b4640 1 -- start start 2024-09-21T07:11:50.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.639+0000 7f08d04b4640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f08c80d3580 0x7f08c81f8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:50.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.639+0000 7f08d04b4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c815c520 0x7f08c81f9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:50.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.639+0000 7f08d04b4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c815ef50 0x7f08c80cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:50.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.639+0000 7f08d04b4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f08c80d1020 con 0x7f08c815c520 2024-09-21T07:11:50.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.639+0000 7f08d04b4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f08c8163380 con 0x7f08c815ef50 2024-09-21T07:11:50.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.639+0000 7f08d04b4640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f08c80d11a0 con 0x7f08c80d3580 2024-09-21T07:11:50.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.639+0000 7f08cda4f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c815c520 0x7f08c81f9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:50.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.639+0000 7f08cda4f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c815c520 0x7f08c81f9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38596/0 (socket says 172.21.15.18:38596) 2024-09-21T07:11:50.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.639+0000 7f08cda4f640 1 -- 172.21.15.18:0/525512395 learned_addr learned my addr 172.21.15.18:0/525512395 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:50.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.639+0000 7f08ce250640 1 --2- 172.21.15.18:0/525512395 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f08c80d3580 0x7f08c81f8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:50.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.640+0000 7f08cea51640 1 --2- 172.21.15.18:0/525512395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c815ef50 0x7f08c80cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:50.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.640+0000 7f08cda4f640 1 -- 172.21.15.18:0/525512395 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f08c80d3580 msgr2=0x7f08c81f8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.640+0000 7f08cda4f640 1 --2- 172.21.15.18:0/525512395 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f08c80d3580 0x7f08c81f8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.640+0000 7f08cda4f640 1 -- 172.21.15.18:0/525512395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c815ef50 msgr2=0x7f08c80cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.640+0000 7f08cda4f640 1 --2- 172.21.15.18:0/525512395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c815ef50 0x7f08c80cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.640+0000 7f08cda4f640 1 -- 172.21.15.18:0/525512395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c81f9ac0 con 0x7f08c815c520 2024-09-21T07:11:50.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.640+0000 7f08cda4f640 1 --2- 172.21.15.18:0/525512395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c815c520 0x7f08c81f9280 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f08b802ab20 tx=0x7f08b8005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:50.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.640+0000 7f08beffd640 1 -- 172.21.15.18:0/525512395 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b803f070 con 0x7f08c815c520 2024-09-21T07:11:50.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.640+0000 7f08beffd640 1 -- 172.21.15.18:0/525512395 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08b8004340 con 0x7f08c815c520 2024-09-21T07:11:50.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.640+0000 7f08d04b4640 1 -- 172.21.15.18:0/525512395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c80cca60 con 0x7f08c815c520 2024-09-21T07:11:50.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.640+0000 7f08beffd640 1 -- 172.21.15.18:0/525512395 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8031bb0 con 0x7f08c815c520 2024-09-21T07:11:50.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.640+0000 7f08d04b4640 1 -- 172.21.15.18:0/525512395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c80cd020 con 0x7f08c815c520 2024-09-21T07:11:50.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.641+0000 7f08d04b4640 1 -- 172.21.15.18:0/525512395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c8162a40 con 0x7f08c815c520 2024-09-21T07:11:50.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.642+0000 7f08beffd640 1 -- 172.21.15.18:0/525512395 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f08b8042070 con 0x7f08c815c520 2024-09-21T07:11:50.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.643+0000 7f08beffd640 1 --2- 172.21.15.18:0/525512395 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f08ac078d40 0x7f08ac07b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:50.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.643+0000 7f08beffd640 1 -- 172.21.15.18:0/525512395 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f08b80bbf90 con 0x7f08c815c520 2024-09-21T07:11:50.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.643+0000 7f08ce250640 1 --2- 172.21.15.18:0/525512395 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f08ac078d40 0x7f08ac07b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:50.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.643+0000 7f08ce250640 1 --2- 172.21.15.18:0/525512395 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f08ac078d40 0x7f08ac07b250 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f08c40017a0 tx=0x7f08c4001730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:50.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.647+0000 7f08beffd640 1 -- 172.21.15.18:0/525512395 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f08b8031770 con 0x7f08c815c520 2024-09-21T07:11:50.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.837+0000 7f08d04b4640 1 -- 172.21.15.18:0/525512395 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f08c806b490 con 0x7f08ac078d40 2024-09-21T07:11:50.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.837+0000 7f08beffd640 1 -- 172.21.15.18:0/525512395 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f08c400fda0 con 0x7f08ac078d40 2024-09-21T07:11:50.839 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T07:11:50.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.840+0000 7f08d04b4640 1 -- 172.21.15.18:0/525512395 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f08ac078d40 msgr2=0x7f08ac07b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.840+0000 7f08d04b4640 1 --2- 172.21.15.18:0/525512395 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f08ac078d40 0x7f08ac07b250 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f08c40017a0 tx=0x7f08c4001730 comp rx=0 tx=0).stop 2024-09-21T07:11:50.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.840+0000 7f08d04b4640 1 -- 172.21.15.18:0/525512395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c815c520 msgr2=0x7f08c81f9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.840+0000 7f08d04b4640 1 --2- 172.21.15.18:0/525512395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c815c520 0x7f08c81f9280 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f08b802ab20 tx=0x7f08b8005270 comp rx=0 tx=0).stop 2024-09-21T07:11:50.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.840+0000 7f08d04b4640 1 -- 172.21.15.18:0/525512395 shutdown_connections 2024-09-21T07:11:50.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.840+0000 7f08d04b4640 1 --2- 172.21.15.18:0/525512395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c815ef50 0x7f08c80cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.840+0000 7f08d04b4640 1 --2- 172.21.15.18:0/525512395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c815c520 0x7f08c81f9280 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.840+0000 7f08d04b4640 1 --2- 172.21.15.18:0/525512395 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f08ac078d40 0x7f08ac07b250 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.840+0000 7f08d04b4640 1 --2- 172.21.15.18:0/525512395 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f08c80d3580 0x7f08c81f8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.840+0000 7f08d04b4640 1 -- 172.21.15.18:0/525512395 >> 172.21.15.18:0/525512395 conn(0x7f08c8073f30 msgr2=0x7f08c80b7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:50.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.840+0000 7f08d04b4640 1 -- 172.21.15.18:0/525512395 shutdown_connections 2024-09-21T07:11:50.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.840+0000 7f08d04b4640 1 -- 172.21.15.18:0/525512395 wait complete. 2024-09-21T07:11:50.852 INFO:tasks.ceph:Scrubbing osd.1 2024-09-21T07:11:50.853 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:11:50.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.972+0000 7f21198a2640 1 -- 172.21.15.18:0/3388670912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2100003a00 msgr2=0x7f2100003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.972+0000 7f21198a2640 1 --2- 172.21.15.18:0/3388670912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2100003a00 0x7f2100003e70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2104009b50 tx=0x7f2100005830 comp rx=0 tx=0).stop 2024-09-21T07:11:50.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.972+0000 7f21137fe640 1 -- 172.21.15.18:0/3388670912 reap_dead start 2024-09-21T07:11:50.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.972+0000 7f21198a2640 1 -- 172.21.15.18:0/3388670912 shutdown_connections 2024-09-21T07:11:50.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.972+0000 7f21198a2640 1 -- 172.21.15.18:0/3388670912 >> 172.21.15.18:0/3388670912 conn(0x7f21140b78b0 msgr2=0x7f21140b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:50.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.972+0000 7f21198a2640 1 -- 172.21.15.18:0/3388670912 shutdown_connections 2024-09-21T07:11:50.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.972+0000 7f21198a2640 1 -- 172.21.15.18:0/3388670912 wait complete. 2024-09-21T07:11:50.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.974+0000 7f21198a2640 1 Processor -- start 2024-09-21T07:11:50.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.974+0000 7f21198a2640 1 -- start start 2024-09-21T07:11:50.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21198a2640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2100003a00 0x7f21141e8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:50.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21198a2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2114143440 0x7f211415f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:50.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21198a2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f211415fc60 0x7f21141f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:50.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21198a2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f21140b5d20 con 0x7f211415fc60 2024-09-21T07:11:50.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21198a2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2114153db0 con 0x7f2114143440 2024-09-21T07:11:50.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21198a2640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f21140b5ea0 con 0x7f2100003a00 2024-09-21T07:11:50.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21137fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f211415fc60 0x7f21141f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:50.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21137fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f211415fc60 0x7f21141f6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38602/0 (socket says 172.21.15.18:38602) 2024-09-21T07:11:50.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21137fe640 1 -- 172.21.15.18:0/2592943102 learned_addr learned my addr 172.21.15.18:0/2592943102 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:50.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f2112ffd640 1 --2- 172.21.15.18:0/2592943102 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2100003a00 0x7f21141e8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:50.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f210a7fc640 1 --2- 172.21.15.18:0/2592943102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2114143440 0x7f211415f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:50.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21137fe640 1 -- 172.21.15.18:0/2592943102 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2100003a00 msgr2=0x7f21141e8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21137fe640 1 --2- 172.21.15.18:0/2592943102 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f2100003a00 0x7f21141e8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21137fe640 1 -- 172.21.15.18:0/2592943102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2114143440 msgr2=0x7f211415f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21137fe640 1 --2- 172.21.15.18:0/2592943102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2114143440 0x7f211415f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21137fe640 1 -- 172.21.15.18:0/2592943102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2114160070 con 0x7f211415fc60 2024-09-21T07:11:50.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21137fe640 1 --2- 172.21.15.18:0/2592943102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f211415fc60 0x7f21141f6740 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f21140a0650 tx=0x7f210c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:50.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f2110ff9640 1 -- 172.21.15.18:0/2592943102 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c004b20 con 0x7f211415fc60 2024-09-21T07:11:50.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f2110ff9640 1 -- 172.21.15.18:0/2592943102 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f210c004cc0 con 0x7f211415fc60 2024-09-21T07:11:50.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f2110ff9640 1 -- 172.21.15.18:0/2592943102 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c003bd0 con 0x7f211415fc60 2024-09-21T07:11:50.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.976+0000 7f21198a2640 1 -- 172.21.15.18:0/2592943102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2114140ac0 con 0x7f211415fc60 2024-09-21T07:11:50.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.977+0000 7f21198a2640 1 -- 172.21.15.18:0/2592943102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2114141080 con 0x7f211415fc60 2024-09-21T07:11:50.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.977+0000 7f21198a2640 1 -- 172.21.15.18:0/2592943102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f211406b490 con 0x7f211415fc60 2024-09-21T07:11:50.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.978+0000 7f2110ff9640 1 -- 172.21.15.18:0/2592943102 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f210c004030 con 0x7f211415fc60 2024-09-21T07:11:50.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.979+0000 7f2110ff9640 1 --2- 172.21.15.18:0/2592943102 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f20f4078d70 0x7f20f407b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:50.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.979+0000 7f2110ff9640 1 -- 172.21.15.18:0/2592943102 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f210c09b4b0 con 0x7f211415fc60 2024-09-21T07:11:50.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.979+0000 7f2110ff9640 1 --2- 172.21.15.18:0/2592943102 >> [v2:172.21.15.18:6800/1388965833,v1:172.21.15.18:6801/1388965833] conn(0x7f20f407ec80 0x7f20f40810d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:50.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.979+0000 7f2110ff9640 1 -- 172.21.15.18:0/2592943102 --> [v2:172.21.15.18:6800/1388965833,v1:172.21.15.18:6801/1388965833] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20f40817a0 con 0x7f20f407ec80 2024-09-21T07:11:50.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.979+0000 7f2112ffd640 1 --2- 172.21.15.18:0/2592943102 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f20f4078d70 0x7f20f407b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:50.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.979+0000 7f2110ff9640 1 -- 172.21.15.18:0/2592943102 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f210c09b860 con 0x7f211415fc60 2024-09-21T07:11:50.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.979+0000 7f210a7fc640 1 --2- 172.21.15.18:0/2592943102 >> [v2:172.21.15.18:6800/1388965833,v1:172.21.15.18:6801/1388965833] conn(0x7f20f407ec80 0x7f20f40810d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:50.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.979+0000 7f210a7fc640 1 --2- 172.21.15.18:0/2592943102 >> [v2:172.21.15.18:6800/1388965833,v1:172.21.15.18:6801/1388965833] conn(0x7f20f407ec80 0x7f20f40810d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:50.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.980+0000 7f2112ffd640 1 --2- 172.21.15.18:0/2592943102 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f20f4078d70 0x7f20f407b280 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2104009b50 tx=0x7f210402d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:50.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.980+0000 7f2110ff9640 1 -- 172.21.15.18:0/2592943102 <== osd.1 v2:172.21.15.18:6800/1388965833 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f20f40817a0 con 0x7f20f407ec80 2024-09-21T07:11:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.993+0000 7f21198a2640 1 -- 172.21.15.18:0/2592943102 --> [v2:172.21.15.18:6800/1388965833,v1:172.21.15.18:6801/1388965833] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f21141e9240 con 0x7f20f407ec80 2024-09-21T07:11:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.993+0000 7f2110ff9640 1 -- 172.21.15.18:0/2592943102 <== osd.1 v2:172.21.15.18:6800/1388965833 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f21141e9240 con 0x7f20f407ec80 2024-09-21T07:11:50.995 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T07:11:50.995 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:11:50.995 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T07:11:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.993+0000 7f21198a2640 1 -- 172.21.15.18:0/2592943102 >> [v2:172.21.15.18:6800/1388965833,v1:172.21.15.18:6801/1388965833] conn(0x7f20f407ec80 msgr2=0x7f20f40810d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.993+0000 7f21198a2640 1 --2- 172.21.15.18:0/2592943102 >> [v2:172.21.15.18:6800/1388965833,v1:172.21.15.18:6801/1388965833] conn(0x7f20f407ec80 0x7f20f40810d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.993+0000 7f21198a2640 1 -- 172.21.15.18:0/2592943102 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f20f4078d70 msgr2=0x7f20f407b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.993+0000 7f21198a2640 1 --2- 172.21.15.18:0/2592943102 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f20f4078d70 0x7f20f407b280 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2104009b50 tx=0x7f210402d040 comp rx=0 tx=0).stop 2024-09-21T07:11:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.993+0000 7f21198a2640 1 -- 172.21.15.18:0/2592943102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f211415fc60 msgr2=0x7f21141f6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.993+0000 7f21198a2640 1 --2- 172.21.15.18:0/2592943102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f211415fc60 0x7f21141f6740 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f21140a0650 tx=0x7f210c00f3c0 comp rx=0 tx=0).stop 2024-09-21T07:11:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.993+0000 7f21137fe640 1 -- 172.21.15.18:0/2592943102 reap_dead start 2024-09-21T07:11:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.993+0000 7f21198a2640 1 -- 172.21.15.18:0/2592943102 shutdown_connections 2024-09-21T07:11:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.993+0000 7f21198a2640 1 -- 172.21.15.18:0/2592943102 >> 172.21.15.18:0/2592943102 conn(0x7f21140b78b0 msgr2=0x7f21141509a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.994+0000 7f21198a2640 1 -- 172.21.15.18:0/2592943102 shutdown_connections 2024-09-21T07:11:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:50.994+0000 7f21198a2640 1 -- 172.21.15.18:0/2592943102 wait complete. 2024-09-21T07:11:51.006 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-21T07:11:51.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.122+0000 7f89839e4640 1 -- 172.21.15.18:0/1923106221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8964004800 msgr2=0x7f8964004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.122+0000 7f89839e4640 1 --2- 172.21.15.18:0/1923106221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8964004800 0x7f8964004c10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8970009b90 tx=0x7f8964005830 comp rx=0 tx=0).stop 2024-09-21T07:11:51.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.122+0000 7f8981f81640 1 -- 172.21.15.18:0/1923106221 reap_dead start 2024-09-21T07:11:51.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.122+0000 7f89839e4640 1 -- 172.21.15.18:0/1923106221 shutdown_connections 2024-09-21T07:11:51.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.122+0000 7f89839e4640 1 -- 172.21.15.18:0/1923106221 >> 172.21.15.18:0/1923106221 conn(0x7f897c073e20 msgr2=0x7f897c06cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:51.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.122+0000 7f89839e4640 1 -- 172.21.15.18:0/1923106221 shutdown_connections 2024-09-21T07:11:51.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.122+0000 7f89839e4640 1 -- 172.21.15.18:0/1923106221 wait complete. 2024-09-21T07:11:51.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.124+0000 7f89839e4640 1 Processor -- start 2024-09-21T07:11:51.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.124+0000 7f89839e4640 1 -- start start 2024-09-21T07:11:51.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.125+0000 7f89839e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8964004800 0x7f897c0cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.125+0000 7f89839e4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f897c1f58e0 0x7f897c1f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.125+0000 7f89839e4640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f897c1f8d10 0x7f897c1f9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.125+0000 7f89839e4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f897c15c730 con 0x7f8964004800 2024-09-21T07:11:51.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.125+0000 7f89839e4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f897c15c5b0 con 0x7f897c1f58e0 2024-09-21T07:11:51.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.125+0000 7f89839e4640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f897c15c8b0 con 0x7f897c1f8d10 2024-09-21T07:11:51.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.125+0000 7f8981780640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8964004800 0x7f897c0cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.125+0000 7f8981780640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8964004800 0x7f897c0cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38628/0 (socket says 172.21.15.18:38628) 2024-09-21T07:11:51.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.125+0000 7f8981780640 1 -- 172.21.15.18:0/2529573729 learned_addr learned my addr 172.21.15.18:0/2529573729 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:51.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.126+0000 7f8980f7f640 1 --2- 172.21.15.18:0/2529573729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f897c1f58e0 0x7f897c1f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.126+0000 7f8981f81640 1 --2- 172.21.15.18:0/2529573729 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f897c1f8d10 0x7f897c1f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.126+0000 7f8981780640 1 -- 172.21.15.18:0/2529573729 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f897c1f8d10 msgr2=0x7f897c1f9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.126+0000 7f8981780640 1 --2- 172.21.15.18:0/2529573729 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f897c1f8d10 0x7f897c1f9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.126+0000 7f8981780640 1 -- 172.21.15.18:0/2529573729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f897c1f58e0 msgr2=0x7f897c1f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.126+0000 7f8981780640 1 --2- 172.21.15.18:0/2529573729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f897c1f58e0 0x7f897c1f5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.126+0000 7f8981780640 1 -- 172.21.15.18:0/2529573729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c1f9660 con 0x7f8964004800 2024-09-21T07:11:51.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.126+0000 7f8981780640 1 --2- 172.21.15.18:0/2529573729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8964004800 0x7f897c0cda20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f896c006600 tx=0x7f896c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:51.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.126+0000 7f8979ffb640 1 -- 172.21.15.18:0/2529573729 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c015070 con 0x7f8964004800 2024-09-21T07:11:51.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.126+0000 7f8979ffb640 1 -- 172.21.15.18:0/2529573729 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f896c00f960 con 0x7f8964004800 2024-09-21T07:11:51.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.126+0000 7f89839e4640 1 -- 172.21.15.18:0/2529573729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f897c1f6650 con 0x7f8964004800 2024-09-21T07:11:51.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.126+0000 7f8979ffb640 1 -- 172.21.15.18:0/2529573729 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c00fd90 con 0x7f8964004800 2024-09-21T07:11:51.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.126+0000 7f89839e4640 1 -- 172.21.15.18:0/2529573729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f897c149d30 con 0x7f8964004800 2024-09-21T07:11:51.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.127+0000 7f89839e4640 1 -- 172.21.15.18:0/2529573729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f897c06a3d0 con 0x7f8964004800 2024-09-21T07:11:51.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.128+0000 7f8979ffb640 1 -- 172.21.15.18:0/2529573729 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f896c011430 con 0x7f8964004800 2024-09-21T07:11:51.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.129+0000 7f8979ffb640 1 --2- 172.21.15.18:0/2529573729 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8968078d70 0x7f896807b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.129+0000 7f8979ffb640 1 -- 172.21.15.18:0/2529573729 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f896c09b8b0 con 0x7f8964004800 2024-09-21T07:11:51.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.129+0000 7f8980f7f640 1 --2- 172.21.15.18:0/2529573729 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8968078d70 0x7f896807b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.130+0000 7f8980f7f640 1 --2- 172.21.15.18:0/2529573729 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8968078d70 0x7f896807b280 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8970035000 tx=0x7f89700046c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:51.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.133+0000 7f8979ffb640 1 -- 172.21.15.18:0/2529573729 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f897c06a3d0 con 0x7f8964004800 2024-09-21T07:11:51.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.319+0000 7f89839e4640 1 -- 172.21.15.18:0/2529573729 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f897c06b490 con 0x7f8968078d70 2024-09-21T07:11:51.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.320+0000 7f8979ffb640 1 -- 172.21.15.18:0/2529573729 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f897002bb40 con 0x7f8968078d70 2024-09-21T07:11:51.321 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T07:11:51.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.322+0000 7f89839e4640 1 -- 172.21.15.18:0/2529573729 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8968078d70 msgr2=0x7f896807b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.322+0000 7f89839e4640 1 --2- 172.21.15.18:0/2529573729 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8968078d70 0x7f896807b280 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8970035000 tx=0x7f89700046c0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.322+0000 7f89839e4640 1 -- 172.21.15.18:0/2529573729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8964004800 msgr2=0x7f897c0cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.322+0000 7f89839e4640 1 --2- 172.21.15.18:0/2529573729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8964004800 0x7f897c0cda20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f896c006600 tx=0x7f896c0039c0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.322+0000 7f89839e4640 1 -- 172.21.15.18:0/2529573729 shutdown_connections 2024-09-21T07:11:51.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.322+0000 7f89839e4640 1 --2- 172.21.15.18:0/2529573729 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8968078d70 0x7f896807b280 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.322+0000 7f89839e4640 1 --2- 172.21.15.18:0/2529573729 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f897c1f8d10 0x7f897c1f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.322+0000 7f89839e4640 1 --2- 172.21.15.18:0/2529573729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f897c1f58e0 0x7f897c1f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.322+0000 7f89839e4640 1 --2- 172.21.15.18:0/2529573729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8964004800 0x7f897c0cda20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.322+0000 7f89839e4640 1 -- 172.21.15.18:0/2529573729 >> 172.21.15.18:0/2529573729 conn(0x7f897c073e20 msgr2=0x7f897c161760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:51.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.322+0000 7f89839e4640 1 -- 172.21.15.18:0/2529573729 shutdown_connections 2024-09-21T07:11:51.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.322+0000 7f89839e4640 1 -- 172.21.15.18:0/2529573729 wait complete. 2024-09-21T07:11:51.336 INFO:tasks.ceph:Scrubbing osd.2 2024-09-21T07:11:51.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:11:51.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.456+0000 7fee833e6640 1 -- 172.21.15.18:0/3196784980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee68003c10 msgr2=0x7fee68004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.456+0000 7fee833e6640 1 --2- 172.21.15.18:0/3196784980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee68003c10 0x7fee68004060 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fee78006f90 tx=0x7fee68005830 comp rx=0 tx=0).stop 2024-09-21T07:11:51.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.456+0000 7fee81983640 1 -- 172.21.15.18:0/3196784980 reap_dead start 2024-09-21T07:11:51.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.456+0000 7fee833e6640 1 -- 172.21.15.18:0/3196784980 shutdown_connections 2024-09-21T07:11:51.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.456+0000 7fee833e6640 1 -- 172.21.15.18:0/3196784980 >> 172.21.15.18:0/3196784980 conn(0x7fee7c073f30 msgr2=0x7fee7c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:51.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.456+0000 7fee833e6640 1 -- 172.21.15.18:0/3196784980 shutdown_connections 2024-09-21T07:11:51.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.456+0000 7fee833e6640 1 -- 172.21.15.18:0/3196784980 wait complete. 2024-09-21T07:11:51.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.458+0000 7fee833e6640 1 Processor -- start 2024-09-21T07:11:51.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.458+0000 7fee833e6640 1 -- start start 2024-09-21T07:11:51.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.459+0000 7fee833e6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee68003c10 0x7fee7c0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.459+0000 7fee833e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7c0ad490 0x7fee7c0b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.459+0000 7fee833e6640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee7c0b9400 0x7fee7c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.459+0000 7fee833e6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c162fd0 con 0x7fee7c0ad490 2024-09-21T07:11:51.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.459+0000 7fee833e6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c162e50 con 0x7fee68003c10 2024-09-21T07:11:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.459+0000 7fee833e6640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fee7c163150 con 0x7fee7c0b9400 2024-09-21T07:11:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.459+0000 7fee80981640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7c0ad490 0x7fee7c0b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.459+0000 7fee80981640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7c0ad490 0x7fee7c0b8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38646/0 (socket says 172.21.15.18:38646) 2024-09-21T07:11:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.459+0000 7fee80981640 1 -- 172.21.15.18:0/3198643199 learned_addr learned my addr 172.21.15.18:0/3198643199 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.459+0000 7fee81983640 1 --2- 172.21.15.18:0/3198643199 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee7c0b9400 0x7fee7c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.459+0000 7fee81182640 1 --2- 172.21.15.18:0/3198643199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee68003c10 0x7fee7c0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.460+0000 7fee80981640 1 -- 172.21.15.18:0/3198643199 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee7c0b9400 msgr2=0x7fee7c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.460+0000 7fee80981640 1 --2- 172.21.15.18:0/3198643199 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fee7c0b9400 0x7fee7c15b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.460+0000 7fee80981640 1 -- 172.21.15.18:0/3198643199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee68003c10 msgr2=0x7fee7c0ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.460+0000 7fee80981640 1 --2- 172.21.15.18:0/3198643199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee68003c10 0x7fee7c0ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.460+0000 7fee80981640 1 -- 172.21.15.18:0/3198643199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c0ced70 con 0x7fee7c0ad490 2024-09-21T07:11:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.460+0000 7fee80981640 1 --2- 172.21.15.18:0/3198643199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7c0ad490 0x7fee7c0b8ec0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fee6c003d60 tx=0x7fee6c0017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:51.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.460+0000 7fee71ffb640 1 -- 172.21.15.18:0/3198643199 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c011640 con 0x7fee7c0ad490 2024-09-21T07:11:51.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.460+0000 7fee71ffb640 1 -- 172.21.15.18:0/3198643199 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee6c016020 con 0x7fee7c0ad490 2024-09-21T07:11:51.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.460+0000 7fee833e6640 1 -- 172.21.15.18:0/3198643199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7c0ab120 con 0x7fee7c0ad490 2024-09-21T07:11:51.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.460+0000 7fee71ffb640 1 -- 172.21.15.18:0/3198643199 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c011aa0 con 0x7fee7c0ad490 2024-09-21T07:11:51.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.460+0000 7fee833e6640 1 -- 172.21.15.18:0/3198643199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7c0ab6e0 con 0x7fee7c0ad490 2024-09-21T07:11:51.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.461+0000 7fee833e6640 1 -- 172.21.15.18:0/3198643199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fee7c06b490 con 0x7fee7c0ad490 2024-09-21T07:11:51.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.462+0000 7fee71ffb640 1 -- 172.21.15.18:0/3198643199 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fee6c011c40 con 0x7fee7c0ad490 2024-09-21T07:11:51.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.462+0000 7fee71ffb640 1 --2- 172.21.15.18:0/3198643199 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee60078d40 0x7fee6007b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.463+0000 7fee71ffb640 1 -- 172.21.15.18:0/3198643199 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fee6c09c240 con 0x7fee7c0ad490 2024-09-21T07:11:51.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.463+0000 7fee71ffb640 1 --2- 172.21.15.18:0/3198643199 >> [v2:172.21.15.18:6816/2742438714,v1:172.21.15.18:6817/2742438714] conn(0x7fee6007ec50 0x7fee600810a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.463+0000 7fee71ffb640 1 -- 172.21.15.18:0/3198643199 --> [v2:172.21.15.18:6816/2742438714,v1:172.21.15.18:6817/2742438714] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee60081770 con 0x7fee6007ec50 2024-09-21T07:11:51.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.463+0000 7fee71ffb640 1 -- 172.21.15.18:0/3198643199 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fee6c09c5f0 con 0x7fee7c0ad490 2024-09-21T07:11:51.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.463+0000 7fee81182640 1 --2- 172.21.15.18:0/3198643199 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee60078d40 0x7fee6007b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.463+0000 7fee81983640 1 --2- 172.21.15.18:0/3198643199 >> [v2:172.21.15.18:6816/2742438714,v1:172.21.15.18:6817/2742438714] conn(0x7fee6007ec50 0x7fee600810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.463+0000 7fee81983640 1 --2- 172.21.15.18:0/3198643199 >> [v2:172.21.15.18:6816/2742438714,v1:172.21.15.18:6817/2742438714] conn(0x7fee6007ec50 0x7fee600810a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:51.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.463+0000 7fee81182640 1 --2- 172.21.15.18:0/3198643199 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee60078d40 0x7fee6007b250 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fee78033000 tx=0x7fee7c162540 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:51.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.464+0000 7fee71ffb640 1 -- 172.21.15.18:0/3198643199 <== osd.2 v2:172.21.15.18:6816/2742438714 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fee60081770 con 0x7fee6007ec50 2024-09-21T07:11:51.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.476+0000 7fee833e6640 1 -- 172.21.15.18:0/3198643199 --> [v2:172.21.15.18:6816/2742438714,v1:172.21.15.18:6817/2742438714] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fee7c0ceb20 con 0x7fee6007ec50 2024-09-21T07:11:51.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.477+0000 7fee71ffb640 1 -- 172.21.15.18:0/3198643199 <== osd.2 v2:172.21.15.18:6816/2742438714 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fee7c0ceb20 con 0x7fee6007ec50 2024-09-21T07:11:51.479 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T07:11:51.479 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:11:51.479 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T07:11:51.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.477+0000 7fee833e6640 1 -- 172.21.15.18:0/3198643199 >> [v2:172.21.15.18:6816/2742438714,v1:172.21.15.18:6817/2742438714] conn(0x7fee6007ec50 msgr2=0x7fee600810a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.477+0000 7fee833e6640 1 --2- 172.21.15.18:0/3198643199 >> [v2:172.21.15.18:6816/2742438714,v1:172.21.15.18:6817/2742438714] conn(0x7fee6007ec50 0x7fee600810a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.477+0000 7fee833e6640 1 -- 172.21.15.18:0/3198643199 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee60078d40 msgr2=0x7fee6007b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.477+0000 7fee833e6640 1 --2- 172.21.15.18:0/3198643199 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fee60078d40 0x7fee6007b250 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fee78033000 tx=0x7fee7c162540 comp rx=0 tx=0).stop 2024-09-21T07:11:51.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.477+0000 7fee833e6640 1 -- 172.21.15.18:0/3198643199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7c0ad490 msgr2=0x7fee7c0b8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.477+0000 7fee833e6640 1 --2- 172.21.15.18:0/3198643199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7c0ad490 0x7fee7c0b8ec0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fee6c003d60 tx=0x7fee6c0017f0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.477+0000 7fee81983640 1 -- 172.21.15.18:0/3198643199 reap_dead start 2024-09-21T07:11:51.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.477+0000 7fee833e6640 1 -- 172.21.15.18:0/3198643199 shutdown_connections 2024-09-21T07:11:51.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.477+0000 7fee833e6640 1 -- 172.21.15.18:0/3198643199 >> 172.21.15.18:0/3198643199 conn(0x7fee7c073f30 msgr2=0x7fee7c0b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:51.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.477+0000 7fee833e6640 1 -- 172.21.15.18:0/3198643199 shutdown_connections 2024-09-21T07:11:51.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.477+0000 7fee833e6640 1 -- 172.21.15.18:0/3198643199 wait complete. 2024-09-21T07:11:51.490 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-21T07:11:51.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.605+0000 7fa1931a8640 1 -- 172.21.15.18:0/1575536580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa18c06dd50 msgr2=0x7fa18c06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.605+0000 7fa1931a8640 1 --2- 172.21.15.18:0/1575536580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa18c06dd50 0x7fa18c06e160 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa17c009830 tx=0x7fa17c02a4a0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.606+0000 7fa1931a8640 1 -- 172.21.15.18:0/1575536580 shutdown_connections 2024-09-21T07:11:51.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.606+0000 7fa1931a8640 1 --2- 172.21.15.18:0/1575536580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa18c06dd50 0x7fa18c06e160 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.606+0000 7fa1931a8640 1 -- 172.21.15.18:0/1575536580 >> 172.21.15.18:0/1575536580 conn(0x7fa18c073340 msgr2=0x7fa18c073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:51.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.606+0000 7fa1931a8640 1 -- 172.21.15.18:0/1575536580 shutdown_connections 2024-09-21T07:11:51.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.606+0000 7fa1931a8640 1 -- 172.21.15.18:0/1575536580 wait complete. 2024-09-21T07:11:51.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.607+0000 7fa1931a8640 1 Processor -- start 2024-09-21T07:11:51.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.607+0000 7fa1931a8640 1 -- start start 2024-09-21T07:11:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa1931a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa18c06dd50 0x7fa18c154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa1931a8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa18c1525f0 0x7fa18c151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa1931a8640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa18c15bcb0 0x7fa18c1f73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa1931a8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c152b80 con 0x7fa18c06dd50 2024-09-21T07:11:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa1931a8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c152a00 con 0x7fa18c1525f0 2024-09-21T07:11:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa1931a8640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fa18c15c7d0 con 0x7fa18c15bcb0 2024-09-21T07:11:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa190f44640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa18c06dd50 0x7fa18c154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa190f44640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa18c06dd50 0x7fa18c154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38668/0 (socket says 172.21.15.18:38668) 2024-09-21T07:11:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa190f44640 1 -- 172.21.15.18:0/1775713240 learned_addr learned my addr 172.21.15.18:0/1775713240 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa183fff640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa18c1525f0 0x7fa18c151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa191745640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa18c15bcb0 0x7fa18c1f73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa190f44640 1 -- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa18c15bcb0 msgr2=0x7fa18c1f73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa190f44640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa18c15bcb0 0x7fa18c1f73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa190f44640 1 -- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa18c1525f0 msgr2=0x7fa18c151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa190f44640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa18c1525f0 0x7fa18c151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa190f44640 1 -- 172.21.15.18:0/1775713240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18c1f4700 con 0x7fa18c06dd50 2024-09-21T07:11:51.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa191745640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa18c15bcb0 0x7fa18c1f73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:51.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.609+0000 7fa183fff640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa18c1525f0 0x7fa18c151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:11:51.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.610+0000 7fa190f44640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa18c06dd50 0x7fa18c154460 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa18800c390 tx=0x7fa18800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:51.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.610+0000 7fa1817fa640 1 -- 172.21.15.18:0/1775713240 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188017070 con 0x7fa18c06dd50 2024-09-21T07:11:51.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.610+0000 7fa1817fa640 1 -- 172.21.15.18:0/1775713240 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1880053c0 con 0x7fa18c06dd50 2024-09-21T07:11:51.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.610+0000 7fa1817fa640 1 -- 172.21.15.18:0/1775713240 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188003880 con 0x7fa18c06dd50 2024-09-21T07:11:51.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.610+0000 7fa1931a8640 1 -- 172.21.15.18:0/1775713240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa18c1f3e60 con 0x7fa18c06dd50 2024-09-21T07:11:51.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.610+0000 7fa1931a8640 1 -- 172.21.15.18:0/1775713240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa18c1f4420 con 0x7fa18c06dd50 2024-09-21T07:11:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.611+0000 7fa1931a8640 1 -- 172.21.15.18:0/1775713240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa18c0766f0 con 0x7fa18c06dd50 2024-09-21T07:11:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.612+0000 7fa1817fa640 1 -- 172.21.15.18:0/1775713240 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fa18801a070 con 0x7fa18c06dd50 2024-09-21T07:11:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.612+0000 7fa1817fa640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa178078d40 0x7fa17807b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.613+0000 7fa1817fa640 1 -- 172.21.15.18:0/1775713240 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fa18809a190 con 0x7fa18c06dd50 2024-09-21T07:11:51.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.613+0000 7fa183fff640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa178078d40 0x7fa17807b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.613+0000 7fa183fff640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa178078d40 0x7fa17807b250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa17c034000 tx=0x7fa17c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:51.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.617+0000 7fa1817fa640 1 -- 172.21.15.18:0/1775713240 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa1880625d0 con 0x7fa18c06dd50 2024-09-21T07:11:51.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.804+0000 7fa1931a8640 1 -- 172.21.15.18:0/1775713240 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fa18c06a820 con 0x7fa178078d40 2024-09-21T07:11:51.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.804+0000 7fa1817fa640 1 -- 172.21.15.18:0/1775713240 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa18c06a820 con 0x7fa178078d40 2024-09-21T07:11:51.806 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T07:11:51.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.807+0000 7fa1931a8640 1 -- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa178078d40 msgr2=0x7fa17807b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.807+0000 7fa1931a8640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa178078d40 0x7fa17807b250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa17c034000 tx=0x7fa17c004730 comp rx=0 tx=0).stop 2024-09-21T07:11:51.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.807+0000 7fa1931a8640 1 -- 172.21.15.18:0/1775713240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa18c06dd50 msgr2=0x7fa18c154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.807+0000 7fa1931a8640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa18c06dd50 0x7fa18c154460 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa18800c390 tx=0x7fa18800c850 comp rx=0 tx=0).stop 2024-09-21T07:11:51.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.807+0000 7fa1931a8640 1 -- 172.21.15.18:0/1775713240 shutdown_connections 2024-09-21T07:11:51.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.807+0000 7fa1931a8640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fa178078d40 0x7fa17807b250 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.807+0000 7fa1931a8640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fa18c15bcb0 0x7fa18c1f73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.807+0000 7fa1931a8640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa18c1525f0 0x7fa18c151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.807+0000 7fa1931a8640 1 --2- 172.21.15.18:0/1775713240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa18c06dd50 0x7fa18c154460 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.807+0000 7fa1931a8640 1 -- 172.21.15.18:0/1775713240 >> 172.21.15.18:0/1775713240 conn(0x7fa18c073340 msgr2=0x7fa18c073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:51.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.807+0000 7fa1931a8640 1 -- 172.21.15.18:0/1775713240 shutdown_connections 2024-09-21T07:11:51.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.807+0000 7fa1931a8640 1 -- 172.21.15.18:0/1775713240 wait complete. 2024-09-21T07:11:51.820 INFO:tasks.ceph:Scrubbing osd.3 2024-09-21T07:11:51.820 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:11:51.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.939+0000 7f49cf8a2640 1 -- 172.21.15.18:0/1310586354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c8074a60 msgr2=0x7f49c80b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.939+0000 7f49cf8a2640 1 --2- 172.21.15.18:0/1310586354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c8074a60 0x7f49c80b3ba0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f49c80721f0 tx=0x7f49b802aac0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.939+0000 7f49cf8a2640 1 -- 172.21.15.18:0/1310586354 shutdown_connections 2024-09-21T07:11:51.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.939+0000 7f49cf8a2640 1 --2- 172.21.15.18:0/1310586354 >> v2:172.21.15.49:3300/0 conn(0x7f49c81624e0 0x7f49c81628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.939+0000 7f49cf8a2640 1 --2- 172.21.15.18:0/1310586354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c8074a60 0x7f49c80b3ba0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.939+0000 7f49cf8a2640 1 -- 172.21.15.18:0/1310586354 >> 172.21.15.18:0/1310586354 conn(0x7f49c80d0d70 msgr2=0x7f49c80d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:51.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.939+0000 7f49cf8a2640 1 -- 172.21.15.18:0/1310586354 shutdown_connections 2024-09-21T07:11:51.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.939+0000 7f49cf8a2640 1 -- 172.21.15.18:0/1310586354 wait complete. 2024-09-21T07:11:51.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.941+0000 7f49cf8a2640 1 Processor -- start 2024-09-21T07:11:51.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.941+0000 7f49cf8a2640 1 -- start start 2024-09-21T07:11:51.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.942+0000 7f49cf8a2640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f49c8074a60 0x7f49c8156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.942+0000 7f49cf8a2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c80ae8d0 0x7f49c815dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.942+0000 7f49cf8a2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c81624e0 0x7f49c806fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.942+0000 7f49cf8a2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f49c8073530 con 0x7f49c80ae8d0 2024-09-21T07:11:51.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.942+0000 7f49cf8a2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f49c80736b0 con 0x7f49c81624e0 2024-09-21T07:11:51.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.942+0000 7f49cf8a2640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f49c80af3f0 con 0x7f49c8074a60 2024-09-21T07:11:51.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49cce3d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c80ae8d0 0x7f49c815dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49cce3d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c80ae8d0 0x7f49c815dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38694/0 (socket says 172.21.15.18:38694) 2024-09-21T07:11:51.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49cce3d640 1 -- 172.21.15.18:0/889547520 learned_addr learned my addr 172.21.15.18:0/889547520 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:51.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49cd63e640 1 --2- 172.21.15.18:0/889547520 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f49c8074a60 0x7f49c8156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49cde3f640 1 --2- 172.21.15.18:0/889547520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c81624e0 0x7f49c806fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49cce3d640 1 -- 172.21.15.18:0/889547520 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f49c8074a60 msgr2=0x7f49c8156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49cce3d640 1 --2- 172.21.15.18:0/889547520 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f49c8074a60 0x7f49c8156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49cce3d640 1 -- 172.21.15.18:0/889547520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c81624e0 msgr2=0x7f49c806fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49cce3d640 1 --2- 172.21.15.18:0/889547520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c81624e0 0x7f49c806fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49cce3d640 1 -- 172.21.15.18:0/889547520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c81572a0 con 0x7f49c80ae8d0 2024-09-21T07:11:51.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49cde3f640 1 --2- 172.21.15.18:0/889547520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49c81624e0 0x7f49c806fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:51.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49cce3d640 1 --2- 172.21.15.18:0/889547520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c80ae8d0 0x7f49c815dab0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00e7c0 tx=0x7f49bc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:51.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49c5ffb640 1 -- 172.21.15.18:0/889547520 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc00ccc0 con 0x7f49c80ae8d0 2024-09-21T07:11:51.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49c5ffb640 1 -- 172.21.15.18:0/889547520 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49bc010430 con 0x7f49c80ae8d0 2024-09-21T07:11:51.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49cf8a2640 1 -- 172.21.15.18:0/889547520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c815dff0 con 0x7f49c80ae8d0 2024-09-21T07:11:51.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.943+0000 7f49c5ffb640 1 -- 172.21.15.18:0/889547520 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc010860 con 0x7f49c80ae8d0 2024-09-21T07:11:51.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.944+0000 7f49cf8a2640 1 -- 172.21.15.18:0/889547520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c81f8ea0 con 0x7f49c80ae8d0 2024-09-21T07:11:51.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.944+0000 7f49cf8a2640 1 -- 172.21.15.18:0/889547520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49c806b490 con 0x7f49c80ae8d0 2024-09-21T07:11:51.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.945+0000 7f49c5ffb640 1 -- 172.21.15.18:0/889547520 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f49bc010a00 con 0x7f49c80ae8d0 2024-09-21T07:11:51.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.946+0000 7f49c5ffb640 1 --2- 172.21.15.18:0/889547520 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f49b4078d40 0x7f49b407b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.946+0000 7f49c5ffb640 1 -- 172.21.15.18:0/889547520 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f49bc09c3a0 con 0x7f49c80ae8d0 2024-09-21T07:11:51.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.946+0000 7f49c5ffb640 1 --2- 172.21.15.18:0/889547520 >> [v2:172.21.15.18:6824/2776683579,v1:172.21.15.18:6825/2776683579] conn(0x7f49b407ec50 0x7f49b40810a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:51.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.946+0000 7f49c5ffb640 1 -- 172.21.15.18:0/889547520 --> [v2:172.21.15.18:6824/2776683579,v1:172.21.15.18:6825/2776683579] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49b4081770 con 0x7f49b407ec50 2024-09-21T07:11:51.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.946+0000 7f49c5ffb640 1 -- 172.21.15.18:0/889547520 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f49bc09c830 con 0x7f49c80ae8d0 2024-09-21T07:11:51.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.946+0000 7f49cd63e640 1 --2- 172.21.15.18:0/889547520 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f49b4078d40 0x7f49b407b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.946+0000 7f49cde3f640 1 --2- 172.21.15.18:0/889547520 >> [v2:172.21.15.18:6824/2776683579,v1:172.21.15.18:6825/2776683579] conn(0x7f49b407ec50 0x7f49b40810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:51.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.947+0000 7f49cde3f640 1 --2- 172.21.15.18:0/889547520 >> [v2:172.21.15.18:6824/2776683579,v1:172.21.15.18:6825/2776683579] conn(0x7f49b407ec50 0x7f49b40810a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:51.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.947+0000 7f49cd63e640 1 --2- 172.21.15.18:0/889547520 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f49b4078d40 0x7f49b407b250 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f49b8035000 tx=0x7f49b8038040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:51.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.947+0000 7f49c5ffb640 1 -- 172.21.15.18:0/889547520 <== osd.3 v2:172.21.15.18:6824/2776683579 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f49b4081770 con 0x7f49b407ec50 2024-09-21T07:11:51.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.960+0000 7f49cf8a2640 1 -- 172.21.15.18:0/889547520 --> [v2:172.21.15.18:6824/2776683579,v1:172.21.15.18:6825/2776683579] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f49c80b3ba0 con 0x7f49b407ec50 2024-09-21T07:11:51.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.960+0000 7f49c5ffb640 1 -- 172.21.15.18:0/889547520 <== osd.3 v2:172.21.15.18:6824/2776683579 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f49c80b3ba0 con 0x7f49b407ec50 2024-09-21T07:11:51.962 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T07:11:51.962 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:11:51.962 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T07:11:51.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.960+0000 7f49cf8a2640 1 -- 172.21.15.18:0/889547520 >> [v2:172.21.15.18:6824/2776683579,v1:172.21.15.18:6825/2776683579] conn(0x7f49b407ec50 msgr2=0x7f49b40810a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.960+0000 7f49cf8a2640 1 --2- 172.21.15.18:0/889547520 >> [v2:172.21.15.18:6824/2776683579,v1:172.21.15.18:6825/2776683579] conn(0x7f49b407ec50 0x7f49b40810a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:51.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.960+0000 7f49cf8a2640 1 -- 172.21.15.18:0/889547520 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f49b4078d40 msgr2=0x7f49b407b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.960+0000 7f49cf8a2640 1 --2- 172.21.15.18:0/889547520 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f49b4078d40 0x7f49b407b250 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f49b8035000 tx=0x7f49b8038040 comp rx=0 tx=0).stop 2024-09-21T07:11:51.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.960+0000 7f49cf8a2640 1 -- 172.21.15.18:0/889547520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c80ae8d0 msgr2=0x7f49c815dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:51.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.960+0000 7f49cf8a2640 1 --2- 172.21.15.18:0/889547520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c80ae8d0 0x7f49c815dab0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00e7c0 tx=0x7f49bc00ec80 comp rx=0 tx=0).stop 2024-09-21T07:11:51.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.960+0000 7f49cde3f640 1 -- 172.21.15.18:0/889547520 reap_dead start 2024-09-21T07:11:51.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.960+0000 7f49cf8a2640 1 -- 172.21.15.18:0/889547520 shutdown_connections 2024-09-21T07:11:51.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.960+0000 7f49cf8a2640 1 -- 172.21.15.18:0/889547520 >> 172.21.15.18:0/889547520 conn(0x7f49c80d0d70 msgr2=0x7f49c80d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:51.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.961+0000 7f49cf8a2640 1 -- 172.21.15.18:0/889547520 shutdown_connections 2024-09-21T07:11:51.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:51.961+0000 7f49cf8a2640 1 -- 172.21.15.18:0/889547520 wait complete. 2024-09-21T07:11:51.973 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-21T07:11:52.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.089+0000 7f4f85a7e640 1 -- 172.21.15.18:0/2717397642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f68005210 msgr2=0x7f4f6800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.089+0000 7f4f85a7e640 1 --2- 172.21.15.18:0/2717397642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f68005210 0x7f4f6800b9c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4f800d2570 tx=0x7f4f68005830 comp rx=0 tx=0).stop 2024-09-21T07:11:52.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.089+0000 7f4f7ffff640 1 -- 172.21.15.18:0/2717397642 reap_dead start 2024-09-21T07:11:52.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.089+0000 7f4f85a7e640 1 -- 172.21.15.18:0/2717397642 shutdown_connections 2024-09-21T07:11:52.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.089+0000 7f4f85a7e640 1 -- 172.21.15.18:0/2717397642 >> 172.21.15.18:0/2717397642 conn(0x7f4f80073f30 msgr2=0x7f4f800b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:52.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.089+0000 7f4f85a7e640 1 -- 172.21.15.18:0/2717397642 shutdown_connections 2024-09-21T07:11:52.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.089+0000 7f4f85a7e640 1 -- 172.21.15.18:0/2717397642 wait complete. 2024-09-21T07:11:52.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.091+0000 7f4f85a7e640 1 Processor -- start 2024-09-21T07:11:52.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.091+0000 7f4f85a7e640 1 -- start start 2024-09-21T07:11:52.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.092+0000 7f4f85a7e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f800cb030 0x7f4f80159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.092+0000 7f4f85a7e640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4f801f8740 0x7f4f801f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f85a7e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f801f9090 0x7f4f800cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f85a7e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4f801631e0 con 0x7f4f801f9090 2024-09-21T07:11:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f85a7e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4f80163060 con 0x7f4f800cb030 2024-09-21T07:11:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f85a7e640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f4f800d37d0 con 0x7f4f801f8740 2024-09-21T07:11:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f7ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f801f9090 0x7f4f800cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f7ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f801f9090 0x7f4f800cd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38718/0 (socket says 172.21.15.18:38718) 2024-09-21T07:11:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f7ffff640 1 -- 172.21.15.18:0/1906475578 learned_addr learned my addr 172.21.15.18:0/1906475578 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f7f7fe640 1 --2- 172.21.15.18:0/1906475578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f800cb030 0x7f4f80159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f7effd640 1 --2- 172.21.15.18:0/1906475578 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4f801f8740 0x7f4f801f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f7ffff640 1 -- 172.21.15.18:0/1906475578 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4f801f8740 msgr2=0x7f4f801f8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f7ffff640 1 --2- 172.21.15.18:0/1906475578 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4f801f8740 0x7f4f801f8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f7ffff640 1 -- 172.21.15.18:0/1906475578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f800cb030 msgr2=0x7f4f80159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f7ffff640 1 --2- 172.21.15.18:0/1906475578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f800cb030 0x7f4f80159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f7ffff640 1 -- 172.21.15.18:0/1906475578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f800c9270 con 0x7f4f801f9090 2024-09-21T07:11:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f7ffff640 1 --2- 172.21.15.18:0/1906475578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f801f9090 0x7f4f800cd4d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4f78035040 tx=0x7f4f78033c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:52.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f67fff640 1 -- 172.21.15.18:0/1906475578 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78009c30 con 0x7f4f801f9090 2024-09-21T07:11:52.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f67fff640 1 -- 172.21.15.18:0/1906475578 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f7802bb40 con 0x7f4f801f9090 2024-09-21T07:11:52.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f85a7e640 1 -- 172.21.15.18:0/1906475578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f800cc1d0 con 0x7f4f801f9090 2024-09-21T07:11:52.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f67fff640 1 -- 172.21.15.18:0/1906475578 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78004d80 con 0x7f4f801f9090 2024-09-21T07:11:52.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.093+0000 7f4f85a7e640 1 -- 172.21.15.18:0/1906475578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f800cc790 con 0x7f4f801f9090 2024-09-21T07:11:52.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.095+0000 7f4f85a7e640 1 -- 172.21.15.18:0/1906475578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f800008d0 con 0x7f4f801f9090 2024-09-21T07:11:52.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.096+0000 7f4f67fff640 1 -- 172.21.15.18:0/1906475578 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f4f78043020 con 0x7f4f801f9090 2024-09-21T07:11:52.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.096+0000 7f4f67fff640 1 --2- 172.21.15.18:0/1906475578 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4f6c078d70 0x7f4f6c07b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.096+0000 7f4f67fff640 1 -- 172.21.15.18:0/1906475578 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f4f780bb730 con 0x7f4f801f9090 2024-09-21T07:11:52.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.096+0000 7f4f7f7fe640 1 --2- 172.21.15.18:0/1906475578 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4f6c078d70 0x7f4f6c07b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.097+0000 7f4f7f7fe640 1 --2- 172.21.15.18:0/1906475578 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4f6c078d70 0x7f4f6c07b280 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4f700064a0 tx=0x7f4f70006b10 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:52.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.100+0000 7f4f67fff640 1 -- 172.21.15.18:0/1906475578 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4f7804a020 con 0x7f4f801f9090 2024-09-21T07:11:52.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.286+0000 7f4f85a7e640 1 -- 172.21.15.18:0/1906475578 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f4f800d2fa0 con 0x7f4f6c078d70 2024-09-21T07:11:52.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.286+0000 7f4f67fff640 1 -- 172.21.15.18:0/1906475578 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4f800d2fa0 con 0x7f4f6c078d70 2024-09-21T07:11:52.288 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 3 to deep-scrub 2024-09-21T07:11:52.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.288+0000 7f4f85a7e640 1 -- 172.21.15.18:0/1906475578 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4f6c078d70 msgr2=0x7f4f6c07b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.288+0000 7f4f85a7e640 1 --2- 172.21.15.18:0/1906475578 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4f6c078d70 0x7f4f6c07b280 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4f700064a0 tx=0x7f4f70006b10 comp rx=0 tx=0).stop 2024-09-21T07:11:52.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.288+0000 7f4f85a7e640 1 -- 172.21.15.18:0/1906475578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f801f9090 msgr2=0x7f4f800cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.288+0000 7f4f85a7e640 1 --2- 172.21.15.18:0/1906475578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f801f9090 0x7f4f800cd4d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4f78035040 tx=0x7f4f78033c30 comp rx=0 tx=0).stop 2024-09-21T07:11:52.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.288+0000 7f4f85a7e640 1 -- 172.21.15.18:0/1906475578 shutdown_connections 2024-09-21T07:11:52.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.288+0000 7f4f85a7e640 1 --2- 172.21.15.18:0/1906475578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f801f9090 0x7f4f800cd4d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.288+0000 7f4f85a7e640 1 --2- 172.21.15.18:0/1906475578 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f4f6c078d70 0x7f4f6c07b280 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.288+0000 7f4f85a7e640 1 --2- 172.21.15.18:0/1906475578 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f4f801f8740 0x7f4f801f8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.288+0000 7f4f85a7e640 1 --2- 172.21.15.18:0/1906475578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f800cb030 0x7f4f80159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.288+0000 7f4f85a7e640 1 -- 172.21.15.18:0/1906475578 >> 172.21.15.18:0/1906475578 conn(0x7f4f80073f30 msgr2=0x7f4f800cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:52.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.289+0000 7f4f85a7e640 1 -- 172.21.15.18:0/1906475578 shutdown_connections 2024-09-21T07:11:52.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.289+0000 7f4f85a7e640 1 -- 172.21.15.18:0/1906475578 wait complete. 2024-09-21T07:11:52.301 INFO:tasks.ceph:Scrubbing osd.4 2024-09-21T07:11:52.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:11:52.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.421+0000 7fcffb6f9640 1 -- 172.21.15.18:0/2110971111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff40b6200 msgr2=0x7fcff406dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.421+0000 7fcffb6f9640 1 --2- 172.21.15.18:0/2110971111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff40b6200 0x7fcff406dd50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcff4074bb0 tx=0x7fcfe802a410 comp rx=0 tx=0).stop 2024-09-21T07:11:52.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.421+0000 7fcffb6f9640 1 -- 172.21.15.18:0/2110971111 shutdown_connections 2024-09-21T07:11:52.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.421+0000 7fcffb6f9640 1 --2- 172.21.15.18:0/2110971111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff40b6200 0x7fcff406dd50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.421+0000 7fcffb6f9640 1 --2- 172.21.15.18:0/2110971111 >> v2:172.21.15.49:3300/0 conn(0x7fcff41525f0 0x7fcff40b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.421+0000 7fcffb6f9640 1 -- 172.21.15.18:0/2110971111 >> 172.21.15.18:0/2110971111 conn(0x7fcff4073340 msgr2=0x7fcff4073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:52.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.421+0000 7fcffb6f9640 1 -- 172.21.15.18:0/2110971111 shutdown_connections 2024-09-21T07:11:52.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.421+0000 7fcffb6f9640 1 -- 172.21.15.18:0/2110971111 wait complete. 2024-09-21T07:11:52.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.423+0000 7fcffb6f9640 1 Processor -- start 2024-09-21T07:11:52.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.423+0000 7fcffb6f9640 1 -- start start 2024-09-21T07:11:52.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.424+0000 7fcffb6f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcff406e290 0x7fcff41f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.424+0000 7fcffb6f9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff40b6200 0x7fcff41f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.424+0000 7fcffb6f9640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcff41525f0 0x7fcff415a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.424+0000 7fcffb6f9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcff415f9b0 con 0x7fcff40b6200 2024-09-21T07:11:52.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.424+0000 7fcffb6f9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcff40b54c0 con 0x7fcff406e290 2024-09-21T07:11:52.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.424+0000 7fcffb6f9640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fcff415fb30 con 0x7fcff41525f0 2024-09-21T07:11:52.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.425+0000 7fcff8c94640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff40b6200 0x7fcff41f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.425+0000 7fcff8c94640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff40b6200 0x7fcff41f45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38726/0 (socket says 172.21.15.18:38726) 2024-09-21T07:11:52.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.425+0000 7fcff8c94640 1 -- 172.21.15.18:0/391539958 learned_addr learned my addr 172.21.15.18:0/391539958 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:52.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.425+0000 7fcff9c96640 1 --2- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcff41525f0 0x7fcff415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.425+0000 7fcff9495640 1 --2- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcff406e290 0x7fcff41f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.425+0000 7fcff8c94640 1 -- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcff41525f0 msgr2=0x7fcff415a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.425+0000 7fcff8c94640 1 --2- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcff41525f0 0x7fcff415a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.425+0000 7fcff8c94640 1 -- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcff406e290 msgr2=0x7fcff41f3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.425+0000 7fcff8c94640 1 --2- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcff406e290 0x7fcff41f3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.425+0000 7fcff8c94640 1 -- 172.21.15.18:0/391539958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff4069490 con 0x7fcff40b6200 2024-09-21T07:11:52.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.425+0000 7fcff8c94640 1 --2- 172.21.15.18:0/391539958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff40b6200 0x7fcff41f45c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009920 tx=0x7fcfe8033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:52.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.425+0000 7fcff1ffb640 1 -- 172.21.15.18:0/391539958 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8031e20 con 0x7fcff40b6200 2024-09-21T07:11:52.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.425+0000 7fcff1ffb640 1 -- 172.21.15.18:0/391539958 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfe8005110 con 0x7fcff40b6200 2024-09-21T07:11:52.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.425+0000 7fcffb6f9640 1 -- 172.21.15.18:0/391539958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff4069770 con 0x7fcff40b6200 2024-09-21T07:11:52.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.425+0000 7fcff1ffb640 1 -- 172.21.15.18:0/391539958 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8005560 con 0x7fcff40b6200 2024-09-21T07:11:52.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.426+0000 7fcffb6f9640 1 -- 172.21.15.18:0/391539958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff41f4b90 con 0x7fcff40b6200 2024-09-21T07:11:52.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.426+0000 7fcffb6f9640 1 -- 172.21.15.18:0/391539958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcff4069c90 con 0x7fcff40b6200 2024-09-21T07:11:52.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.427+0000 7fcff1ffb640 1 -- 172.21.15.18:0/391539958 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fcfe80047a0 con 0x7fcff40b6200 2024-09-21T07:11:52.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.428+0000 7fcff1ffb640 1 --2- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfe0078d40 0x7fcfe007b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.428+0000 7fcff1ffb640 1 -- 172.21.15.18:0/391539958 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fcfe80bc460 con 0x7fcff40b6200 2024-09-21T07:11:52.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.428+0000 7fcff1ffb640 1 --2- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:6818/1945709510,v1:172.21.15.49:6819/1945709510] conn(0x7fcfe007ec50 0x7fcfe00810a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.428+0000 7fcff1ffb640 1 -- 172.21.15.18:0/391539958 --> [v2:172.21.15.49:6818/1945709510,v1:172.21.15.49:6819/1945709510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcfe8045e50 con 0x7fcfe007ec50 2024-09-21T07:11:52.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.428+0000 7fcff1ffb640 1 -- 172.21.15.18:0/391539958 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcfe80bc8f0 con 0x7fcff40b6200 2024-09-21T07:11:52.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.428+0000 7fcff9495640 1 --2- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfe0078d40 0x7fcfe007b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.428+0000 7fcff9c96640 1 --2- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:6818/1945709510,v1:172.21.15.49:6819/1945709510] conn(0x7fcfe007ec50 0x7fcfe00810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.429+0000 7fcff9495640 1 --2- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfe0078d40 0x7fcfe007b250 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400a400 tx=0x7fcfe400d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:52.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.429+0000 7fcff9c96640 1 --2- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:6818/1945709510,v1:172.21.15.49:6819/1945709510] conn(0x7fcfe007ec50 0x7fcfe00810a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:52.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.430+0000 7fcff1ffb640 1 -- 172.21.15.18:0/391539958 <== osd.4 v2:172.21.15.49:6818/1945709510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcfe8045e50 con 0x7fcfe007ec50 2024-09-21T07:11:52.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.443+0000 7fcffb6f9640 1 -- 172.21.15.18:0/391539958 --> [v2:172.21.15.49:6818/1945709510,v1:172.21.15.49:6819/1945709510] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcff4069240 con 0x7fcfe007ec50 2024-09-21T07:11:52.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.443+0000 7fcff1ffb640 1 -- 172.21.15.18:0/391539958 <== osd.4 v2:172.21.15.49:6818/1945709510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcff4069240 con 0x7fcfe007ec50 2024-09-21T07:11:52.445 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T07:11:52.445 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:11:52.445 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T07:11:52.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.444+0000 7fcffb6f9640 1 -- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:6818/1945709510,v1:172.21.15.49:6819/1945709510] conn(0x7fcfe007ec50 msgr2=0x7fcfe00810a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.444+0000 7fcffb6f9640 1 --2- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:6818/1945709510,v1:172.21.15.49:6819/1945709510] conn(0x7fcfe007ec50 0x7fcfe00810a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.444+0000 7fcffb6f9640 1 -- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfe0078d40 msgr2=0x7fcfe007b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.444+0000 7fcffb6f9640 1 --2- 172.21.15.18:0/391539958 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcfe0078d40 0x7fcfe007b250 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400a400 tx=0x7fcfe400d040 comp rx=0 tx=0).stop 2024-09-21T07:11:52.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.444+0000 7fcffb6f9640 1 -- 172.21.15.18:0/391539958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff40b6200 msgr2=0x7fcff41f45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.444+0000 7fcffb6f9640 1 --2- 172.21.15.18:0/391539958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff40b6200 0x7fcff41f45c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009920 tx=0x7fcfe8033d60 comp rx=0 tx=0).stop 2024-09-21T07:11:52.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.444+0000 7fcff9c96640 1 -- 172.21.15.18:0/391539958 reap_dead start 2024-09-21T07:11:52.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.444+0000 7fcffb6f9640 1 -- 172.21.15.18:0/391539958 shutdown_connections 2024-09-21T07:11:52.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.444+0000 7fcffb6f9640 1 -- 172.21.15.18:0/391539958 >> 172.21.15.18:0/391539958 conn(0x7fcff4073340 msgr2=0x7fcff415d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:52.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.444+0000 7fcffb6f9640 1 -- 172.21.15.18:0/391539958 shutdown_connections 2024-09-21T07:11:52.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.444+0000 7fcffb6f9640 1 -- 172.21.15.18:0/391539958 wait complete. 2024-09-21T07:11:52.456 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-21T07:11:52.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.573+0000 7fd4baa1f640 1 -- 172.21.15.18:0/755716361 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd4b41605e0 msgr2=0x7fd4b41609f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.573+0000 7fd4baa1f640 1 --2- 172.21.15.18:0/755716361 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd4b41605e0 0x7fd4b41609f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009830 tx=0x7fd4a802a510 comp rx=0 tx=0).stop 2024-09-21T07:11:52.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.573+0000 7fd4baa1f640 1 -- 172.21.15.18:0/755716361 shutdown_connections 2024-09-21T07:11:52.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.573+0000 7fd4baa1f640 1 --2- 172.21.15.18:0/755716361 >> v2:172.21.15.49:3300/0 conn(0x7fd4b4160f30 0x7fd4b40b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.573+0000 7fd4baa1f640 1 --2- 172.21.15.18:0/755716361 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd4b41605e0 0x7fd4b41609f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.573+0000 7fd4baa1f640 1 -- 172.21.15.18:0/755716361 >> 172.21.15.18:0/755716361 conn(0x7fd4b40b78b0 msgr2=0x7fd4b40b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:52.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.573+0000 7fd4baa1f640 1 -- 172.21.15.18:0/755716361 shutdown_connections 2024-09-21T07:11:52.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.573+0000 7fd4baa1f640 1 -- 172.21.15.18:0/755716361 wait complete. 2024-09-21T07:11:52.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.575+0000 7fd4baa1f640 1 Processor -- start 2024-09-21T07:11:52.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.575+0000 7fd4baa1f640 1 -- start start 2024-09-21T07:11:52.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.576+0000 7fd4baa1f640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd4b40b4760 0x7fd4b409d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.576+0000 7fd4baa1f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4b41605e0 0x7fd4b409dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.576+0000 7fd4baa1f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4160f30 0x7fd4b4149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.576+0000 7fd4baa1f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b40b6190 con 0x7fd4b4160f30 2024-09-21T07:11:52.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.576+0000 7fd4baa1f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b40b6010 con 0x7fd4b41605e0 2024-09-21T07:11:52.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.576+0000 7fd4baa1f640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b40b6310 con 0x7fd4b40b4760 2024-09-21T07:11:52.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.576+0000 7fd4b8fbc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4160f30 0x7fd4b4149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.576+0000 7fd4b8fbc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4160f30 0x7fd4b4149060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38734/0 (socket says 172.21.15.18:38734) 2024-09-21T07:11:52.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.576+0000 7fd4b8fbc640 1 -- 172.21.15.18:0/1472868244 learned_addr learned my addr 172.21.15.18:0/1472868244 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:52.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.576+0000 7fd4b37fe640 1 --2- 172.21.15.18:0/1472868244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4b41605e0 0x7fd4b409dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.576+0000 7fd4b3fff640 1 --2- 172.21.15.18:0/1472868244 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd4b40b4760 0x7fd4b409d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.577+0000 7fd4b8fbc640 1 -- 172.21.15.18:0/1472868244 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd4b40b4760 msgr2=0x7fd4b409d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.577+0000 7fd4b8fbc640 1 --2- 172.21.15.18:0/1472868244 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd4b40b4760 0x7fd4b409d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.577+0000 7fd4b8fbc640 1 -- 172.21.15.18:0/1472868244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4b41605e0 msgr2=0x7fd4b409dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.577+0000 7fd4b8fbc640 1 --2- 172.21.15.18:0/1472868244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4b41605e0 0x7fd4b409dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.577+0000 7fd4b8fbc640 1 -- 172.21.15.18:0/1472868244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b41495a0 con 0x7fd4b4160f30 2024-09-21T07:11:52.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.577+0000 7fd4b8fbc640 1 --2- 172.21.15.18:0/1472868244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4160f30 0x7fd4b4149060 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009fd0 tx=0x7fd4ac00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:52.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.577+0000 7fd4b0ff9640 1 -- 172.21.15.18:0/1472868244 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac003970 con 0x7fd4b4160f30 2024-09-21T07:11:52.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.577+0000 7fd4b0ff9640 1 -- 172.21.15.18:0/1472868244 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4ac003b30 con 0x7fd4b4160f30 2024-09-21T07:11:52.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.577+0000 7fd4baa1f640 1 -- 172.21.15.18:0/1472868244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b409c5e0 con 0x7fd4b4160f30 2024-09-21T07:11:52.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.577+0000 7fd4b0ff9640 1 -- 172.21.15.18:0/1472868244 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac004020 con 0x7fd4b4160f30 2024-09-21T07:11:52.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.577+0000 7fd4baa1f640 1 -- 172.21.15.18:0/1472868244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b409cba0 con 0x7fd4b4160f30 2024-09-21T07:11:52.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.578+0000 7fd4baa1f640 1 -- 172.21.15.18:0/1472868244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b40b67c0 con 0x7fd4b4160f30 2024-09-21T07:11:52.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.579+0000 7fd4b0ff9640 1 -- 172.21.15.18:0/1472868244 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fd4ac01d020 con 0x7fd4b4160f30 2024-09-21T07:11:52.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.579+0000 7fd4b0ff9640 1 --2- 172.21.15.18:0/1472868244 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd4a0078d40 0x7fd4a007b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.579+0000 7fd4b0ff9640 1 -- 172.21.15.18:0/1472868244 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fd4ac09b190 con 0x7fd4b4160f30 2024-09-21T07:11:52.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.580+0000 7fd4b3fff640 1 --2- 172.21.15.18:0/1472868244 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd4a0078d40 0x7fd4a007b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.580+0000 7fd4b3fff640 1 --2- 172.21.15.18:0/1472868244 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd4a0078d40 0x7fd4a007b250 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4001720 tx=0x7fd4a4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:52.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.584+0000 7fd4b0ff9640 1 -- 172.21.15.18:0/1472868244 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd4b41495a0 con 0x7fd4b4160f30 2024-09-21T07:11:52.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.774+0000 7fd4baa1f640 1 -- 172.21.15.18:0/1472868244 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fd4b406b490 con 0x7fd4a0078d40 2024-09-21T07:11:52.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.775+0000 7fd4b0ff9640 1 -- 172.21.15.18:0/1472868244 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd4a4001d00 con 0x7fd4a0078d40 2024-09-21T07:11:52.776 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 4 to deep-scrub 2024-09-21T07:11:52.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.777+0000 7fd4baa1f640 1 -- 172.21.15.18:0/1472868244 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd4a0078d40 msgr2=0x7fd4a007b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.777+0000 7fd4baa1f640 1 --2- 172.21.15.18:0/1472868244 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd4a0078d40 0x7fd4a007b250 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4001720 tx=0x7fd4a4009040 comp rx=0 tx=0).stop 2024-09-21T07:11:52.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.777+0000 7fd4baa1f640 1 -- 172.21.15.18:0/1472868244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4160f30 msgr2=0x7fd4b4149060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.777+0000 7fd4baa1f640 1 --2- 172.21.15.18:0/1472868244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4160f30 0x7fd4b4149060 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009fd0 tx=0x7fd4ac00c740 comp rx=0 tx=0).stop 2024-09-21T07:11:52.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.777+0000 7fd4baa1f640 1 -- 172.21.15.18:0/1472868244 shutdown_connections 2024-09-21T07:11:52.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.777+0000 7fd4baa1f640 1 --2- 172.21.15.18:0/1472868244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b4160f30 0x7fd4b4149060 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.777+0000 7fd4baa1f640 1 --2- 172.21.15.18:0/1472868244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4b41605e0 0x7fd4b409dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.777+0000 7fd4baa1f640 1 --2- 172.21.15.18:0/1472868244 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fd4a0078d40 0x7fd4a007b250 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.777+0000 7fd4baa1f640 1 --2- 172.21.15.18:0/1472868244 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fd4b40b4760 0x7fd4b409d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.777+0000 7fd4baa1f640 1 -- 172.21.15.18:0/1472868244 >> 172.21.15.18:0/1472868244 conn(0x7fd4b40b78b0 msgr2=0x7fd4b40b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:52.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.777+0000 7fd4baa1f640 1 -- 172.21.15.18:0/1472868244 shutdown_connections 2024-09-21T07:11:52.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.777+0000 7fd4baa1f640 1 -- 172.21.15.18:0/1472868244 wait complete. 2024-09-21T07:11:52.790 INFO:tasks.ceph:Scrubbing osd.5 2024-09-21T07:11:52.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:11:52.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.909+0000 7f569fd0b640 1 -- 172.21.15.18:0/3989004037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f569815db80 msgr2=0x7f56980b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.909+0000 7f569fd0b640 1 --2- 172.21.15.18:0/3989004037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f569815db80 0x7f56980b57e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5688005fd0 tx=0x7f568802aa90 comp rx=0 tx=0).stop 2024-09-21T07:11:52.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.909+0000 7f569fd0b640 1 -- 172.21.15.18:0/3989004037 shutdown_connections 2024-09-21T07:11:52.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.909+0000 7f569fd0b640 1 --2- 172.21.15.18:0/3989004037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f569815db80 0x7f56980b57e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.909+0000 7f569fd0b640 1 --2- 172.21.15.18:0/3989004037 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f56980b4760 0x7f5698153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.909+0000 7f569fd0b640 1 -- 172.21.15.18:0/3989004037 >> 172.21.15.18:0/3989004037 conn(0x7f56980b78b0 msgr2=0x7f56980b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:52.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.909+0000 7f569fd0b640 1 -- 172.21.15.18:0/3989004037 shutdown_connections 2024-09-21T07:11:52.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.909+0000 7f569fd0b640 1 -- 172.21.15.18:0/3989004037 wait complete. 2024-09-21T07:11:52.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.911+0000 7f569fd0b640 1 Processor -- start 2024-09-21T07:11:52.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.911+0000 7f569fd0b640 1 -- start start 2024-09-21T07:11:52.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.912+0000 7f569fd0b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56980b4760 0x7f56981f7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.912+0000 7f569fd0b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f569815d060 0x7f5698148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.912+0000 7f569fd0b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f569815db80 0x7f569809f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.912+0000 7f569fd0b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f56980b6160 con 0x7f56980b4760 2024-09-21T07:11:52.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.912+0000 7f569fd0b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f56980b5fe0 con 0x7f569815db80 2024-09-21T07:11:52.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.912+0000 7f569fd0b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f56980b62e0 con 0x7f569815d060 2024-09-21T07:11:52.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.912+0000 7f569daa7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56980b4760 0x7f56981f7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.912+0000 7f569daa7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56980b4760 0x7f56981f7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38742/0 (socket says 172.21.15.18:38742) 2024-09-21T07:11:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.913+0000 7f569daa7640 1 -- 172.21.15.18:0/77736190 learned_addr learned my addr 172.21.15.18:0/77736190 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.913+0000 7f569e2a8640 1 --2- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f569815db80 0x7f569809f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.913+0000 7f569d2a6640 1 --2- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f569815d060 0x7f5698148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.913+0000 7f569daa7640 1 -- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f569815d060 msgr2=0x7f5698148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.913+0000 7f569daa7640 1 --2- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f569815d060 0x7f5698148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.913+0000 7f569daa7640 1 -- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f569815db80 msgr2=0x7f569809f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.913+0000 7f569daa7640 1 --2- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f569815db80 0x7f569809f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.913+0000 7f569daa7640 1 -- 172.21.15.18:0/77736190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5698149a00 con 0x7f56980b4760 2024-09-21T07:11:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.913+0000 7f569daa7640 1 --2- 172.21.15.18:0/77736190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56980b4760 0x7f56981f7a80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f569000e790 tx=0x7f569000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.913+0000 7f56967fc640 1 -- 172.21.15.18:0/77736190 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569000eea0 con 0x7f56980b4760 2024-09-21T07:11:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.913+0000 7f56967fc640 1 -- 172.21.15.18:0/77736190 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f569000cdb0 con 0x7f56980b4760 2024-09-21T07:11:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.913+0000 7f569fd0b640 1 -- 172.21.15.18:0/77736190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56981f7fc0 con 0x7f56980b4760 2024-09-21T07:11:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.913+0000 7f56967fc640 1 -- 172.21.15.18:0/77736190 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5690010690 con 0x7f56980b4760 2024-09-21T07:11:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.913+0000 7f569fd0b640 1 -- 172.21.15.18:0/77736190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5698154540 con 0x7f56980b4760 2024-09-21T07:11:52.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.914+0000 7f569fd0b640 1 -- 172.21.15.18:0/77736190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5698154080 con 0x7f56980b4760 2024-09-21T07:11:52.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.915+0000 7f56967fc640 1 -- 172.21.15.18:0/77736190 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f5690010830 con 0x7f56980b4760 2024-09-21T07:11:52.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.916+0000 7f56967fc640 1 --2- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5684078d40 0x7f568407b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.916+0000 7f56967fc640 1 -- 172.21.15.18:0/77736190 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f569009c380 con 0x7f56980b4760 2024-09-21T07:11:52.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.916+0000 7f56967fc640 1 --2- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:6810/3861333879,v1:172.21.15.49:6811/3861333879] conn(0x7f568407ec50 0x7f56840810a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:52.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.916+0000 7f569d2a6640 1 --2- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5684078d40 0x7f568407b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.916+0000 7f56967fc640 1 -- 172.21.15.18:0/77736190 --> [v2:172.21.15.49:6810/3861333879,v1:172.21.15.49:6811/3861333879] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5684081770 con 0x7f568407ec50 2024-09-21T07:11:52.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.916+0000 7f56967fc640 1 -- 172.21.15.18:0/77736190 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f569009c730 con 0x7f56980b4760 2024-09-21T07:11:52.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.916+0000 7f569e2a8640 1 --2- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:6810/3861333879,v1:172.21.15.49:6811/3861333879] conn(0x7f568407ec50 0x7f56840810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:52.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.916+0000 7f569d2a6640 1 --2- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5684078d40 0x7f568407b250 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56981f6fd0 tx=0x7f568c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:52.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.917+0000 7f569e2a8640 1 --2- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:6810/3861333879,v1:172.21.15.49:6811/3861333879] conn(0x7f568407ec50 0x7f56840810a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:52.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.917+0000 7f56967fc640 1 -- 172.21.15.18:0/77736190 <== osd.5 v2:172.21.15.49:6810/3861333879 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5684081770 con 0x7f568407ec50 2024-09-21T07:11:52.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.930+0000 7f569fd0b640 1 -- 172.21.15.18:0/77736190 --> [v2:172.21.15.49:6810/3861333879,v1:172.21.15.49:6811/3861333879] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f569809fc30 con 0x7f568407ec50 2024-09-21T07:11:52.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.930+0000 7f56967fc640 1 -- 172.21.15.18:0/77736190 <== osd.5 v2:172.21.15.49:6810/3861333879 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f569809fc30 con 0x7f568407ec50 2024-09-21T07:11:52.932 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T07:11:52.932 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:11:52.932 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T07:11:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.931+0000 7f569fd0b640 1 -- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:6810/3861333879,v1:172.21.15.49:6811/3861333879] conn(0x7f568407ec50 msgr2=0x7f56840810a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.931+0000 7f569fd0b640 1 --2- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:6810/3861333879,v1:172.21.15.49:6811/3861333879] conn(0x7f568407ec50 0x7f56840810a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.931+0000 7f569fd0b640 1 -- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5684078d40 msgr2=0x7f568407b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.931+0000 7f569fd0b640 1 --2- 172.21.15.18:0/77736190 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5684078d40 0x7f568407b250 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56981f6fd0 tx=0x7f568c009040 comp rx=0 tx=0).stop 2024-09-21T07:11:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.931+0000 7f569fd0b640 1 -- 172.21.15.18:0/77736190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56980b4760 msgr2=0x7f56981f7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.931+0000 7f569fd0b640 1 --2- 172.21.15.18:0/77736190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56980b4760 0x7f56981f7a80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f569000e790 tx=0x7f569000ec50 comp rx=0 tx=0).stop 2024-09-21T07:11:52.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.931+0000 7f569e2a8640 1 -- 172.21.15.18:0/77736190 reap_dead start 2024-09-21T07:11:52.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.931+0000 7f569fd0b640 1 -- 172.21.15.18:0/77736190 shutdown_connections 2024-09-21T07:11:52.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.931+0000 7f569fd0b640 1 -- 172.21.15.18:0/77736190 >> 172.21.15.18:0/77736190 conn(0x7f56980b78b0 msgr2=0x7f5698152f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:52.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.931+0000 7f569fd0b640 1 -- 172.21.15.18:0/77736190 shutdown_connections 2024-09-21T07:11:52.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:52.931+0000 7f569fd0b640 1 -- 172.21.15.18:0/77736190 wait complete. 2024-09-21T07:11:52.943 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-21T07:11:53.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.059+0000 7f89ada3f640 1 -- 172.21.15.18:0/2265339399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a815ef50 msgr2=0x7f89a815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.059+0000 7f89ada3f640 1 --2- 172.21.15.18:0/2265339399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a815ef50 0x7f89a815c520 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f89a0005fd0 tx=0x7f89a002a8d0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.059+0000 7f89ada3f640 1 -- 172.21.15.18:0/2265339399 shutdown_connections 2024-09-21T07:11:53.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.059+0000 7f89ada3f640 1 --2- 172.21.15.18:0/2265339399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a815ef50 0x7f89a815c520 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.059+0000 7f89ada3f640 1 -- 172.21.15.18:0/2265339399 >> 172.21.15.18:0/2265339399 conn(0x7f89a8073f30 msgr2=0x7f89a80b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:53.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.059+0000 7f89ada3f640 1 -- 172.21.15.18:0/2265339399 shutdown_connections 2024-09-21T07:11:53.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.059+0000 7f89ada3f640 1 -- 172.21.15.18:0/2265339399 wait complete. 2024-09-21T07:11:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.061+0000 7f89ada3f640 1 Processor -- start 2024-09-21T07:11:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.061+0000 7f89ada3f640 1 -- start start 2024-09-21T07:11:53.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.062+0000 7f89ada3f640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f89a80cef70 0x7f89a8151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.062+0000 7f89ada3f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89a815ef50 0x7f89a80ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.062+0000 7f89ada3f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a8162a40 0x7f89a80b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.062+0000 7f89ada3f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f89a80d11a0 con 0x7f89a815ef50 2024-09-21T07:11:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.062+0000 7f89ada3f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f89a80d1020 con 0x7f89a8162a40 2024-09-21T07:11:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.062+0000 7f89ada3f640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f89a80d1320 con 0x7f89a80cef70 2024-09-21T07:11:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.062+0000 7f89a67fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89a815ef50 0x7f89a80ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.062+0000 7f89a67fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89a815ef50 0x7f89a80ab120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38752/0 (socket says 172.21.15.18:38752) 2024-09-21T07:11:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.062+0000 7f89a67fc640 1 -- 172.21.15.18:0/2471408776 learned_addr learned my addr 172.21.15.18:0/2471408776 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.063+0000 7f89a6ffd640 1 --2- 172.21.15.18:0/2471408776 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f89a80cef70 0x7f89a8151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.063+0000 7f89a77fe640 1 --2- 172.21.15.18:0/2471408776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a8162a40 0x7f89a80b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.063+0000 7f89a67fc640 1 -- 172.21.15.18:0/2471408776 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f89a80cef70 msgr2=0x7f89a8151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.063+0000 7f89a67fc640 1 --2- 172.21.15.18:0/2471408776 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f89a80cef70 0x7f89a8151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.063+0000 7f89a67fc640 1 -- 172.21.15.18:0/2471408776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a8162a40 msgr2=0x7f89a80b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.063+0000 7f89a67fc640 1 --2- 172.21.15.18:0/2471408776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a8162a40 0x7f89a80b56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.063+0000 7f89a67fc640 1 -- 172.21.15.18:0/2471408776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a80cd840 con 0x7f89a815ef50 2024-09-21T07:11:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.063+0000 7f89a77fe640 1 --2- 172.21.15.18:0/2471408776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a8162a40 0x7f89a80b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.063+0000 7f89a67fc640 1 --2- 172.21.15.18:0/2471408776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89a815ef50 0x7f89a80ab120 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f899000c400 tx=0x7f899000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.063+0000 7f899ffff640 1 -- 172.21.15.18:0/2471408776 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8990017070 con 0x7f89a815ef50 2024-09-21T07:11:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.063+0000 7f899ffff640 1 -- 172.21.15.18:0/2471408776 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89900053c0 con 0x7f89a815ef50 2024-09-21T07:11:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.063+0000 7f89ada3f640 1 -- 172.21.15.18:0/2471408776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a80cdb20 con 0x7f89a815ef50 2024-09-21T07:11:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.063+0000 7f899ffff640 1 -- 172.21.15.18:0/2471408776 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89900038a0 con 0x7f89a815ef50 2024-09-21T07:11:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.063+0000 7f89ada3f640 1 -- 172.21.15.18:0/2471408776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a80ce0e0 con 0x7f89a815ef50 2024-09-21T07:11:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.064+0000 7f89ada3f640 1 -- 172.21.15.18:0/2471408776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a8163080 con 0x7f89a815ef50 2024-09-21T07:11:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.065+0000 7f899ffff640 1 -- 172.21.15.18:0/2471408776 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f899001a070 con 0x7f89a815ef50 2024-09-21T07:11:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.065+0000 7f899ffff640 1 --2- 172.21.15.18:0/2471408776 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8988078d70 0x7f898807b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.066+0000 7f899ffff640 1 -- 172.21.15.18:0/2471408776 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f899009a220 con 0x7f89a815ef50 2024-09-21T07:11:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.066+0000 7f89a6ffd640 1 --2- 172.21.15.18:0/2471408776 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8988078d70 0x7f898807b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.066+0000 7f89a6ffd640 1 --2- 172.21.15.18:0/2471408776 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8988078d70 0x7f898807b280 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f89a0034000 tx=0x7f89a0004ab0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.070+0000 7f899ffff640 1 -- 172.21.15.18:0/2471408776 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f89a8163080 con 0x7f89a815ef50 2024-09-21T07:11:53.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.257+0000 7f89ada3f640 1 -- 172.21.15.18:0/2471408776 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f89a806b490 con 0x7f8988078d70 2024-09-21T07:11:53.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.258+0000 7f899ffff640 1 -- 172.21.15.18:0/2471408776 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f89a0009280 con 0x7f8988078d70 2024-09-21T07:11:53.260 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 5 to deep-scrub 2024-09-21T07:11:53.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.260+0000 7f89ada3f640 1 -- 172.21.15.18:0/2471408776 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8988078d70 msgr2=0x7f898807b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.260+0000 7f89ada3f640 1 --2- 172.21.15.18:0/2471408776 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8988078d70 0x7f898807b280 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f89a0034000 tx=0x7f89a0004ab0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.260+0000 7f89ada3f640 1 -- 172.21.15.18:0/2471408776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89a815ef50 msgr2=0x7f89a80ab120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.260+0000 7f89ada3f640 1 --2- 172.21.15.18:0/2471408776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89a815ef50 0x7f89a80ab120 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f899000c400 tx=0x7f899000c8c0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.260+0000 7f89ada3f640 1 -- 172.21.15.18:0/2471408776 shutdown_connections 2024-09-21T07:11:53.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.260+0000 7f89ada3f640 1 --2- 172.21.15.18:0/2471408776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a8162a40 0x7f89a80b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.260+0000 7f89ada3f640 1 --2- 172.21.15.18:0/2471408776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89a815ef50 0x7f89a80ab120 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.260+0000 7f89ada3f640 1 --2- 172.21.15.18:0/2471408776 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f8988078d70 0x7f898807b280 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.260+0000 7f89ada3f640 1 --2- 172.21.15.18:0/2471408776 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f89a80cef70 0x7f89a8151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.260+0000 7f89ada3f640 1 -- 172.21.15.18:0/2471408776 >> 172.21.15.18:0/2471408776 conn(0x7f89a8073f30 msgr2=0x7f89a8160080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:53.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.260+0000 7f89ada3f640 1 -- 172.21.15.18:0/2471408776 shutdown_connections 2024-09-21T07:11:53.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.260+0000 7f89ada3f640 1 -- 172.21.15.18:0/2471408776 wait complete. 2024-09-21T07:11:53.273 INFO:tasks.ceph:Scrubbing osd.6 2024-09-21T07:11:53.274 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:11:53.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.393+0000 7fb90c78b640 1 -- 172.21.15.18:0/645615546 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb9040cef70 msgr2=0x7fb9040d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.393+0000 7fb90c78b640 1 --2- 172.21.15.18:0/645615546 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb9040cef70 0x7fb9040d3040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009820 tx=0x7fb8f402a510 comp rx=0 tx=0).stop 2024-09-21T07:11:53.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.393+0000 7fb90c78b640 1 -- 172.21.15.18:0/645615546 shutdown_connections 2024-09-21T07:11:53.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.393+0000 7fb90c78b640 1 --2- 172.21.15.18:0/645615546 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb9040cef70 0x7fb9040d3040 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.393+0000 7fb90c78b640 1 --2- 172.21.15.18:0/645615546 >> v2:172.21.15.49:3300/0 conn(0x7fb90415ef50 0x7fb90415c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.393+0000 7fb90c78b640 1 -- 172.21.15.18:0/645615546 >> 172.21.15.18:0/645615546 conn(0x7fb904073f30 msgr2=0x7fb9040b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:53.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.393+0000 7fb90c78b640 1 -- 172.21.15.18:0/645615546 shutdown_connections 2024-09-21T07:11:53.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.393+0000 7fb90c78b640 1 -- 172.21.15.18:0/645615546 wait complete. 2024-09-21T07:11:53.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.395+0000 7fb90c78b640 1 Processor -- start 2024-09-21T07:11:53.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.395+0000 7fb90c78b640 1 -- start start 2024-09-21T07:11:53.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.396+0000 7fb90c78b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9040cef70 0x7fb9041f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.396+0000 7fb90c78b640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb9040d3580 0x7fb904151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.396+0000 7fb90c78b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb90415ef50 0x7fb9040cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.396+0000 7fb90c78b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb9040d11a0 con 0x7fb9040cef70 2024-09-21T07:11:53.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.396+0000 7fb90c78b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb9040d1020 con 0x7fb90415ef50 2024-09-21T07:11:53.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.396+0000 7fb90c78b640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fb9040d1320 con 0x7fb9040d3580 2024-09-21T07:11:53.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.396+0000 7fb90a527640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9040cef70 0x7fb9041f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.396+0000 7fb90a527640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9040cef70 0x7fb9041f9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38762/0 (socket says 172.21.15.18:38762) 2024-09-21T07:11:53.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.396+0000 7fb90a527640 1 -- 172.21.15.18:0/1823223070 learned_addr learned my addr 172.21.15.18:0/1823223070 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:53.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.396+0000 7fb909d26640 1 --2- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb9040d3580 0x7fb904151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.396+0000 7fb90ad28640 1 --2- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb90415ef50 0x7fb9040cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.397+0000 7fb90a527640 1 -- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb9040d3580 msgr2=0x7fb904151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.397+0000 7fb90a527640 1 --2- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fb9040d3580 0x7fb904151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.397+0000 7fb90a527640 1 -- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb90415ef50 msgr2=0x7fb9040cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.397+0000 7fb90a527640 1 --2- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb90415ef50 0x7fb9040cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.397+0000 7fb90a527640 1 -- 172.21.15.18:0/1823223070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9040cd350 con 0x7fb9040cef70 2024-09-21T07:11:53.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.397+0000 7fb90a527640 1 --2- 172.21.15.18:0/1823223070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9040cef70 0x7fb9041f9150 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb90000e9f0 tx=0x7fb90000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:53.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.397+0000 7fb8faffd640 1 -- 172.21.15.18:0/1823223070 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90000cd80 con 0x7fb9040cef70 2024-09-21T07:11:53.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.397+0000 7fb8faffd640 1 -- 172.21.15.18:0/1823223070 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb900004020 con 0x7fb9040cef70 2024-09-21T07:11:53.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.397+0000 7fb90c78b640 1 -- 172.21.15.18:0/1823223070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9041f9a50 con 0x7fb9040cef70 2024-09-21T07:11:53.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.397+0000 7fb8faffd640 1 -- 172.21.15.18:0/1823223070 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb900004450 con 0x7fb9040cef70 2024-09-21T07:11:53.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.397+0000 7fb90c78b640 1 -- 172.21.15.18:0/1823223070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9041fa010 con 0x7fb9040cef70 2024-09-21T07:11:53.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.398+0000 7fb90c78b640 1 -- 172.21.15.18:0/1823223070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb90406b490 con 0x7fb9040cef70 2024-09-21T07:11:53.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.399+0000 7fb8faffd640 1 -- 172.21.15.18:0/1823223070 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fb9000035f0 con 0x7fb9040cef70 2024-09-21T07:11:53.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.400+0000 7fb8faffd640 1 --2- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb8e8078d40 0x7fb8e807b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.400+0000 7fb8faffd640 1 -- 172.21.15.18:0/1823223070 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fb90009b990 con 0x7fb9040cef70 2024-09-21T07:11:53.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.400+0000 7fb8faffd640 1 --2- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:6802/3256581088,v1:172.21.15.49:6803/3256581088] conn(0x7fb8e807ec50 0x7fb8e80810a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.400+0000 7fb909d26640 1 --2- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb8e8078d40 0x7fb8e807b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.400+0000 7fb8faffd640 1 -- 172.21.15.18:0/1823223070 --> [v2:172.21.15.49:6802/3256581088,v1:172.21.15.49:6803/3256581088] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb900022e50 con 0x7fb8e807ec50 2024-09-21T07:11:53.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.400+0000 7fb8faffd640 1 -- 172.21.15.18:0/1823223070 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb90009be20 con 0x7fb9040cef70 2024-09-21T07:11:53.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.400+0000 7fb90ad28640 1 --2- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:6802/3256581088,v1:172.21.15.49:6803/3256581088] conn(0x7fb8e807ec50 0x7fb8e80810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.400+0000 7fb909d26640 1 --2- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb8e8078d40 0x7fb8e807b250 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4034000 tx=0x7fb8f4004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:53.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.401+0000 7fb90ad28640 1 --2- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:6802/3256581088,v1:172.21.15.49:6803/3256581088] conn(0x7fb8e807ec50 0x7fb8e80810a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:53.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.401+0000 7fb8faffd640 1 -- 172.21.15.18:0/1823223070 <== osd.6 v2:172.21.15.49:6802/3256581088 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb900022e50 con 0x7fb8e807ec50 2024-09-21T07:11:53.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.414+0000 7fb90c78b640 1 -- 172.21.15.18:0/1823223070 --> [v2:172.21.15.49:6802/3256581088,v1:172.21.15.49:6803/3256581088] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb9040d17d0 con 0x7fb8e807ec50 2024-09-21T07:11:53.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.415+0000 7fb8faffd640 1 -- 172.21.15.18:0/1823223070 <== osd.6 v2:172.21.15.49:6802/3256581088 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb9040d17d0 con 0x7fb8e807ec50 2024-09-21T07:11:53.416 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T07:11:53.417 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:11:53.417 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T07:11:53.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.415+0000 7fb90c78b640 1 -- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:6802/3256581088,v1:172.21.15.49:6803/3256581088] conn(0x7fb8e807ec50 msgr2=0x7fb8e80810a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.415+0000 7fb90c78b640 1 --2- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:6802/3256581088,v1:172.21.15.49:6803/3256581088] conn(0x7fb8e807ec50 0x7fb8e80810a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.415+0000 7fb90c78b640 1 -- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb8e8078d40 msgr2=0x7fb8e807b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.415+0000 7fb90c78b640 1 --2- 172.21.15.18:0/1823223070 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fb8e8078d40 0x7fb8e807b250 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4034000 tx=0x7fb8f4004730 comp rx=0 tx=0).stop 2024-09-21T07:11:53.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.415+0000 7fb90c78b640 1 -- 172.21.15.18:0/1823223070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9040cef70 msgr2=0x7fb9041f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.415+0000 7fb90c78b640 1 --2- 172.21.15.18:0/1823223070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9040cef70 0x7fb9041f9150 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb90000e9f0 tx=0x7fb90000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.415+0000 7fb90ad28640 1 -- 172.21.15.18:0/1823223070 reap_dead start 2024-09-21T07:11:53.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.415+0000 7fb90c78b640 1 -- 172.21.15.18:0/1823223070 shutdown_connections 2024-09-21T07:11:53.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.415+0000 7fb90c78b640 1 -- 172.21.15.18:0/1823223070 >> 172.21.15.18:0/1823223070 conn(0x7fb904073f30 msgr2=0x7fb90415d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:53.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.415+0000 7fb90c78b640 1 -- 172.21.15.18:0/1823223070 shutdown_connections 2024-09-21T07:11:53.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.415+0000 7fb90c78b640 1 -- 172.21.15.18:0/1823223070 wait complete. 2024-09-21T07:11:53.428 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-21T07:11:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.544+0000 7fcc5e015640 1 -- 172.21.15.18:0/2347190313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc5815ef50 msgr2=0x7fcc5815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.544+0000 7fcc5e015640 1 --2- 172.21.15.18:0/2347190313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc5815ef50 0x7fcc5815c520 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcc580d21f0 tx=0x7fcc4802a560 comp rx=0 tx=0).stop 2024-09-21T07:11:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.544+0000 7fcc5e015640 1 -- 172.21.15.18:0/2347190313 shutdown_connections 2024-09-21T07:11:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.544+0000 7fcc5e015640 1 --2- 172.21.15.18:0/2347190313 >> v2:172.21.15.49:3300/0 conn(0x7fcc580d3580 0x7fcc58162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.544+0000 7fcc5e015640 1 --2- 172.21.15.18:0/2347190313 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc580cef70 0x7fcc580d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.544+0000 7fcc5e015640 1 --2- 172.21.15.18:0/2347190313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc5815ef50 0x7fcc5815c520 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.544+0000 7fcc5e015640 1 -- 172.21.15.18:0/2347190313 >> 172.21.15.18:0/2347190313 conn(0x7fcc58073f30 msgr2=0x7fcc580b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.544+0000 7fcc5e015640 1 -- 172.21.15.18:0/2347190313 shutdown_connections 2024-09-21T07:11:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.544+0000 7fcc5e015640 1 -- 172.21.15.18:0/2347190313 wait complete. 2024-09-21T07:11:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.546+0000 7fcc5e015640 1 Processor -- start 2024-09-21T07:11:53.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.546+0000 7fcc5e015640 1 -- start start 2024-09-21T07:11:53.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.547+0000 7fcc5e015640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc580cef70 0x7fcc580abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.547+0000 7fcc5e015640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc580d3580 0x7fcc581518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.547+0000 7fcc5e015640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc5815ef50 0x7fcc580b9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.547+0000 7fcc5e015640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcc58163420 con 0x7fcc5815ef50 2024-09-21T07:11:53.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.547+0000 7fcc5e015640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581632a0 con 0x7fcc580cef70 2024-09-21T07:11:53.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.547+0000 7fcc5e015640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7fcc580d1020 con 0x7fcc580d3580 2024-09-21T07:11:53.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.547+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc5815ef50 0x7fcc580b9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.548+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc5815ef50 0x7fcc580b9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38766/0 (socket says 172.21.15.18:38766) 2024-09-21T07:11:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.548+0000 7fcc57fff640 1 -- 172.21.15.18:0/1326588122 learned_addr learned my addr 172.21.15.18:0/1326588122 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.548+0000 7fcc56ffd640 1 --2- 172.21.15.18:0/1326588122 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc580d3580 0x7fcc581518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.548+0000 7fcc577fe640 1 --2- 172.21.15.18:0/1326588122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc580cef70 0x7fcc580abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.548+0000 7fcc57fff640 1 -- 172.21.15.18:0/1326588122 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc580d3580 msgr2=0x7fcc581518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.548+0000 7fcc57fff640 1 --2- 172.21.15.18:0/1326588122 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc580d3580 0x7fcc581518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.548+0000 7fcc57fff640 1 -- 172.21.15.18:0/1326588122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc580cef70 msgr2=0x7fcc580abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.548+0000 7fcc57fff640 1 --2- 172.21.15.18:0/1326588122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc580cef70 0x7fcc580abb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.548+0000 7fcc57fff640 1 -- 172.21.15.18:0/1326588122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc580cca20 con 0x7fcc5815ef50 2024-09-21T07:11:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.548+0000 7fcc57fff640 1 --2- 172.21.15.18:0/1326588122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc5815ef50 0x7fcc580b9110 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000d960 tx=0x7fcc5000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.548+0000 7fcc3ffff640 1 -- 172.21.15.18:0/1326588122 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50017070 con 0x7fcc5815ef50 2024-09-21T07:11:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.548+0000 7fcc3ffff640 1 -- 172.21.15.18:0/1326588122 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc5000be20 con 0x7fcc5815ef50 2024-09-21T07:11:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.548+0000 7fcc5e015640 1 -- 172.21.15.18:0/1326588122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc580ccd00 con 0x7fcc5815ef50 2024-09-21T07:11:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.548+0000 7fcc3ffff640 1 -- 172.21.15.18:0/1326588122 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc500106a0 con 0x7fcc5815ef50 2024-09-21T07:11:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.548+0000 7fcc5e015640 1 -- 172.21.15.18:0/1326588122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc581f67b0 con 0x7fcc5815ef50 2024-09-21T07:11:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.549+0000 7fcc5e015640 1 -- 172.21.15.18:0/1326588122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc581f6a10 con 0x7fcc5815ef50 2024-09-21T07:11:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.550+0000 7fcc3ffff640 1 -- 172.21.15.18:0/1326588122 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fcc5001a070 con 0x7fcc5815ef50 2024-09-21T07:11:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.551+0000 7fcc3ffff640 1 --2- 172.21.15.18:0/1326588122 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcc44078d40 0x7fcc4407b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.551+0000 7fcc3ffff640 1 -- 172.21.15.18:0/1326588122 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fcc5009b250 con 0x7fcc5815ef50 2024-09-21T07:11:53.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.551+0000 7fcc577fe640 1 --2- 172.21.15.18:0/1326588122 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcc44078d40 0x7fcc4407b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.552+0000 7fcc577fe640 1 --2- 172.21.15.18:0/1326588122 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcc44078d40 0x7fcc4407b250 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcc48033000 tx=0x7fcc48004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.555+0000 7fcc3ffff640 1 -- 172.21.15.18:0/1326588122 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcc50063060 con 0x7fcc5815ef50 2024-09-21T07:11:53.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.741+0000 7fcc5e015640 1 -- 172.21.15.18:0/1326588122 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fcc58162a40 con 0x7fcc44078d40 2024-09-21T07:11:53.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.742+0000 7fcc3ffff640 1 -- 172.21.15.18:0/1326588122 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcc58162a40 con 0x7fcc44078d40 2024-09-21T07:11:53.743 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 6 to deep-scrub 2024-09-21T07:11:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.744+0000 7fcc5e015640 1 -- 172.21.15.18:0/1326588122 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcc44078d40 msgr2=0x7fcc4407b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.744+0000 7fcc5e015640 1 --2- 172.21.15.18:0/1326588122 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcc44078d40 0x7fcc4407b250 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcc48033000 tx=0x7fcc48004730 comp rx=0 tx=0).stop 2024-09-21T07:11:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.744+0000 7fcc5e015640 1 -- 172.21.15.18:0/1326588122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc5815ef50 msgr2=0x7fcc580b9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.744+0000 7fcc5e015640 1 --2- 172.21.15.18:0/1326588122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc5815ef50 0x7fcc580b9110 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000d960 tx=0x7fcc5000de20 comp rx=0 tx=0).stop 2024-09-21T07:11:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.744+0000 7fcc5e015640 1 -- 172.21.15.18:0/1326588122 shutdown_connections 2024-09-21T07:11:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.744+0000 7fcc5e015640 1 --2- 172.21.15.18:0/1326588122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc5815ef50 0x7fcc580b9110 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.744+0000 7fcc5e015640 1 --2- 172.21.15.18:0/1326588122 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7fcc44078d40 0x7fcc4407b250 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.744+0000 7fcc5e015640 1 --2- 172.21.15.18:0/1326588122 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7fcc580d3580 0x7fcc581518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.744+0000 7fcc5e015640 1 --2- 172.21.15.18:0/1326588122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc580cef70 0x7fcc580abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.744+0000 7fcc5e015640 1 -- 172.21.15.18:0/1326588122 >> 172.21.15.18:0/1326588122 conn(0x7fcc58073f30 msgr2=0x7fcc580cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.744+0000 7fcc5e015640 1 -- 172.21.15.18:0/1326588122 shutdown_connections 2024-09-21T07:11:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.744+0000 7fcc5e015640 1 -- 172.21.15.18:0/1326588122 wait complete. 2024-09-21T07:11:53.757 INFO:tasks.ceph:Scrubbing osd.7 2024-09-21T07:11:53.758 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:11:53.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.876+0000 7f12afed5640 1 -- 172.21.15.18:0/1206713431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a8074240 msgr2=0x7f12a815f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.876+0000 7f12afed5640 1 --2- 172.21.15.18:0/1206713431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a8074240 0x7f12a815f440 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f129c005fd0 tx=0x7f129c02a5d0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.876+0000 7f12afed5640 1 -- 172.21.15.18:0/1206713431 shutdown_connections 2024-09-21T07:11:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.876+0000 7f12afed5640 1 --2- 172.21.15.18:0/1206713431 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f12a815f980 0x7f12a8151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.876+0000 7f12afed5640 1 --2- 172.21.15.18:0/1206713431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a8074240 0x7f12a815f440 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.876+0000 7f12afed5640 1 -- 172.21.15.18:0/1206713431 >> 172.21.15.18:0/1206713431 conn(0x7f12a80d0d70 msgr2=0x7f12a80d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.876+0000 7f12afed5640 1 -- 172.21.15.18:0/1206713431 shutdown_connections 2024-09-21T07:11:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.876+0000 7f12afed5640 1 -- 172.21.15.18:0/1206713431 wait complete. 2024-09-21T07:11:53.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.878+0000 7f12afed5640 1 Processor -- start 2024-09-21T07:11:53.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.878+0000 7f12afed5640 1 -- start start 2024-09-21T07:11:53.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.879+0000 7f12afed5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a80d0050 0x7f12a81f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.879+0000 7f12afed5640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f12a815f980 0x7f12a81f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.879+0000 7f12afed5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a80b2020 0x7f12a80b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.879+0000 7f12afed5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f12a8152730 con 0x7f12a80b2020 2024-09-21T07:11:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.879+0000 7f12afed5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f12a81525b0 con 0x7f12a80d0050 2024-09-21T07:11:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.879+0000 7f12afed5640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f12a81528b0 con 0x7f12a815f980 2024-09-21T07:11:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12ae472640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a80b2020 0x7f12a80b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12ae472640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a80b2020 0x7f12a80b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38796/0 (socket says 172.21.15.18:38796) 2024-09-21T07:11:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12ae472640 1 -- 172.21.15.18:0/3304100611 learned_addr learned my addr 172.21.15.18:0/3304100611 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12adc71640 1 --2- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a80d0050 0x7f12a81f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12ad470640 1 --2- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f12a815f980 0x7f12a81f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12ae472640 1 -- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f12a815f980 msgr2=0x7f12a81f87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12ae472640 1 --2- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f12a815f980 0x7f12a81f87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12ae472640 1 -- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a80d0050 msgr2=0x7f12a81f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12ae472640 1 --2- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12a80d0050 0x7f12a81f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12ae472640 1 -- 172.21.15.18:0/3304100611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a81f8d10 con 0x7f12a80b2020 2024-09-21T07:11:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12ae472640 1 --2- 172.21.15.18:0/3304100611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a80b2020 0x7f12a80b4300 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f129800e770 tx=0x7f129800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12a67fc640 1 -- 172.21.15.18:0/3304100611 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129800ccc0 con 0x7f12a80b2020 2024-09-21T07:11:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12a67fc640 1 -- 172.21.15.18:0/3304100611 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f129800ee80 con 0x7f12a80b2020 2024-09-21T07:11:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12afed5640 1 -- 172.21.15.18:0/3304100611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a81f51e0 con 0x7f12a80b2020 2024-09-21T07:11:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12a67fc640 1 -- 172.21.15.18:0/3304100611 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298005280 con 0x7f12a80b2020 2024-09-21T07:11:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.880+0000 7f12afed5640 1 -- 172.21.15.18:0/3304100611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a81f9500 con 0x7f12a80b2020 2024-09-21T07:11:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.881+0000 7f12afed5640 1 -- 172.21.15.18:0/3304100611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f12a806b490 con 0x7f12a80b2020 2024-09-21T07:11:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.882+0000 7f12a67fc640 1 -- 172.21.15.18:0/3304100611 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f1298005420 con 0x7f12a80b2020 2024-09-21T07:11:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.883+0000 7f12a67fc640 1 --2- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1294078d40 0x7f129407b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.883+0000 7f12a67fc640 1 -- 172.21.15.18:0/3304100611 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f129809bd20 con 0x7f12a80b2020 2024-09-21T07:11:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.883+0000 7f12a67fc640 1 --2- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:6826/3277556905,v1:172.21.15.49:6827/3277556905] conn(0x7f129407ec50 0x7f12940810a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.883+0000 7f12a67fc640 1 -- 172.21.15.18:0/3304100611 --> [v2:172.21.15.49:6826/3277556905,v1:172.21.15.49:6827/3277556905] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1298021e50 con 0x7f129407ec50 2024-09-21T07:11:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.883+0000 7f12a67fc640 1 -- 172.21.15.18:0/3304100611 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f129809c1b0 con 0x7f12a80b2020 2024-09-21T07:11:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.883+0000 7f12adc71640 1 --2- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1294078d40 0x7f129407b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.883+0000 7f12ad470640 1 --2- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:6826/3277556905,v1:172.21.15.49:6827/3277556905] conn(0x7f129407ec50 0x7f12940810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.883+0000 7f12adc71640 1 --2- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1294078d40 0x7f129407b250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f12a0001ce0 tx=0x7f12a0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.884+0000 7f12ad470640 1 --2- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:6826/3277556905,v1:172.21.15.49:6827/3277556905] conn(0x7f129407ec50 0x7f12940810a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.884+0000 7f12a67fc640 1 -- 172.21.15.18:0/3304100611 <== osd.7 v2:172.21.15.49:6826/3277556905 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1298021e50 con 0x7f129407ec50 2024-09-21T07:11:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.897+0000 7f12afed5640 1 -- 172.21.15.18:0/3304100611 --> [v2:172.21.15.49:6826/3277556905,v1:172.21.15.49:6827/3277556905] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f12a815f440 con 0x7f129407ec50 2024-09-21T07:11:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.898+0000 7f12a67fc640 1 -- 172.21.15.18:0/3304100611 <== osd.7 v2:172.21.15.49:6826/3277556905 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f12a815f440 con 0x7f129407ec50 2024-09-21T07:11:53.900 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T07:11:53.900 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:11:53.900 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T07:11:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.898+0000 7f12afed5640 1 -- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:6826/3277556905,v1:172.21.15.49:6827/3277556905] conn(0x7f129407ec50 msgr2=0x7f12940810a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.898+0000 7f12afed5640 1 --2- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:6826/3277556905,v1:172.21.15.49:6827/3277556905] conn(0x7f129407ec50 0x7f12940810a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.898+0000 7f12afed5640 1 -- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1294078d40 msgr2=0x7f129407b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.898+0000 7f12afed5640 1 --2- 172.21.15.18:0/3304100611 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f1294078d40 0x7f129407b250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f12a0001ce0 tx=0x7f12a0009040 comp rx=0 tx=0).stop 2024-09-21T07:11:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.898+0000 7f12afed5640 1 -- 172.21.15.18:0/3304100611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a80b2020 msgr2=0x7f12a80b4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.898+0000 7f12afed5640 1 --2- 172.21.15.18:0/3304100611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12a80b2020 0x7f12a80b4300 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f129800e770 tx=0x7f129800ec30 comp rx=0 tx=0).stop 2024-09-21T07:11:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.898+0000 7f12ae472640 1 -- 172.21.15.18:0/3304100611 reap_dead start 2024-09-21T07:11:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.898+0000 7f12afed5640 1 -- 172.21.15.18:0/3304100611 shutdown_connections 2024-09-21T07:11:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.898+0000 7f12afed5640 1 -- 172.21.15.18:0/3304100611 >> 172.21.15.18:0/3304100611 conn(0x7f12a80d0d70 msgr2=0x7f12a8151080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.898+0000 7f12afed5640 1 -- 172.21.15.18:0/3304100611 shutdown_connections 2024-09-21T07:11:53.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:53.898+0000 7f12afed5640 1 -- 172.21.15.18:0/3304100611 wait complete. 2024-09-21T07:11:53.911 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-21T07:11:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.026+0000 7f6441638640 1 -- 172.21.15.18:0/3320882223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f643c1605e0 msgr2=0x7f643c1609f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.026+0000 7f6441638640 1 --2- 172.21.15.18:0/3320882223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f643c1605e0 0x7f643c1609f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f643c074360 tx=0x7f642402a530 comp rx=0 tx=0).stop 2024-09-21T07:11:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.026+0000 7f6441638640 1 -- 172.21.15.18:0/3320882223 shutdown_connections 2024-09-21T07:11:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.026+0000 7f6441638640 1 --2- 172.21.15.18:0/3320882223 >> v2:172.21.15.49:3300/0 conn(0x7f643c160f30 0x7f643c0b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.026+0000 7f6441638640 1 --2- 172.21.15.18:0/3320882223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f643c1605e0 0x7f643c1609f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.026+0000 7f6441638640 1 -- 172.21.15.18:0/3320882223 >> 172.21.15.18:0/3320882223 conn(0x7f643c0b78b0 msgr2=0x7f643c0b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:54.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.026+0000 7f6441638640 1 -- 172.21.15.18:0/3320882223 shutdown_connections 2024-09-21T07:11:54.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.026+0000 7f6441638640 1 -- 172.21.15.18:0/3320882223 wait complete. 2024-09-21T07:11:54.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.028+0000 7f6441638640 1 Processor -- start 2024-09-21T07:11:54.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.028+0000 7f6441638640 1 -- start start 2024-09-21T07:11:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.029+0000 7f6441638640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f643c0b4760 0x7f643c1f9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.029+0000 7f6441638640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f643c1605e0 0x7f643c146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.029+0000 7f6441638640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f643c160f30 0x7f643c15e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.029+0000 7f6441638640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f643c0b60b0 con 0x7f643c160f30 2024-09-21T07:11:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.029+0000 7f6441638640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f643c0b5f30 con 0x7f643c0b4760 2024-09-21T07:11:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.029+0000 7f6441638640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f643c0b6230 con 0x7f643c1605e0 2024-09-21T07:11:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.029+0000 7f643b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f643c160f30 0x7f643c15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.029+0000 7f643b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f643c160f30 0x7f643c15e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38814/0 (socket says 172.21.15.18:38814) 2024-09-21T07:11:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.029+0000 7f643b7fe640 1 -- 172.21.15.18:0/1176909637 learned_addr learned my addr 172.21.15.18:0/1176909637 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.030+0000 7f643a7fc640 1 --2- 172.21.15.18:0/1176909637 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f643c1605e0 0x7f643c146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.030+0000 7f643affd640 1 --2- 172.21.15.18:0/1176909637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f643c0b4760 0x7f643c1f9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.030+0000 7f643b7fe640 1 -- 172.21.15.18:0/1176909637 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f643c1605e0 msgr2=0x7f643c146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.030+0000 7f643b7fe640 1 --2- 172.21.15.18:0/1176909637 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f643c1605e0 0x7f643c146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.030+0000 7f643b7fe640 1 -- 172.21.15.18:0/1176909637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f643c0b4760 msgr2=0x7f643c1f9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.030+0000 7f643b7fe640 1 --2- 172.21.15.18:0/1176909637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f643c0b4760 0x7f643c1f9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.030+0000 7f643b7fe640 1 -- 172.21.15.18:0/1176909637 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643c06cd40 con 0x7f643c160f30 2024-09-21T07:11:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.030+0000 7f643b7fe640 1 --2- 172.21.15.18:0/1176909637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f643c160f30 0x7f643c15e340 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f643400e740 tx=0x7f643400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.030+0000 7f64337fe640 1 -- 172.21.15.18:0/1176909637 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643400ccc0 con 0x7f643c160f30 2024-09-21T07:11:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.030+0000 7f64337fe640 1 -- 172.21.15.18:0/1176909637 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f643400ce80 con 0x7f643c160f30 2024-09-21T07:11:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.030+0000 7f6441638640 1 -- 172.21.15.18:0/1176909637 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643c1f5430 con 0x7f643c160f30 2024-09-21T07:11:54.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.030+0000 7f64337fe640 1 -- 172.21.15.18:0/1176909637 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434005280 con 0x7f643c160f30 2024-09-21T07:11:54.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.030+0000 7f6441638640 1 -- 172.21.15.18:0/1176909637 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f643c1f59f0 con 0x7f643c160f30 2024-09-21T07:11:54.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.031+0000 7f6441638640 1 -- 172.21.15.18:0/1176909637 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f643c1609f0 con 0x7f643c160f30 2024-09-21T07:11:54.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.032+0000 7f64337fe640 1 -- 172.21.15.18:0/1176909637 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f6434005420 con 0x7f643c160f30 2024-09-21T07:11:54.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.032+0000 7f64337fe640 1 --2- 172.21.15.18:0/1176909637 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f641c078d40 0x7f641c07b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:54.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.033+0000 7f64337fe640 1 -- 172.21.15.18:0/1176909637 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f643409b700 con 0x7f643c160f30 2024-09-21T07:11:54.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.033+0000 7f643affd640 1 --2- 172.21.15.18:0/1176909637 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f641c078d40 0x7f641c07b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:54.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.033+0000 7f643affd640 1 --2- 172.21.15.18:0/1176909637 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f641c078d40 0x7f641c07b250 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f642c0017a0 tx=0x7f642c001730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:54.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.037+0000 7f64337fe640 1 -- 172.21.15.18:0/1176909637 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f64340633c0 con 0x7f643c160f30 2024-09-21T07:11:54.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.225+0000 7f6441638640 1 -- 172.21.15.18:0/1176909637 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f643c06b490 con 0x7f641c078d40 2024-09-21T07:11:54.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.226+0000 7f64337fe640 1 -- 172.21.15.18:0/1176909637 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f642c00fda0 con 0x7f641c078d40 2024-09-21T07:11:54.228 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 7 to deep-scrub 2024-09-21T07:11:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.229+0000 7f6441638640 1 -- 172.21.15.18:0/1176909637 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f641c078d40 msgr2=0x7f641c07b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.229+0000 7f6441638640 1 --2- 172.21.15.18:0/1176909637 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f641c078d40 0x7f641c07b250 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f642c0017a0 tx=0x7f642c001730 comp rx=0 tx=0).stop 2024-09-21T07:11:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.229+0000 7f6441638640 1 -- 172.21.15.18:0/1176909637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f643c160f30 msgr2=0x7f643c15e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.229+0000 7f6441638640 1 --2- 172.21.15.18:0/1176909637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f643c160f30 0x7f643c15e340 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f643400e740 tx=0x7f643400ec00 comp rx=0 tx=0).stop 2024-09-21T07:11:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.229+0000 7f6441638640 1 -- 172.21.15.18:0/1176909637 shutdown_connections 2024-09-21T07:11:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.229+0000 7f6441638640 1 --2- 172.21.15.18:0/1176909637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f643c160f30 0x7f643c15e340 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.229+0000 7f6441638640 1 --2- 172.21.15.18:0/1176909637 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f641c078d40 0x7f641c07b250 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.229+0000 7f6441638640 1 --2- 172.21.15.18:0/1176909637 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f643c1605e0 0x7f643c146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.229+0000 7f6441638640 1 --2- 172.21.15.18:0/1176909637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f643c0b4760 0x7f643c1f9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.229+0000 7f6441638640 1 -- 172.21.15.18:0/1176909637 >> 172.21.15.18:0/1176909637 conn(0x7f643c0b78b0 msgr2=0x7f643c152db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.229+0000 7f6441638640 1 -- 172.21.15.18:0/1176909637 shutdown_connections 2024-09-21T07:11:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.229+0000 7f6441638640 1 -- 172.21.15.18:0/1176909637 wait complete. 2024-09-21T07:11:54.242 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:11:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.356+0000 7f5d74ed3640 1 -- 172.21.15.18:0/3782811404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d700d3580 msgr2=0x7f5d70162a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.356+0000 7f5d74ed3640 1 --2- 172.21.15.18:0/3782811404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d700d3580 0x7f5d70162a40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5d700d1fb0 tx=0x7f5d6802aa30 comp rx=0 tx=0).stop 2024-09-21T07:11:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.357+0000 7f5d74ed3640 1 -- 172.21.15.18:0/3782811404 shutdown_connections 2024-09-21T07:11:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.357+0000 7f5d74ed3640 1 --2- 172.21.15.18:0/3782811404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d700d3580 0x7f5d70162a40 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.357+0000 7f5d74ed3640 1 --2- 172.21.15.18:0/3782811404 >> v2:172.21.15.49:3300/0 conn(0x7f5d7015c520 0x7f5d700d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.357+0000 7f5d74ed3640 1 -- 172.21.15.18:0/3782811404 >> 172.21.15.18:0/3782811404 conn(0x7f5d70073f30 msgr2=0x7f5d700b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.357+0000 7f5d74ed3640 1 -- 172.21.15.18:0/3782811404 shutdown_connections 2024-09-21T07:11:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.357+0000 7f5d74ed3640 1 -- 172.21.15.18:0/3782811404 wait complete. 2024-09-21T07:11:54.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.358+0000 7f5d74ed3640 1 Processor -- start 2024-09-21T07:11:54.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.359+0000 7f5d74ed3640 1 -- start start 2024-09-21T07:11:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d74ed3640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5d700d3580 0x7f5d700b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d74ed3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d7015c520 0x7f5d700abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d74ed3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d7015ef50 0x7f5d700abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d74ed3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d700d1020 con 0x7f5d7015c520 2024-09-21T07:11:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d74ed3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5d70163380 con 0x7f5d7015ef50 2024-09-21T07:11:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d74ed3640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f5d700d11a0 con 0x7f5d700d3580 2024-09-21T07:11:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d6dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d7015c520 0x7f5d700abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d6dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d7015c520 0x7f5d700abaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38832/0 (socket says 172.21.15.18:38832) 2024-09-21T07:11:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d6dd9b640 1 -- 172.21.15.18:0/2456703034 learned_addr learned my addr 172.21.15.18:0/2456703034 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:11:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d6ed9d640 1 --2- 172.21.15.18:0/2456703034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d7015ef50 0x7f5d700abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d6e59c640 1 --2- 172.21.15.18:0/2456703034 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5d700d3580 0x7f5d700b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d6dd9b640 1 -- 172.21.15.18:0/2456703034 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5d700d3580 msgr2=0x7f5d700b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d6dd9b640 1 --2- 172.21.15.18:0/2456703034 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5d700d3580 0x7f5d700b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d6dd9b640 1 -- 172.21.15.18:0/2456703034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d7015ef50 msgr2=0x7f5d700abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d6dd9b640 1 --2- 172.21.15.18:0/2456703034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d7015ef50 0x7f5d700abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d6dd9b640 1 -- 172.21.15.18:0/2456703034 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d700ccc90 con 0x7f5d7015c520 2024-09-21T07:11:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d6ed9d640 1 --2- 172.21.15.18:0/2456703034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d7015ef50 0x7f5d700abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:11:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.360+0000 7f5d6dd9b640 1 --2- 172.21.15.18:0/2456703034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d7015c520 0x7f5d700abaa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400c970 tx=0x7f5d6400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.361+0000 7f5d5effd640 1 -- 172.21.15.18:0/2456703034 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64007bb0 con 0x7f5d7015c520 2024-09-21T07:11:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.361+0000 7f5d5effd640 1 -- 172.21.15.18:0/2456703034 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d64007d50 con 0x7f5d7015c520 2024-09-21T07:11:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.361+0000 7f5d74ed3640 1 -- 172.21.15.18:0/2456703034 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d700ccf70 con 0x7f5d7015c520 2024-09-21T07:11:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.361+0000 7f5d5effd640 1 -- 172.21.15.18:0/2456703034 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64005290 con 0x7f5d7015c520 2024-09-21T07:11:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.361+0000 7f5d74ed3640 1 -- 172.21.15.18:0/2456703034 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d700ab580 con 0x7f5d7015c520 2024-09-21T07:11:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.362+0000 7f5d74ed3640 1 -- 172.21.15.18:0/2456703034 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d700cca00 con 0x7f5d7015c520 2024-09-21T07:11:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.362+0000 7f5d5effd640 1 -- 172.21.15.18:0/2456703034 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f5d64005430 con 0x7f5d7015c520 2024-09-21T07:11:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.363+0000 7f5d5effd640 1 --2- 172.21.15.18:0/2456703034 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5d50078d40 0x7f5d5007b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:11:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.363+0000 7f5d5effd640 1 -- 172.21.15.18:0/2456703034 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f5d6409b2c0 con 0x7f5d7015c520 2024-09-21T07:11:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.363+0000 7f5d6e59c640 1 --2- 172.21.15.18:0/2456703034 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5d50078d40 0x7f5d5007b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:11:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.364+0000 7f5d6e59c640 1 --2- 172.21.15.18:0/2456703034 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5d50078d40 0x7f5d5007b250 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5d60006fd0 tx=0x7f5d60008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:11:54.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.367+0000 7f5d5effd640 1 -- 172.21.15.18:0/2456703034 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5d64014070 con 0x7f5d7015c520 2024-09-21T07:11:54.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.551+0000 7f5d74ed3640 1 -- 172.21.15.18:0/2456703034 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d7006b490 con 0x7f5d50078d40 2024-09-21T07:11:54.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.552+0000 7f5d5effd640 1 -- 172.21.15.18:0/2456703034 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13335 (secure 0 0 0) 0x7f5d6000be30 con 0x7f5d50078d40 2024-09-21T07:11:54.554 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:11:54.554 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-21T07:11:54.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.554+0000 7f5d74ed3640 1 -- 172.21.15.18:0/2456703034 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5d50078d40 msgr2=0x7f5d5007b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:54.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.554+0000 7f5d74ed3640 1 --2- 172.21.15.18:0/2456703034 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5d50078d40 0x7f5d5007b250 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5d60006fd0 tx=0x7f5d60008040 comp rx=0 tx=0).stop 2024-09-21T07:11:54.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.554+0000 7f5d74ed3640 1 -- 172.21.15.18:0/2456703034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d7015c520 msgr2=0x7f5d700abaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:11:54.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.554+0000 7f5d74ed3640 1 --2- 172.21.15.18:0/2456703034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d7015c520 0x7f5d700abaa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400c970 tx=0x7f5d6400ce30 comp rx=0 tx=0).stop 2024-09-21T07:11:54.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.554+0000 7f5d74ed3640 1 -- 172.21.15.18:0/2456703034 shutdown_connections 2024-09-21T07:11:54.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.554+0000 7f5d74ed3640 1 --2- 172.21.15.18:0/2456703034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d7015ef50 0x7f5d700abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.554+0000 7f5d74ed3640 1 --2- 172.21.15.18:0/2456703034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d7015c520 0x7f5d700abaa0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.554+0000 7f5d74ed3640 1 --2- 172.21.15.18:0/2456703034 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f5d50078d40 0x7f5d5007b250 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.554+0000 7f5d74ed3640 1 --2- 172.21.15.18:0/2456703034 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f5d700d3580 0x7f5d700b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:11:54.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.554+0000 7f5d74ed3640 1 -- 172.21.15.18:0/2456703034 >> 172.21.15.18:0/2456703034 conn(0x7f5d70073f30 msgr2=0x7f5d700ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:11:54.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.555+0000 7f5d74ed3640 1 -- 172.21.15.18:0/2456703034 shutdown_connections 2024-09-21T07:11:54.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:11:54.555+0000 7f5d74ed3640 1 -- 172.21.15.18:0/2456703034 wait complete. 2024-09-21T07:11:54.567 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-21T07:11:54.330801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":270444,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754704276,"statfs":{"total":773094113280,"available":772817178624,"internally_reserved":0,"allocated":4366336,"data_stored":2412416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.531047"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":135,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T07:11:43.804157+0000","last_change":"2024-09-21T07:10:32.034091+0000","last_active":"2024-09-21T07:11:43.804157+0000","last_peered":"2024-09-21T07:11:43.804157+0000","last_clean":"2024-09-21T07:11:43.804157+0000","last_became_active":"2024-09-21T07:10:32.033005+0000","last_became_peered":"2024-09-21T07:10:32.033005+0000","last_unstale":"2024-09-21T07:11:43.804157+0000","last_undegraded":"2024-09-21T07:11:43.804157+0000","last_fullsized":"2024-09-21T07:11:43.804157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:10:31.011167+0000","last_clean_scrub_stamp":"2024-09-21T07:10:31.011167+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:10.064019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":991232,"data_stored":744328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35744,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336096,"statfs":{"total":96636764160,"available":96600162304,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35740,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336100,"statfs":{"total":96636764160,"available":96600166400,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35744,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336096,"statfs":{"total":96636764160,"available":96600162304,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":991232,"data_stored":744328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:11:54.570 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T07:10:31.011167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=7, tm_min=10, tm_sec=31, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=7, tm_min=11, tm_sec=49, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T07:11:54.570 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T07:12:11.451 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:12:11.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:12:14.570 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:12:14.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.698+0000 7ff490d19640 1 -- 172.21.15.18:0/3043021454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff48c15db80 msgr2=0x7ff48c0b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:14.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.698+0000 7ff490d19640 1 --2- 172.21.15.18:0/3043021454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff48c15db80 0x7ff48c0b57e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff484005fd0 tx=0x7ff48402aa90 comp rx=0 tx=0).stop 2024-09-21T07:12:14.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.698+0000 7ff490d19640 1 -- 172.21.15.18:0/3043021454 shutdown_connections 2024-09-21T07:12:14.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.698+0000 7ff490d19640 1 --2- 172.21.15.18:0/3043021454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff48c15db80 0x7ff48c0b57e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:14.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.698+0000 7ff490d19640 1 --2- 172.21.15.18:0/3043021454 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff48c0b4760 0x7ff48c153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:14.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.698+0000 7ff490d19640 1 -- 172.21.15.18:0/3043021454 >> 172.21.15.18:0/3043021454 conn(0x7ff48c0b78b0 msgr2=0x7ff48c0b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:14.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.698+0000 7ff490d19640 1 -- 172.21.15.18:0/3043021454 shutdown_connections 2024-09-21T07:12:14.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.699+0000 7ff490d19640 1 -- 172.21.15.18:0/3043021454 wait complete. 2024-09-21T07:12:14.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.700+0000 7ff490d19640 1 Processor -- start 2024-09-21T07:12:14.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.701+0000 7ff490d19640 1 -- start start 2024-09-21T07:12:14.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff490d19640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff48c0b4760 0x7ff48c1f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:14.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff490d19640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c15d060 0x7ff48c144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:14.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff490d19640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff48c15db80 0x7ff48c1f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:14.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff490d19640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c0b61f0 con 0x7ff48c15db80 2024-09-21T07:12:14.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff490d19640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c0b6070 con 0x7ff48c15d060 2024-09-21T07:12:14.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff490d19640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7ff48c0b6370 con 0x7ff48c0b4760 2024-09-21T07:12:14.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff48ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff48c15db80 0x7ff48c1f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:14.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff48ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff48c15db80 0x7ff48c1f4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59510/0 (socket says 172.21.15.18:59510) 2024-09-21T07:12:14.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff48ad9d640 1 -- 172.21.15.18:0/1947405234 learned_addr learned my addr 172.21.15.18:0/1947405234 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:12:14.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff48a59c640 1 --2- 172.21.15.18:0/1947405234 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff48c0b4760 0x7ff48c1f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:14.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff489d9b640 1 --2- 172.21.15.18:0/1947405234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c15d060 0x7ff48c144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:14.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff48ad9d640 1 -- 172.21.15.18:0/1947405234 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff48c0b4760 msgr2=0x7ff48c1f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:14.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff48ad9d640 1 --2- 172.21.15.18:0/1947405234 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff48c0b4760 0x7ff48c1f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:14.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff48ad9d640 1 -- 172.21.15.18:0/1947405234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c15d060 msgr2=0x7ff48c144f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:14.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff48ad9d640 1 --2- 172.21.15.18:0/1947405234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c15d060 0x7ff48c144f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:14.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff48ad9d640 1 -- 172.21.15.18:0/1947405234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c1f7d30 con 0x7ff48c15db80 2024-09-21T07:12:14.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.702+0000 7ff489d9b640 1 --2- 172.21.15.18:0/1947405234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c15d060 0x7ff48c144f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:14.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.703+0000 7ff48ad9d640 1 --2- 172.21.15.18:0/1947405234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff48c15db80 0x7ff48c1f4d50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff484009d90 tx=0x7ff484003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:14.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.703+0000 7ff47affd640 1 -- 172.21.15.18:0/1947405234 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484044070 con 0x7ff48c15db80 2024-09-21T07:12:14.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.703+0000 7ff47affd640 1 -- 172.21.15.18:0/1947405234 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff48402e7f0 con 0x7ff48c15db80 2024-09-21T07:12:14.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.703+0000 7ff490d19640 1 -- 172.21.15.18:0/1947405234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48c1f8010 con 0x7ff48c15db80 2024-09-21T07:12:14.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.703+0000 7ff47affd640 1 -- 172.21.15.18:0/1947405234 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4840044b0 con 0x7ff48c15db80 2024-09-21T07:12:14.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.703+0000 7ff490d19640 1 -- 172.21.15.18:0/1947405234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff48c1f3f80 con 0x7ff48c15db80 2024-09-21T07:12:14.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.704+0000 7ff490d19640 1 -- 172.21.15.18:0/1947405234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff48c0b6820 con 0x7ff48c15db80 2024-09-21T07:12:14.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.705+0000 7ff47affd640 1 -- 172.21.15.18:0/1947405234 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7ff484047070 con 0x7ff48c15db80 2024-09-21T07:12:14.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.705+0000 7ff47affd640 1 --2- 172.21.15.18:0/1947405234 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff46c078d40 0x7ff46c07b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:14.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.705+0000 7ff47affd640 1 -- 172.21.15.18:0/1947405234 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7ff4840bbd10 con 0x7ff48c15db80 2024-09-21T07:12:14.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.705+0000 7ff48a59c640 1 --2- 172.21.15.18:0/1947405234 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff46c078d40 0x7ff46c07b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:14.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.706+0000 7ff48a59c640 1 --2- 172.21.15.18:0/1947405234 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff46c078d40 0x7ff46c07b250 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00bb50 tx=0x7ff47c00b2e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:14.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.710+0000 7ff47affd640 1 -- 172.21.15.18:0/1947405234 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff484032030 con 0x7ff48c15db80 2024-09-21T07:12:14.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.897+0000 7ff490d19640 1 -- 172.21.15.18:0/1947405234 --> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff48c06b490 con 0x7ff46c078d40 2024-09-21T07:12:14.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.898+0000 7ff47affd640 1 -- 172.21.15.18:0/1947405234 <== mgr.4114 v2:172.21.15.49:6800/1123180713 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13339 (secure 0 0 0) 0x7ff47c010bd0 con 0x7ff46c078d40 2024-09-21T07:12:14.901 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:12:14.901 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-21T07:12:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.900+0000 7ff490d19640 1 -- 172.21.15.18:0/1947405234 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff46c078d40 msgr2=0x7ff46c07b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.900+0000 7ff490d19640 1 --2- 172.21.15.18:0/1947405234 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff46c078d40 0x7ff46c07b250 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00bb50 tx=0x7ff47c00b2e0 comp rx=0 tx=0).stop 2024-09-21T07:12:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.900+0000 7ff490d19640 1 -- 172.21.15.18:0/1947405234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff48c15db80 msgr2=0x7ff48c1f4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.900+0000 7ff490d19640 1 --2- 172.21.15.18:0/1947405234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff48c15db80 0x7ff48c1f4d50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff484009d90 tx=0x7ff484003f10 comp rx=0 tx=0).stop 2024-09-21T07:12:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.900+0000 7ff490d19640 1 -- 172.21.15.18:0/1947405234 shutdown_connections 2024-09-21T07:12:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.900+0000 7ff490d19640 1 --2- 172.21.15.18:0/1947405234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff48c15db80 0x7ff48c1f4d50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.900+0000 7ff490d19640 1 --2- 172.21.15.18:0/1947405234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c15d060 0x7ff48c144f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.900+0000 7ff490d19640 1 --2- 172.21.15.18:0/1947405234 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff46c078d40 0x7ff46c07b250 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.900+0000 7ff490d19640 1 --2- 172.21.15.18:0/1947405234 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff48c0b4760 0x7ff48c1f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.900+0000 7ff490d19640 1 -- 172.21.15.18:0/1947405234 >> 172.21.15.18:0/1947405234 conn(0x7ff48c0b78b0 msgr2=0x7ff48c0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.900+0000 7ff490d19640 1 -- 172.21.15.18:0/1947405234 shutdown_connections 2024-09-21T07:12:14.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:14.900+0000 7ff490d19640 1 -- 172.21.15.18:0/1947405234 wait complete. 2024-09-21T07:12:14.914 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-09-21T07:12:14.335371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":270428,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754704292,"statfs":{"total":773094113280,"available":772817195008,"internally_reserved":0,"allocated":4366336,"data_stored":2412416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002770"},"pg_stats":[{"pgid":"1.0","version":"35'74","reported_seq":145,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T07:11:54.323173+0000","last_change":"2024-09-21T07:11:54.323173+0000","last_active":"2024-09-21T07:11:54.323173+0000","last_peered":"2024-09-21T07:11:54.323173+0000","last_clean":"2024-09-21T07:11:54.323173+0000","last_became_active":"2024-09-21T07:10:32.033005+0000","last_became_peered":"2024-09-21T07:10:32.033005+0000","last_unstale":"2024-09-21T07:11:54.323173+0000","last_undegraded":"2024-09-21T07:11:54.323173+0000","last_fullsized":"2024-09-21T07:11:54.323173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'74","last_scrub_stamp":"2024-09-21T07:11:54.323063+0000","last_deep_scrub":"35'74","last_deep_scrub_stamp":"2024-09-21T07:11:54.323063+0000","last_clean_scrub_stamp":"2024-09-21T07:11:54.323063+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:36.902454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":991232,"data_stored":744328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35744,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336096,"statfs":{"total":96636764160,"available":96600162304,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35740,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336100,"statfs":{"total":96636764160,"available":96600166400,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35744,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336096,"statfs":{"total":96636764160,"available":96600162304,"internally_reserved":0,"allocated":397312,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335528,"statfs":{"total":96636764160,"available":96599580672,"internally_reserved":0,"allocated":991232,"data_stored":744328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:12:14.915 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-21T07:12:15.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.028+0000 7f306fbf9640 1 -- 172.21.15.18:0/326901813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f306806f850 msgr2=0x7f306815ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.028+0000 7f306fbf9640 1 --2- 172.21.15.18:0/326901813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f306806f850 0x7f306815ea60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f305c009830 tx=0x7f305c02a510 comp rx=0 tx=0).stop 2024-09-21T07:12:15.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.028+0000 7f306fbf9640 1 -- 172.21.15.18:0/326901813 shutdown_connections 2024-09-21T07:12:15.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.028+0000 7f306fbf9640 1 --2- 172.21.15.18:0/326901813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f306806f850 0x7f306815ea60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.028+0000 7f306fbf9640 1 --2- 172.21.15.18:0/326901813 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f30680d0b20 0x7f30680ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.028+0000 7f306fbf9640 1 -- 172.21.15.18:0/326901813 >> 172.21.15.18:0/326901813 conn(0x7f30680b1fe0 msgr2=0x7f30680b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:15.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.028+0000 7f306fbf9640 1 -- 172.21.15.18:0/326901813 shutdown_connections 2024-09-21T07:12:15.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.028+0000 7f306fbf9640 1 -- 172.21.15.18:0/326901813 wait complete. 2024-09-21T07:12:15.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.030+0000 7f306fbf9640 1 Processor -- start 2024-09-21T07:12:15.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.030+0000 7f306fbf9640 1 -- start start 2024-09-21T07:12:15.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.031+0000 7f306fbf9640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f306806f850 0x7f30681f97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.031+0000 7f306fbf9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30680d0b20 0x7f3068159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.031+0000 7f306fbf9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306815efa0 0x7f306806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.031+0000 7f306fbf9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f306815bb80 con 0x7f30680d0b20 2024-09-21T07:12:15.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.031+0000 7f306fbf9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f306815f600 con 0x7f306815efa0 2024-09-21T07:12:15.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.031+0000 7f306fbf9640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7f306815bd00 con 0x7f306806f850 2024-09-21T07:12:15.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.031+0000 7f306d194640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30680d0b20 0x7f3068159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.031+0000 7f306d194640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30680d0b20 0x7f3068159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59526/0 (socket says 172.21.15.18:59526) 2024-09-21T07:12:15.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.031+0000 7f306d194640 1 -- 172.21.15.18:0/2586372549 learned_addr learned my addr 172.21.15.18:0/2586372549 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:12:15.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.031+0000 7f306d995640 1 --2- 172.21.15.18:0/2586372549 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f306806f850 0x7f30681f97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.032+0000 7f306e196640 1 --2- 172.21.15.18:0/2586372549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306815efa0 0x7f306806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.032+0000 7f306d194640 1 -- 172.21.15.18:0/2586372549 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f306806f850 msgr2=0x7f30681f97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.032+0000 7f306d194640 1 --2- 172.21.15.18:0/2586372549 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f306806f850 0x7f30681f97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.032+0000 7f306d194640 1 -- 172.21.15.18:0/2586372549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306815efa0 msgr2=0x7f306806e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.032+0000 7f306d194640 1 --2- 172.21.15.18:0/2586372549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306815efa0 0x7f306806e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.032+0000 7f306d194640 1 -- 172.21.15.18:0/2586372549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30680b05b0 con 0x7f30680d0b20 2024-09-21T07:12:15.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.032+0000 7f306e196640 1 --2- 172.21.15.18:0/2586372549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306815efa0 0x7f306806e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:12:15.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.032+0000 7f306d194640 1 --2- 172.21.15.18:0/2586372549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30680d0b20 0x7f3068159c40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f305c02ab00 tx=0x7f305c033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:15.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.032+0000 7f30667fc640 1 -- 172.21.15.18:0/2586372549 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c005c90 con 0x7f30680d0b20 2024-09-21T07:12:15.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.032+0000 7f30667fc640 1 -- 172.21.15.18:0/2586372549 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f305c031e50 con 0x7f30680d0b20 2024-09-21T07:12:15.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.032+0000 7f306fbf9640 1 -- 172.21.15.18:0/2586372549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30681f9d30 con 0x7f30680d0b20 2024-09-21T07:12:15.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.032+0000 7f30667fc640 1 -- 172.21.15.18:0/2586372549 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c005260 con 0x7f30680d0b20 2024-09-21T07:12:15.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.032+0000 7f306fbf9640 1 -- 172.21.15.18:0/2586372549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30680b0b70 con 0x7f30680d0b20 2024-09-21T07:12:15.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.033+0000 7f306fbf9640 1 -- 172.21.15.18:0/2586372549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f306815c180 con 0x7f30680d0b20 2024-09-21T07:12:15.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.034+0000 7f30667fc640 1 -- 172.21.15.18:0/2586372549 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f305c005400 con 0x7f30680d0b20 2024-09-21T07:12:15.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.034+0000 7f30667fc640 1 --2- 172.21.15.18:0/2586372549 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3054078d70 0x7f305407b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.035+0000 7f30667fc640 1 -- 172.21.15.18:0/2586372549 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f305c0bbf50 con 0x7f30680d0b20 2024-09-21T07:12:15.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.035+0000 7f306d995640 1 --2- 172.21.15.18:0/2586372549 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3054078d70 0x7f305407b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.035+0000 7f306d995640 1 --2- 172.21.15.18:0/2586372549 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3054078d70 0x7f305407b280 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3068071990 tx=0x7f30580095d0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:15.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.039+0000 7f30667fc640 1 -- 172.21.15.18:0/2586372549 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f305c03f030 con 0x7f30680d0b20 2024-09-21T07:12:15.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.227+0000 7f306fbf9640 1 -- 172.21.15.18:0/2586372549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f30680b02d0 con 0x7f30680d0b20 2024-09-21T07:12:15.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.231+0000 7f30667fc640 1 -- 172.21.15.18:0/2586372549 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v34)=0 v34) ==== 123+0+0 (secure 0 0 0) 0x7f305c083d40 con 0x7f30680d0b20 2024-09-21T07:12:15.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.232+0000 7f30667fc640 1 -- 172.21.15.18:0/2586372549 <== mon.0 v2:172.21.15.18:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f305c083850 con 0x7f30680d0b20 2024-09-21T07:12:15.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.234+0000 7f306fbf9640 1 -- 172.21.15.18:0/2586372549 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3054078d70 msgr2=0x7f305407b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.234+0000 7f306fbf9640 1 --2- 172.21.15.18:0/2586372549 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3054078d70 0x7f305407b280 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3068071990 tx=0x7f30580095d0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.234+0000 7f306fbf9640 1 -- 172.21.15.18:0/2586372549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30680d0b20 msgr2=0x7f3068159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.234+0000 7f306fbf9640 1 --2- 172.21.15.18:0/2586372549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30680d0b20 0x7f3068159c40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f305c02ab00 tx=0x7f305c033c90 comp rx=0 tx=0).stop 2024-09-21T07:12:15.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.234+0000 7f306fbf9640 1 -- 172.21.15.18:0/2586372549 shutdown_connections 2024-09-21T07:12:15.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.234+0000 7f306fbf9640 1 --2- 172.21.15.18:0/2586372549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306815efa0 0x7f306806e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.234+0000 7f306fbf9640 1 --2- 172.21.15.18:0/2586372549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30680d0b20 0x7f3068159c40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.234+0000 7f306fbf9640 1 --2- 172.21.15.18:0/2586372549 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7f3054078d70 0x7f305407b280 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.234+0000 7f306fbf9640 1 --2- 172.21.15.18:0/2586372549 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7f306806f850 0x7f30681f97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.234+0000 7f306fbf9640 1 -- 172.21.15.18:0/2586372549 >> 172.21.15.18:0/2586372549 conn(0x7f30680b1fe0 msgr2=0x7f30680b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:15.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.234+0000 7f306fbf9640 1 -- 172.21.15.18:0/2586372549 shutdown_connections 2024-09-21T07:12:15.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.234+0000 7f306fbf9640 1 -- 172.21.15.18:0/2586372549 wait complete. 2024-09-21T07:12:15.250 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:12:15.250 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:12:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.370+0000 7ff4129a1640 1 -- 172.21.15.18:0/4197669702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff40c15c520 msgr2=0x7ff40c0d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.370+0000 7ff4129a1640 1 --2- 172.21.15.18:0/4197669702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff40c15c520 0x7ff40c0d3040 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff400009820 tx=0x7ff40002a510 comp rx=0 tx=0).stop 2024-09-21T07:12:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.370+0000 7ff4129a1640 1 -- 172.21.15.18:0/4197669702 shutdown_connections 2024-09-21T07:12:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.370+0000 7ff4129a1640 1 --2- 172.21.15.18:0/4197669702 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff40c0d3580 0x7ff40c162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.370+0000 7ff4129a1640 1 --2- 172.21.15.18:0/4197669702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff40c15c520 0x7ff40c0d3040 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.370+0000 7ff4129a1640 1 -- 172.21.15.18:0/4197669702 >> 172.21.15.18:0/4197669702 conn(0x7ff40c073f30 msgr2=0x7ff40c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.370+0000 7ff4129a1640 1 -- 172.21.15.18:0/4197669702 shutdown_connections 2024-09-21T07:12:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.370+0000 7ff4129a1640 1 -- 172.21.15.18:0/4197669702 wait complete. 2024-09-21T07:12:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.372+0000 7ff4129a1640 1 Processor -- start 2024-09-21T07:12:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.372+0000 7ff4129a1640 1 -- start start 2024-09-21T07:12:15.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.373+0000 7ff4129a1640 1 --2- >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff40c0d3580 0x7ff40c14d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.373+0000 7ff4129a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40c15c520 0x7ff40c0cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.373+0000 7ff4129a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff40c15ef50 0x7ff40c0ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.373+0000 7ff4129a1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c0d11a0 con 0x7ff40c15c520 2024-09-21T07:12:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.373+0000 7ff4129a1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c0d1020 con 0x7ff40c15ef50 2024-09-21T07:12:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.373+0000 7ff4129a1640 1 -- --> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] -- mon_getmap magic: 0 -- 0x7ff40c0d1320 con 0x7ff40c0d3580 2024-09-21T07:12:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.373+0000 7ff40b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40c15c520 0x7ff40c0cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.373+0000 7ff40b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40c15c520 0x7ff40c0cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59540/0 (socket says 172.21.15.18:59540) 2024-09-21T07:12:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.373+0000 7ff40b7fe640 1 -- 172.21.15.18:0/1247205349 learned_addr learned my addr 172.21.15.18:0/1247205349 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T07:12:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.374+0000 7ff40bfff640 1 --2- 172.21.15.18:0/1247205349 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff40c0d3580 0x7ff40c14d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.374+0000 7ff410f3e640 1 --2- 172.21.15.18:0/1247205349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff40c15ef50 0x7ff40c0ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.374+0000 7ff40b7fe640 1 -- 172.21.15.18:0/1247205349 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff40c0d3580 msgr2=0x7ff40c14d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.374+0000 7ff40b7fe640 1 --2- 172.21.15.18:0/1247205349 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff40c0d3580 0x7ff40c14d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.374+0000 7ff40b7fe640 1 -- 172.21.15.18:0/1247205349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff40c15ef50 msgr2=0x7ff40c0ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.374+0000 7ff40b7fe640 1 --2- 172.21.15.18:0/1247205349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff40c15ef50 0x7ff40c0ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.374+0000 7ff40b7fe640 1 -- 172.21.15.18:0/1247205349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40c0abc00 con 0x7ff40c15c520 2024-09-21T07:12:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.374+0000 7ff40b7fe640 1 --2- 172.21.15.18:0/1247205349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40c15c520 0x7ff40c0cec00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff400009910 tx=0x7ff4000052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.374+0000 7ff408ff9640 1 -- 172.21.15.18:0/1247205349 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40003f070 con 0x7ff40c15c520 2024-09-21T07:12:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.374+0000 7ff408ff9640 1 -- 172.21.15.18:0/1247205349 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7ff400031d70 con 0x7ff40c15c520 2024-09-21T07:12:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.374+0000 7ff408ff9640 1 -- 172.21.15.18:0/1247205349 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff400005c30 con 0x7ff40c15c520 2024-09-21T07:12:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.374+0000 7ff4129a1640 1 -- 172.21.15.18:0/1247205349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40c0abee0 con 0x7ff40c15c520 2024-09-21T07:12:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.374+0000 7ff4129a1640 1 -- 172.21.15.18:0/1247205349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff40c14cb70 con 0x7ff40c15c520 2024-09-21T07:12:15.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.375+0000 7ff4129a1640 1 -- 172.21.15.18:0/1247205349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff40c0d1900 con 0x7ff40c15c520 2024-09-21T07:12:15.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.376+0000 7ff408ff9640 1 -- 172.21.15.18:0/1247205349 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7ff400042070 con 0x7ff40c15c520 2024-09-21T07:12:15.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.377+0000 7ff408ff9640 1 --2- 172.21.15.18:0/1247205349 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff3f8078d40 0x7ff3f807b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:12:15.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.377+0000 7ff408ff9640 1 -- 172.21.15.18:0/1247205349 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7ff4000bbba0 con 0x7ff40c15c520 2024-09-21T07:12:15.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.377+0000 7ff40bfff640 1 --2- 172.21.15.18:0/1247205349 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff3f8078d40 0x7ff3f807b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:12:15.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.378+0000 7ff40bfff640 1 --2- 172.21.15.18:0/1247205349 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff3f8078d40 0x7ff3f807b250 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc007fd0 tx=0x7ff3fc001370 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:12:15.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.382+0000 7ff408ff9640 1 -- 172.21.15.18:0/1247205349 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff400083900 con 0x7ff40c15c520 2024-09-21T07:12:15.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.608+0000 7ff4129a1640 1 -- 172.21.15.18:0/1247205349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff40c0b3c90 con 0x7ff40c15c520 2024-09-21T07:12:15.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.608+0000 7ff408ff9640 1 -- 172.21.15.18:0/1247205349 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3908 (secure 0 0 0) 0x7ff400088330 con 0x7ff40c15c520 2024-09-21T07:12:15.611 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T07:12:15.611 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":20,"btime":"2024-09-21T07:11:41:794505+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/492466681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":492466681},{"type":"v1","addr":"172.21.15.18:6834","nonce":492466681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4777,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/2411496903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2411496903},{"type":"v1","addr":"172.21.15.18:6835","nonce":2411496903}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4780,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6836/2997359476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2997359476},{"type":"v1","addr":"172.21.15.49:6836","nonce":2997359476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5056,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/4089003804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6835","nonce":4089003804},{"type":"v1","addr":"172.21.15.49:6837","nonce":4089003804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-09-21T07:12:15.611 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 20 2024-09-21T07:12:15.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.611+0000 7ff4129a1640 1 -- 172.21.15.18:0/1247205349 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff3f8078d40 msgr2=0x7ff3f807b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.611+0000 7ff4129a1640 1 --2- 172.21.15.18:0/1247205349 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff3f8078d40 0x7ff3f807b250 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc007fd0 tx=0x7ff3fc001370 comp rx=0 tx=0).stop 2024-09-21T07:12:15.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.611+0000 7ff4129a1640 1 -- 172.21.15.18:0/1247205349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40c15c520 msgr2=0x7ff40c0cec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:12:15.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.611+0000 7ff4129a1640 1 --2- 172.21.15.18:0/1247205349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40c15c520 0x7ff40c0cec00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff400009910 tx=0x7ff4000052f0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.611+0000 7ff4129a1640 1 -- 172.21.15.18:0/1247205349 shutdown_connections 2024-09-21T07:12:15.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.611+0000 7ff4129a1640 1 --2- 172.21.15.18:0/1247205349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff40c15ef50 0x7ff40c0ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.611+0000 7ff4129a1640 1 --2- 172.21.15.18:0/1247205349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40c15c520 0x7ff40c0cec00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.611+0000 7ff4129a1640 1 --2- 172.21.15.18:0/1247205349 >> [v2:172.21.15.49:6800/1123180713,v1:172.21.15.49:6801/1123180713] conn(0x7ff3f8078d40 0x7ff3f807b250 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.611+0000 7ff4129a1640 1 --2- 172.21.15.18:0/1247205349 >> [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] conn(0x7ff40c0d3580 0x7ff40c14d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:12:15.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.611+0000 7ff4129a1640 1 -- 172.21.15.18:0/1247205349 >> 172.21.15.18:0/1247205349 conn(0x7ff40c073f30 msgr2=0x7ff40c15cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:12:15.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.611+0000 7ff4129a1640 1 -- 172.21.15.18:0/1247205349 shutdown_connections 2024-09-21T07:12:15.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T07:12:15.611+0000 7ff4129a1640 1 -- 172.21.15.18:0/1247205349 wait complete. 2024-09-21T07:12:15.625 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-21T07:12:15.625 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T07:12:15.625 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:12:15.625 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:15.634 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:12:15.634 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:12:15.634 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:15.684 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:12:15.684 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:12:15.684 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:15.697 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:12:15.697 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:12:15.697 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:15.753 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:12:15.753 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T07:12:15.753 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-21T07:12:15.753 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:15.783 INFO:tasks.ceph.osd.0:Stopped 2024-09-21T07:12:15.784 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-21T07:12:15.784 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:15.851 INFO:tasks.ceph.osd.1:Stopped 2024-09-21T07:12:15.851 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-21T07:12:15.851 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:15.921 INFO:tasks.ceph.osd.2:Stopped 2024-09-21T07:12:15.922 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T07:12:15.922 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:15.994 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T07:12:15.994 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-21T07:12:15.994 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:16.031 INFO:tasks.ceph.osd.4:Stopped 2024-09-21T07:12:16.031 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-21T07:12:16.031 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:16.105 INFO:tasks.ceph.osd.5:Stopped 2024-09-21T07:12:16.105 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-21T07:12:16.106 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:16.173 INFO:tasks.ceph.osd.6:Stopped 2024-09-21T07:12:16.173 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-21T07:12:16.173 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:16.246 INFO:tasks.ceph.osd.7:Stopped 2024-09-21T07:12:16.247 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T07:12:16.247 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-21T07:12:16.247 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:16.275 INFO:tasks.ceph.mgr.y:Stopped 2024-09-21T07:12:16.275 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-21T07:12:16.275 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:16.318 INFO:tasks.ceph.mgr.x:Stopped 2024-09-21T07:12:16.318 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T07:12:16.319 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T07:12:16.319 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:16.330 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T07:12:16.331 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-21T07:12:16.331 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:16.372 INFO:tasks.ceph.mon.b:Stopped 2024-09-21T07:12:16.372 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T07:12:16.372 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:12:16.425 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T07:12:16.425 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T07:12:16.425 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-21T07:12:16.464 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T07:12:16.464 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-21T07:12:16.668 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T07:12:16.668 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-21T07:12:16.755 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T07:12:16.755 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-21T07:12:16.821 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T07:12:16.821 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-21T07:12:16.881 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T07:12:16.881 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-21T07:12:17.028 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T07:12:17.029 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-21T07:12:17.099 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T07:12:17.100 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-21T07:12:17.157 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T07:12:17.157 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-21T07:12:17.215 INFO:tasks.ceph:Archiving mon data... 2024-09-21T07:12:17.217 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913583/data/mon.a.tgz 2024-09-21T07:12:17.217 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-21T07:12:17.233 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.RbMXZgqHUb 2024-09-21T07:12:17.233 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.RbMXZgqHUb 2024-09-21T07:12:17.387 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.RbMXZgqHUb 2024-09-21T07:12:17.472 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.RbMXZgqHUb is 366KB 2024-09-21T07:12:17.570 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.RbMXZgqHUb 2024-09-21T07:12:17.586 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913583/data/mon.b.tgz 2024-09-21T07:12:17.586 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-09-21T07:12:17.606 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.fwgcSiq8dd 2024-09-21T07:12:17.606 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.fwgcSiq8dd 2024-09-21T07:12:17.779 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.fwgcSiq8dd 2024-09-21T07:12:17.864 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.fwgcSiq8dd is 504KB 2024-09-21T07:12:17.960 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.fwgcSiq8dd 2024-09-21T07:12:17.976 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913583/data/mon.c.tgz 2024-09-21T07:12:17.976 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-09-21T07:12:18.031 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.QsLb5ZWNFJ 2024-09-21T07:12:18.031 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.QsLb5ZWNFJ 2024-09-21T07:12:18.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.QsLb5ZWNFJ 2024-09-21T07:12:18.268 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.QsLb5ZWNFJ is 504KB 2024-09-21T07:12:18.368 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.QsLb5ZWNFJ 2024-09-21T07:12:18.383 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T07:12:18.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T07:12:18.386 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T07:12:18.473 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T07:12:18.503 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T07:12:18.504 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T07:12:18.505 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913583/remote/smithi018/crash 2024-09-21T07:12:18.506 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T07:12:18.543 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913583/remote/smithi049/crash 2024-09-21T07:12:18.544 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T07:12:18.569 INFO:tasks.ceph:Shutting down logrotate 2024-09-21T07:12:18.570 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:12:18.585 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:12:18.661 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T07:12:18.689 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T07:12:18.715 INFO:tasks.ceph:Compressing logs... 2024-09-21T07:12:18.715 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T07:12:18.732 DEBUG:teuthology.orchestra.run.smithi049:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T07:12:18.755 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-21T07:12:18.756 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37145.log 2024-09-21T07:12:18.797 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36601.log 2024-09-21T07:12:18.797 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-21T07:12:18.797 INFO:teuthology.orchestra.run.smithi049.stderr:gzip/var/log/ceph/ceph-client.admin.36601.log: -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-21T07:12:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36561.log 2024-09-21T07:12:18.798 INFO:teuthology.orchestra.run.smithi049.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36601.log.gz 2024-09-21T07:12:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42225.log 2024-09-21T07:12:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36561.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-21T07:12:18.798 INFO:teuthology.orchestra.run.smithi049.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36561.log.gz 2024-09-21T07:12:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.1.42225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42225.log.gz 2024-09-21T07:12:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T07:12:18.798 INFO:teuthology.orchestra.run.smithi049.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-21T07:12:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36641.log 2024-09-21T07:12:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36681.log 2024-09-21T07:12:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36641.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-21T07:12:18.798 INFO:teuthology.orchestra.run.smithi049.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36641.log.gz 2024-09-21T07:12:18.798 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36841.log 2024-09-21T07:12:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mon.c.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36681.log.gz 2024-09-21T07:12:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43200.log 2024-09-21T07:12:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36721.log 2024-09-21T07:12:18.799 INFO:teuthology.orchestra.run.smithi049.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36841.log.gz 2024-09-21T07:12:18.799 INFO:teuthology.orchestra.run.smithi049.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T07:12:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36761.log/var/log/ceph/ceph-client.1.43200.log: 2024-09-21T07:12:18.799 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43200.log.gz 2024-09-21T07:12:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:gzip/var/log/ceph/ceph-client.admin.36721.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36801.log 2024-09-21T07:12:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36761.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36721.log.gz 2024-09-21T07:12:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-21T07:12:18.799 INFO:teuthology.orchestra.run.smithi049.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36761.log.gz 2024-09-21T07:12:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36801.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-21T07:12:18.799 INFO:teuthology.orchestra.run.smithi049.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36801.log.gz 2024-09-21T07:12:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T07:12:18.799 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-21T07:12:18.800 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-21T07:12:18.800 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-21T07:12:18.800 INFO:teuthology.orchestra.run.smithi049.stderr: 91.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T07:12:18.802 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42623.log 2024-09-21T07:12:18.814 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.3.42623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42623.log.gz 2024-09-21T07:12:18.850 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46426.log 2024-09-21T07:12:18.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43297.log 2024-09-21T07:12:18.851 INFO:teuthology.orchestra.run.smithi018.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.37145.log.gz 2024-09-21T07:12:18.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45376.log 2024-09-21T07:12:18.851 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46426.log.gz 2024-09-21T07:12:18.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36531.log 2024-09-21T07:12:18.851 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43297.log.gz 2024-09-21T07:12:18.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45645.log 2024-09-21T07:12:18.851 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45376.log.gz 2024-09-21T07:12:18.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45855.log 2024-09-21T07:12:18.851 INFO:teuthology.orchestra.run.smithi018.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.36531.log.gz 2024-09-21T07:12:18.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36822.log 2024-09-21T07:12:18.851 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45645.log.gz 2024-09-21T07:12:18.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49363.log 2024-09-21T07:12:18.852 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45855.log.gz 2024-09-21T07:12:18.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47729.log 2024-09-21T07:12:18.852 INFO:teuthology.orchestra.run.smithi018.stderr: 76.1% -- replaced with /var/log/ceph/ceph-client.admin.36822.log.gz 2024-09-21T07:12:18.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43299.log 2024-09-21T07:12:18.852 INFO:teuthology.orchestra.run.smithi018.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49363.log.gz 2024-09-21T07:12:18.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48668.log 2024-09-21T07:12:18.852 INFO:teuthology.orchestra.run.smithi018.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.47729.log.gz 2024-09-21T07:12:18.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41990.log 2024-09-21T07:12:18.852 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43299.log.gz 2024-09-21T07:12:18.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42571.log 2024-09-21T07:12:18.852 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48668.log.gz 2024-09-21T07:12:18.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36927.log 2024-09-21T07:12:18.852 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41990.log.gz 2024-09-21T07:12:18.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42487.log 2024-09-21T07:12:18.853 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42571.log.gz 2024-09-21T07:12:18.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36884.log 2024-09-21T07:12:18.853 INFO:teuthology.orchestra.run.smithi018.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36927.log.gz 2024-09-21T07:12:18.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46766.log 2024-09-21T07:12:18.853 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42487.log.gz 2024-09-21T07:12:18.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42963.log 2024-09-21T07:12:18.853 INFO:teuthology.orchestra.run.smithi018.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36884.log.gz 2024-09-21T07:12:18.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43298.log 2024-09-21T07:12:18.853 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46766.log.gz 2024-09-21T07:12:18.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36447.log 2024-09-21T07:12:18.854 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42963.log.gz 2024-09-21T07:12:18.854 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43747.log 2024-09-21T07:12:18.854 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43298.log.gz 2024-09-21T07:12:18.854 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36447.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-21T07:12:18.854 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36447.log.gz 2024-09-21T07:12:18.854 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45466.log 2024-09-21T07:12:18.854 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43747.log.gz 2024-09-21T07:12:18.854 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47519.log 2024-09-21T07:12:18.854 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49841.log 2024-09-21T07:12:18.854 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45466.log.gz 2024-09-21T07:12:18.854 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47435.log 2024-09-21T07:12:18.854 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47519.log.gz 2024-09-21T07:12:18.854 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46468.log 2024-09-21T07:12:18.854 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49841.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49841.log.gz 2024-09-21T07:12:18.855 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42781.log 2024-09-21T07:12:18.855 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49657.log 2024-09-21T07:12:18.855 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47435.log.gz 2024-09-21T07:12:18.855 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46468.log: /var/log/ceph/ceph-client.admin.42781.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46468.log.gz 2024-09-21T07:12:18.855 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46000.log 2024-09-21T07:12:18.855 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42781.log.gz 2024-09-21T07:12:18.855 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45543.log 2024-09-21T07:12:18.855 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49657.log: /var/log/ceph/ceph-client.admin.46000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45771.log 2024-09-21T07:12:18.855 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49657.log.gz 2024-09-21T07:12:18.855 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46000.log.gz 2024-09-21T07:12:18.855 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45813.log 2024-09-21T07:12:18.855 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45543.log.gz 2024-09-21T07:12:18.855 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46384.log 2024-09-21T07:12:18.855 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45771.log.gz 2024-09-21T07:12:18.856 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41906.log 2024-09-21T07:12:18.856 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44413.log 87.7% 2024-09-21T07:12:18.856 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45813.log.gz 2024-09-21T07:12:18.856 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46384.log: /var/log/ceph/ceph-client.admin.41906.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46384.log.gz 2024-09-21T07:12:18.856 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36559.log 2024-09-21T07:12:18.856 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41906.log.gz 2024-09-21T07:12:18.856 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42277.log 2024-09-21T07:12:18.856 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44413.log: /var/log/ceph/ceph-client.admin.36559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42655.log 2024-09-21T07:12:18.856 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36559.log.gz 2024-09-21T07:12:18.856 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44413.log.gz 2024-09-21T07:12:18.856 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49699.log 2024-09-21T07:12:18.856 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42655.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42277.log.gz 2024-09-21T07:12:18.856 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37133.log 2024-09-21T07:12:18.857 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42655.log.gz 2024-09-21T07:12:18.857 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47477.log 2024-09-21T07:12:18.857 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49699.log: /var/log/ceph/ceph-client.admin.37133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49069.log 2024-09-21T07:12:18.857 INFO:teuthology.orchestra.run.smithi018.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49699.log.gz 2024-09-21T07:12:18.857 INFO:teuthology.orchestra.run.smithi018.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.37133.log.gz 2024-09-21T07:12:18.857 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46510.log 2024-09-21T07:12:18.857 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47477.log.gz 2024-09-21T07:12:18.857 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44893.log 2024-09-21T07:12:18.857 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49069.log: /var/log/ceph/ceph-client.admin.46510.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49069.log.gz 2024-09-21T07:12:18.857 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46598.log 2024-09-21T07:12:18.857 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46510.log.gz 2024-09-21T07:12:18.857 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42189.log 2024-09-21T07:12:18.857 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44893.log: /var/log/ceph/ceph-client.admin.46598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43927.log 2024-09-21T07:12:18.857 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44893.log.gz 2024-09-21T07:12:18.858 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46598.log.gz 2024-09-21T07:12:18.858 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42613.log 2024-09-21T07:12:18.858 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42189.log.gz 2024-09-21T07:12:18.858 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44851.log 2024-09-21T07:12:18.858 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43927.log: /var/log/ceph/ceph-client.admin.42613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42231.log 2024-09-21T07:12:18.858 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43927.log.gz 2024-09-21T07:12:18.858 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42613.log.gz 2024-09-21T07:12:18.858 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37139.log 2024-09-21T07:12:18.858 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44851.log.gz 2024-09-21T07:12:18.858 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46554.log 2024-09-21T07:12:18.858 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42231.log.gz 2024-09-21T07:12:18.858 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42952.log 2024-09-21T07:12:18.858 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37139.log: /var/log/ceph/ceph-client.admin.46554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47561.log 2024-09-21T07:12:18.859 INFO:teuthology.orchestra.run.smithi018.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37139.log.gz 2024-09-21T07:12:18.859 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46554.log.gz 2024-09-21T07:12:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49405.log 2024-09-21T07:12:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46215.log 2024-09-21T07:12:18.859 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42952.log.gz 2024-09-21T07:12:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47561.log: /var/log/ceph/ceph-client.admin.49405.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47561.log.gz 2024-09-21T07:12:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T07:12:18.859 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49405.log.gz 2024-09-21T07:12:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43295.log 2024-09-21T07:12:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46215.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46640.log 2024-09-21T07:12:18.859 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46215.log.gz 2024-09-21T07:12:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49027.log 2024-09-21T07:12:18.859 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43295.log.gz 2024-09-21T07:12:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44277.log 2024-09-21T07:12:18.860 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36504.log 2024-09-21T07:12:18.860 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46640.log.gz 2024-09-21T07:12:18.860 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49027.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T07:12:18.860 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.44277.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49027.log.gz 2024-09-21T07:12:18.860 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37725.log 2024-09-21T07:12:18.860 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44277.log.gz 2024-09-21T07:12:18.860 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43705.log 2024-09-21T07:12:18.860 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36504.log.gz 2024-09-21T07:12:18.860 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.37725.log: /var/log/ceph/ceph-client.admin.42961.log 2024-09-21T07:12:18.860 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43705.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.37725.log.gz 2024-09-21T07:12:18.860 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46257.log 2024-09-21T07:12:18.860 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43705.log.gz 2024-09-21T07:12:18.860 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46342.log 2024-09-21T07:12:18.860 INFO:teuthology.orchestra.run.smithi018.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42961.log.gz 2024-09-21T07:12:18.861 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37430.log 2024-09-21T07:12:18.861 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46257.log: /var/log/ceph/ceph-client.admin.46342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43789.log 2024-09-21T07:12:18.861 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46257.log.gz 2024-09-21T07:12:18.861 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46342.log.gz 2024-09-21T07:12:18.861 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45897.log 2024-09-21T07:12:18.861 INFO:teuthology.orchestra.run.smithi018.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.37430.log.gz 2024-09-21T07:12:18.861 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46808.log 2024-09-21T07:12:18.861 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43789.log: /var/log/ceph/ceph-client.admin.45897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43579.log 2024-09-21T07:12:18.861 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45897.log.gz 2024-09-21T07:12:18.861 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45103.log 2024-09-21T07:12:18.861 INFO:teuthology.orchestra.run.smithi018.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43789.log.gz 2024-09-21T07:12:18.861 INFO:teuthology.orchestra.run.smithi018.stderr: 86.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.46808.log.gz 2024-09-21T07:12:18.861 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42962.log 2024-09-21T07:12:18.861 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43579.log: /var/log/ceph/ceph-client.admin.45103.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43579.log.gz 2024-09-21T07:12:18.862 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47855.log 2024-09-21T07:12:18.862 INFO:teuthology.orchestra.run.smithi018.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45103.log.gz 2024-09-21T07:12:18.862 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45061.log 2024-09-21T07:12:18.862 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42962.log: /var/log/ceph/ceph-client.admin.47855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37047.log 2024-09-21T07:12:18.862 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42962.log.gz 2024-09-21T07:12:18.862 INFO:teuthology.orchestra.run.smithi018.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47855.log.gz 2024-09-21T07:12:18.862 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42950.log 2024-09-21T07:12:18.862 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45061.log.gz 2024-09-21T07:12:18.862 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42403.log 2024-09-21T07:12:18.862 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37047.log: /var/log/ceph/ceph-client.admin.42950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42445.log 2024-09-21T07:12:18.862 INFO:teuthology.orchestra.run.smithi018.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.37047.log.gz 2024-09-21T07:12:18.862 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42950.log.gz 2024-09-21T07:12:18.862 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48356.log 2024-09-21T07:12:18.862 INFO:teuthology.orchestra.run.smithi018.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42403.log.gz 2024-09-21T07:12:18.863 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49531.log 2024-09-21T07:12:18.863 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48710.log 2024-09-21T07:12:18.863 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42445.log.gz 2024-09-21T07:12:18.863 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49531.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48356.log.gz 2024-09-21T07:12:18.863 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47393.log 2024-09-21T07:12:18.863 INFO:teuthology.orchestra.run.smithi018.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49531.log.gz 2024-09-21T07:12:18.863 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36588.log 2024-09-21T07:12:18.863 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48710.log.gz 2024-09-21T07:12:18.863 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48943.log 2024-09-21T07:12:18.863 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47393.log: /var/log/ceph/ceph-client.admin.36588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48046.log 2024-09-21T07:12:18.863 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47393.log.gz 2024-09-21T07:12:18.863 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36588.log.gz 2024-09-21T07:12:18.863 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48104.log 2024-09-21T07:12:18.863 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48943.log.gz 2024-09-21T07:12:18.863 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48046.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-21T07:12:18.864 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48046.log.gz 2024-09-21T07:12:18.864 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44935.log 2024-09-21T07:12:18.864 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48104.log.gz 2024-09-21T07:12:18.864 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43621.log 2024-09-21T07:12:18.864 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48584.log 2024-09-21T07:12:18.864 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44935.log: /var/log/ceph/ceph-client.admin.43621.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44935.log.gzgzip 2024-09-21T07:12:18.864 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37140.log 2024-09-21T07:12:18.864 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43621.log.gz 2024-09-21T07:12:18.864 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49801.log 2024-09-21T07:12:18.864 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1%/var/log/ceph/ceph-client.admin.37140.log: -- replaced with /var/log/ceph/ceph-client.admin.48584.log.gz 2024-09-21T07:12:18.864 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43537.log 2024-09-21T07:12:18.864 INFO:teuthology.orchestra.run.smithi018.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37140.log.gz 2024-09-21T07:12:18.864 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37144.log 2024-09-21T07:12:18.864 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49801.log.gz 2024-09-21T07:12:18.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49489.log 2024-09-21T07:12:18.865 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47968.log 2024-09-21T07:12:18.865 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43537.log.gz 2024-09-21T07:12:18.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37144.log: 85.8%/var/log/ceph/ceph-client.admin.49489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36989.log 2024-09-21T07:12:18.865 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37144.log.gz 2024-09-21T07:12:18.865 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49489.log.gz 2024-09-21T07:12:18.865 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37390.log 2024-09-21T07:12:18.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47968.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47968.log.gz 2024-09-21T07:12:18.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46682.log 2024-09-21T07:12:18.865 INFO:teuthology.orchestra.run.smithi018.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36989.log.gz 2024-09-21T07:12:18.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42739.log 2024-09-21T07:12:18.865 INFO:teuthology.orchestra.run.smithi018.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37390.log.gz 2024-09-21T07:12:18.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49237.log 2024-09-21T07:12:18.865 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46682.log.gz 2024-09-21T07:12:18.866 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46892.log 2024-09-21T07:12:18.866 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42739.log.gz 2024-09-21T07:12:18.866 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44717.log 2024-09-21T07:12:18.866 INFO:teuthology.orchestra.run.smithi018.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49237.log.gz 2024-09-21T07:12:18.866 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-21T07:12:18.866 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46892.log: /var/log/ceph/ceph-client.2.44717.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46892.log.gz 2024-09-21T07:12:18.866 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44717.log.gz 2024-09-21T07:12:18.866 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43292.log 2024-09-21T07:12:18.866 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43288.log 2024-09-21T07:12:18.866 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46089.log 2024-09-21T07:12:18.866 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43292.log.gz 2024-09-21T07:12:18.866 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47603.log 2024-09-21T07:12:18.866 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49883.log 2024-09-21T07:12:18.866 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46089.log: -- replaced with /var/log/ceph/ceph-client.admin.43288.log.gz 2024-09-21T07:12:18.867 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47603.log: gzip 87.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.46089.log.gz --verbose 2024-09-21T07:12:18.867 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.42955.log 2024-09-21T07:12:18.867 INFO:teuthology.orchestra.run.smithi018.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47603.log.gz 2024-09-21T07:12:18.867 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48985.log 2024-09-21T07:12:18.867 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49883.log: /var/log/ceph/ceph-client.admin.42955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36616.log 2024-09-21T07:12:18.867 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49883.log.gz 2024-09-21T07:12:18.867 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47813.log 2024-09-21T07:12:18.867 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42955.log.gz 2024-09-21T07:12:18.867 INFO:teuthology.orchestra.run.smithi018.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48985.log.gz 2024-09-21T07:12:18.867 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5/var/log/ceph/ceph-client.admin.36616.log: --verbose -- /var/log/ceph/ceph-client.admin.42529.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36616.log.gz 2024-09-21T07:12:18.867 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-21T07:12:18.867 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48500.log 2024-09-21T07:12:18.867 INFO:teuthology.orchestra.run.smithi018.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.47813.log.gz 2024-09-21T07:12:18.867 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47126.log 2024-09-21T07:12:18.868 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42529.log.gz 2024-09-21T07:12:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.48500.log: /var/log/ceph/ceph-client.admin.36754.log 2024-09-21T07:12:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47126.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48500.log.gz 2024-09-21T07:12:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47126.log.gz 2024-09-21T07:12:18.868 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48542.log 2024-09-21T07:12:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36754.log: gzip -5 75.8% -- replaced with /var/log/ceph/ceph-client.admin.36754.log.gz 2024-09-21T07:12:18.868 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-21T07:12:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48542.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48542.log.gz 2024-09-21T07:12:18.868 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49321.log 2024-09-21T07:12:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36655.log 2024-09-21T07:12:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42096.log 2024-09-21T07:12:18.868 INFO:teuthology.orchestra.run.smithi018.stderr: 87.0%/var/log/ceph/ceph-client.admin.36655.log: -- replaced with /var/log/ceph/ceph-client.admin.49321.log.gz 2024-09-21T07:12:18.868 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46976.log 2024-09-21T07:12:18.868 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36655.log.gz 2024-09-21T07:12:18.869 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48230.log 2024-09-21T07:12:18.869 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.42096.log.gz 2024-09-21T07:12:18.869 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43287.log 2024-09-21T07:12:18.869 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46976.log: /var/log/ceph/ceph-client.admin.48230.log: gzip 87.1% -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-21T07:12:18.869 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46976.log.gz 87.7% 2024-09-21T07:12:18.869 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48230.log.gz 2024-09-21T07:12:18.869 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49195.log 2024-09-21T07:12:18.869 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43287.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45187.log 2024-09-21T07:12:18.869 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49195.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43287.log.gz 2024-09-21T07:12:18.869 INFO:teuthology.orchestra.run.smithi018.stderr: 86.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45958.log 2024-09-21T07:12:18.869 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49195.log.gz 2024-09-21T07:12:18.869 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45187.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45187.log.gz 2024-09-21T07:12:18.869 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45145.log 2024-09-21T07:12:18.869 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T07:12:18.869 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45145.log: /var/log/ceph/ceph-client.admin.45958.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45958.log.gz 2024-09-21T07:12:18.870 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45145.log.gz 2024-09-21T07:12:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37011.log 2024-09-21T07:12:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49111.log 2024-09-21T07:12:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.37011.log: 92.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-21T07:12:18.870 INFO:teuthology.orchestra.run.smithi018.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.37011.log.gz 83.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T07:12:18.870 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-21T07:12:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45729.log 2024-09-21T07:12:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42958.log 2024-09-21T07:12:18.870 INFO:teuthology.orchestra.run.smithi018.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49111.log.gz/var/log/ceph/ceph-client.admin.45729.log: 2024-09-21T07:12:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45729.log.gz 2024-09-21T07:12:18.870 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.49279.log 2024-09-21T07:12:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42958.log: gzip 86.7% -- replaced with /var/log/ceph/ceph-client.admin.42958.log.gz 2024-09-21T07:12:18.870 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42052.log 2024-09-21T07:12:18.870 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45019.log 2024-09-21T07:12:18.871 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49279.log.gz/var/log/ceph/ceph-client.admin.42052.log: 2024-09-21T07:12:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46850.log 2024-09-21T07:12:18.871 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42052.log.gz 2024-09-21T07:12:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43495.log 2024-09-21T07:12:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45019.log: /var/log/ceph/ceph-client.admin.46850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48398.log 2024-09-21T07:12:18.871 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45019.log.gz 2024-09-21T07:12:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43495.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46850.log.gz 2024-09-21T07:12:18.871 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46934.log 2024-09-21T07:12:18.871 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43495.log.gz 2024-09-21T07:12:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44977.log 2024-09-21T07:12:18.871 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.48398.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.45298.log 2024-09-21T07:12:18.871 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-21T07:12:18.871 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46934.log: /var/log/ceph/ceph-client.admin.44977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48901.log 2024-09-21T07:12:18.872 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46934.log.gz 2024-09-21T07:12:18.872 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44977.log.gz 2024-09-21T07:12:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37631.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45298.log.gz 2024-09-21T07:12:18.872 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-21T07:12:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48901.log: gzip -5 --verbose 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48901.log.gz 2024-09-21T07:12:18.872 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.42361.log 2024-09-21T07:12:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37631.log: gzip -5 --verbose 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37631.log.gz 2024-09-21T07:12:18.872 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.47018.log 2024-09-21T07:12:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42361.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42361.log.gz 2024-09-21T07:12:18.872 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.41824.log 2024-09-21T07:12:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47018.log: gzip -5 --verbose 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47018.log.gz 2024-09-21T07:12:18.872 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.48314.log 2024-09-21T07:12:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42697.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41824.log.gz 2024-09-21T07:12:18.872 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-21T07:12:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48314.log: gzip -5 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48314.log.gz 2024-09-21T07:12:18.873 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43293.log 2024-09-21T07:12:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42147.log 2024-09-21T07:12:18.873 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42697.log.gz 2024-09-21T07:12:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47314.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43293.log.gz 2024-09-21T07:12:18.873 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-21T07:12:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42147.log: gzip -5 --verbose -- 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42147.log.gz 2024-09-21T07:12:18.873 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.47060.log 2024-09-21T07:12:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.47314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47314.log.gz 2024-09-21T07:12:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48146.log 2024-09-21T07:12:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5/var/log/ceph/ceph-client.admin.47060.log: --verbose -- /var/log/ceph/ceph-client.admin.48188.log 2024-09-21T07:12:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47771.log 2024-09-21T07:12:18.873 INFO:teuthology.orchestra.run.smithi018.stderr: 91.0% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48146.log.gz 2024-09-21T07:12:18.874 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47060.log.gz 2024-09-21T07:12:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49447.log 2024-09-21T07:12:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47771.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30403.log 2024-09-21T07:12:18.874 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48188.log.gz 2024-09-21T07:12:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49447.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.47771.log.gz 2024-09-21T07:12:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48458.log 2024-09-21T07:12:18.874 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49447.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49741.log 2024-09-21T07:12:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.tmp-client.admin.30403.log: 2024-09-21T07:12:18.874 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30403.log.gz 2024-09-21T07:12:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48626.log 2024-09-21T07:12:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45603.log 2024-09-21T07:12:18.874 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48458.log.gz 2024-09-21T07:12:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48626.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49741.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41948.log 2024-09-21T07:12:18.874 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-21T07:12:18.875 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48626.log.gz 2024-09-21T07:12:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49573.log 2024-09-21T07:12:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45603.log: /var/log/ceph/ceph-client.admin.41948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46300.log 2024-09-21T07:12:18.875 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45603.log.gz 2024-09-21T07:12:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49573.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41948.log.gz 2024-09-21T07:12:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49573.log.gz 2024-09-21T07:12:18.875 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47687.log 2024-09-21T07:12:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46300.log: gzip -5 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46300.log.gz 2024-09-21T07:12:18.875 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36938.log 2024-09-21T07:12:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46173.log 2024-09-21T07:12:18.875 INFO:teuthology.orchestra.run.smithi018.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.47687.log.gz 2024-09-21T07:12:18.875 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36877.log 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36938.log.gz 2024-09-21T07:12:18.875 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-21T07:12:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46173.log: gzip -5 --verbose 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46173.log.gz 2024-09-21T07:12:18.876 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.49153.log 2024-09-21T07:12:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36877.log: gzip 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36877.log.gz 2024-09-21T07:12:18.876 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43663.log 2024-09-21T07:12:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49615.log 2024-09-21T07:12:18.876 INFO:teuthology.orchestra.run.smithi018.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49153.log.gz 2024-09-21T07:12:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42959.log 2024-09-21T07:12:18.876 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43663.log.gz 2024-09-21T07:12:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49615.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49615.log.gz 2024-09-21T07:12:18.876 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-21T07:12:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42959.log: gzip 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42959.log.gz 2024-09-21T07:12:18.876 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46724.log 2024-09-21T07:12:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47645.log 2024-09-21T07:12:18.876 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42319.log 2024-09-21T07:12:18.877 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46724.log.gz 2024-09-21T07:12:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47645.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-21T07:12:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42319.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47645.log.gz 2024-09-21T07:12:18.877 INFO:teuthology.orchestra.run.smithi018.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42319.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48272.log 2024-09-21T07:12:18.877 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-21T07:12:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41728.log 2024-09-21T07:12:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.48272.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48272.log.gz 2024-09-21T07:12:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41647.log 2024-09-21T07:12:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41728.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-21T07:12:18.877 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41728.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45687.log 2024-09-21T07:12:18.877 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-21T07:12:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36726.log 2024-09-21T07:12:18.877 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45687.log: /var/log/ceph/ceph-client.admin.41647.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41647.log.gz 2024-09-21T07:12:18.877 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45687.log.gz 2024-09-21T07:12:18.878 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36726.log: 76.0% -- replaced with /var/log/ceph/ceph-client.admin.36726.log.gz 2024-09-21T07:12:18.878 INFO:teuthology.orchestra.run.smithi018.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-21T07:12:18.878 INFO:teuthology.orchestra.run.smithi018.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-21T07:12:18.878 INFO:teuthology.orchestra.run.smithi049.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-21T07:12:18.880 INFO:teuthology.orchestra.run.smithi018.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-21T07:12:18.885 INFO:teuthology.orchestra.run.smithi018.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-21T07:12:18.887 INFO:teuthology.orchestra.run.smithi049.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-21T07:12:18.892 INFO:teuthology.orchestra.run.smithi049.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-21T07:12:18.895 INFO:teuthology.orchestra.run.smithi049.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-21T07:12:18.904 INFO:teuthology.orchestra.run.smithi049.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-21T07:12:18.913 INFO:teuthology.orchestra.run.smithi049.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-21T07:12:18.930 INFO:teuthology.orchestra.run.smithi049.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-21T07:12:18.931 INFO:teuthology.orchestra.run.smithi049.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-21T07:12:18.933 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-09-21T07:12:18.933 INFO:teuthology.orchestra.run.smithi049.stderr:real 0m0.163s 2024-09-21T07:12:18.933 INFO:teuthology.orchestra.run.smithi049.stderr:user 0m0.928s 2024-09-21T07:12:18.934 INFO:teuthology.orchestra.run.smithi049.stderr:sys 0m0.048s 2024-09-21T07:12:18.937 INFO:teuthology.orchestra.run.smithi018.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-21T07:12:18.950 INFO:teuthology.orchestra.run.smithi018.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-21T07:12:18.952 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-21T07:12:18.952 INFO:teuthology.orchestra.run.smithi018.stderr:real 0m0.207s 2024-09-21T07:12:18.952 INFO:teuthology.orchestra.run.smithi018.stderr:user 0m0.714s 2024-09-21T07:12:18.952 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m0.150s 2024-09-21T07:12:18.952 INFO:tasks.ceph:Archiving logs... 2024-09-21T07:12:18.952 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913583/remote/smithi018/log 2024-09-21T07:12:18.953 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T07:12:19.240 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913583/remote/smithi049/log 2024-09-21T07:12:19.241 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T07:12:19.371 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T07:12:19.386 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T07:12:19.386 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T07:12:19.389 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T07:12:19.476 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T07:12:19.485 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T07:12:19.485 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:12:19.488 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:12:19.501 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:12:19.503 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:12:19.506 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:12:19.506 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-21T07:12:19.506 INFO:teuthology.orchestra.run.smithi018.stdout:^* hv01.front.sepia.ceph.com 3 6 177 61 +30us[ +10us] +/- 39ms 2024-09-21T07:12:19.506 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 61 -114us[ -114us] +/- 49ms 2024-09-21T07:12:19.506 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 62 +106us[ +87us] +/- 85ms 2024-09-21T07:12:19.506 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:12:19.508 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:12:19.508 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-09-21T07:12:19.508 INFO:teuthology.orchestra.run.smithi049.stdout:^* hv01.front.sepia.ceph.com 3 6 177 61 +32us[ +13us] +/- 39ms 2024-09-21T07:12:19.508 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 62 -127us[ -146us] +/- 49ms 2024-09-21T07:12:19.508 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 61 +109us[ +90us] +/- 85ms 2024-09-21T07:12:19.508 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:12:19.509 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T07:12:19.518 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T07:12:19.518 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T07:12:19.529 DEBUG:teuthology.orchestra.run.smithi018:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T07:12:19.617 DEBUG:teuthology.orchestra.run.smithi049:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T07:12:19.683 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T07:12:19.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:12:19.712 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T07:12:19.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:12:19.741 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T07:12:19.750 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T07:12:19.759 INFO:teuthology.task.internal:Duration was 498.848372 seconds 2024-09-21T07:12:19.760 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T07:12:19.769 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T07:12:19.770 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T07:12:19.772 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T07:12:19.810 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:12:19.821 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:12:20.133 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T07:12:20.134 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T07:12:20.134 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T07:12:20.195 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T07:12:20.196 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T07:12:20.225 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T07:12:20.225 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T07:12:20.238 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T07:12:20.294 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T07:12:20.294 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T07:12:20.305 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T07:12:20.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T07:12:20.455 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T07:12:20.455 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T07:12:20.481 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T07:12:20.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T07:12:20.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:12:20.524 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:12:20.545 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-09-21T07:12:20.572 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2024-09-21T07:12:20.587 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:12:20.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:12:20.614 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:12:20.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:12:20.642 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T07:12:20.652 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T07:12:20.652 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913583/remote/smithi018 2024-09-21T07:12:20.653 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T07:12:20.688 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913583/remote/smithi049 2024-09-21T07:12:20.688 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T07:12:20.722 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T07:12:20.722 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T07:12:20.725 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T07:12:20.772 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T07:12:20.784 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T07:12:20.784 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T07:12:20.793 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T07:12:20.793 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T07:12:20.796 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T07:12:20.809 INFO:teuthology.orchestra.run.smithi018.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 07:12 /home/ubuntu/cephtest 2024-09-21T07:12:20.828 INFO:teuthology.orchestra.run.smithi049.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 07:12 /home/ubuntu/cephtest 2024-09-21T07:12:20.829 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T07:12:20.840 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T07:12:20.864 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}} duration: 498.8483717441559 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T07:12:20.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T07:12:20.948 INFO:teuthology.run:pass